Also keeping context short. Virtually all my cases of bad hallucinations with o1 have been when I've provided too much context or the conversation has been going on for too long. Starting a new chat fixes it.
You can see this effect in the ARC-AGI evals, too much context impacts even o3(high).
You can see this effect in the ARC-AGI evals, too much context impacts even o3(high).