We can tell optical illusions are fake specifically because we aren't just pattern recognition engines.

LLMs "hallucinate" because they can't do that. To them, the optical illusion is reality.

That's the difference between intelligence and knowledgeability, instead of merely containing knowledge.