I feel like calling „hallucinations“ a side effect isn’t really describing the issue properly. They’re not a side effect, nor are they hallucinations. It implied that there’s somehow something that distinguishes „correct“ output from „incorrect“. There isn’t, it’s all just output. The output resembling actual factual reality is statistical chance.