It isn't pedantry in the case I'm making. I'm making more of a moral/ethical point in that it's unfair and probably ableist to people who do actually hallucinate to compare them with something that doesn't actually do that.
It is robbing the word of any value or meaning and kind of making fun of them in the process, downplaying what they go through.