AI is anathema to teaching and learning.
Your statement on its face value, sure I agree, but I can see a path were AI is a fantastic tool for teaching and learning critical thinking. If the teacher is able to alter the "temperature" setting of the LLM, they could crank it all the way up to 1 (meaning full creativity) which will likely induce AI hallucination.
The AI LLM can create output which can speak to a topic but even those with only a little bit of knowledge can easily see the flaws in the AI response. It would give the student a chance to see how rational sounding output can be factually wrong. It would teach students to evaluate the statements individually and tease out logical fallacies or even outright manufactured falsehoods.
Further, if the teacher can again set the temperature lower (perhaps to .7) which reduces the creativity then the LLM output would be more factual with possible logical or factual errors. This would increase the difficulty on the students to be able to inspect what they are given as LLM output and explore the tools and resources available to provide a human check on not only AI, but anything that another human says too.
It can become an excellent tool for teaching critical thinking.
EDIT: The more I'm thinking about this, the better I see this as a teaching tool. Tests students take to cover the material can be teacher created questions accompanied with a completely AI generated answer and the question to the student is "Is this true or bullshit? If bullshit, which parts are wrong?". Every question on the entire test could use that format. It would be a great test of the student because they'd have to know the material well enough to know where the LLM produced a "right sounding answer" but was in fact, wrong. Even better, if a student tried to cheat using their own AI to answer the "bullshit or not?" question there's an even higher chance the students cheating LLM would give a wrong answer because of the repeated Error Cascade.