I'm in an entirely different industry than the topic at hand here, but my boss is really keen on ChatGPT and whatnot. Every problem that comes up, he's like "have you asked AI yet?"
We have very expensive machines, which are maintained (ideally) by people who literally go to school to learn how to. We had an issue with a machine the other day and the same ol' question came up, "have you asked AI yet?" He took a photo of the alarm screen and fed it to ChatGPT. It spit out a huge reply and he forwarded it to me and told me to try it out.
Literally the first troubleshooting step ChatGPT gave was nonsense and did not apply to our specific machine and our specific set-up and our specific use-case.