One of the insanely powerful uses of AI is just parsing large amounts of data and looking for patterns. However it still requires human oversight and may overlook patterns also. I think this is the problem with AI in general: The vast majority of people can't be trusted to verify the results. Scientists are extremely thorough in general so that's probably fine.
I had a family member arguing with me about a particular piece of law that I happened to be very familiar with. They are actually an attorney. And they flaunted that as if it made them right. The problem is they didn't even actually review the law, they just typed it into chat GPT. So they were breaking the law based on advice from a chat bot.