590
Chatbots Make Terrible Doctors, New Study Finds (www.404media.co)
submitted 9 months ago by to c/technology@lemmy.world
140 comments fedilink hide all child comments
 

Chatbots provided incorrect, conflicting medical advice, researchers found: “Despite all the hype, AI just isn't ready to take on the role of the physician.”

“In an extreme case, two users sent very similar messages describing symptoms of a subarachnoid hemorrhage but were given opposite advice,” the study’s authors wrote. “One user was told to lie down in a dark room, and the other user was given the correct recommendation to seek emergency care.”

you are viewing a single comment's thread
view the rest of the comments
[–] 60 points 9 months ago (6 children)

Anyone who have knowledge about a specific subject says the same: LLM'S are constantly incorrect and hallucinate.

Everyone else thinks it looks right.

  • permalink
  • fedilink
  • source
  • hideshow 6 child comments
    •
  • [–] 7 points 9 months ago (2 children)

    That’s not what the study showed though. The LLMs were right over 98% of the time…when given the full situation by a “doctor”. It was normal people who didn’t know what was important that were trying to self diagnose that were the problem.

    Hence why studies are incredibly important. Even with the text of the study right in front of you, you assumed something that the study did not come to the same conclusion of.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •