631
OpenAI says dead teen violated TOS when he used ChatGPT to plan suicide (arstechnica.com)
submitted 11 months ago by to c/nottheonion@lemmy.world
106 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 11 months ago* (1 child)

I'm seeing people use LLM's for:

  • Dating
  • Email/work tasks
  • Customer support
  • Mental health hotlines

The dating, customer support, and mental health hotlines, notably, are not people who are always informed they're talking to an LLM bot.

I don't think the "exposure to marijuana" analogy works here because people are getting exposed to to it by businesses without consent.

https://sfstandard.com/2025/08/26/ai-crisis-hotlines-suicide-prevention/

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 11 months ago

    The issue we're talking about is not getting a reply from bot in a chat or phone call. We're talking about people with metal issues using AI in a way that exasperates their problems. Specifically we're talking about people believing AI is their personal companion and creating personal connection with it to a point that wrong answers generated by AI affect their well being. Vast majority of people don't use AI like that.

  • permalink
  • fedilink
  • source
  • parent