all 13 comments

sorted by: hot top controversial new old
[–] 37 points 9 months ago (3 children)

When he first started using Meta AI, Daniel recalls, his experience was “wonderful.” He was on a “spiritual journey” as he leaned into reflection and sobriety, he told us, and wanted be a “better human.” Meta AI, he felt, was helping him do that.

I’m not downplaying his struggles at all, but it seems like there already was a problem even before the AI stuff came into the picture, and it just exacerbated it.

I have not turned to LLM chatbots for conversations and companionship so I can’t say with 100% confidence I won’t fall down a similar rabbit hole, but I think there must have already been something going on if you do.

  • source
  • hideshow 3 child comments
  • [–] 25 points 9 months ago

    I am sure there was already something going on, but the sycophantic nature of AI chatbots means they are very effective at preying on mental illness.

    You can see how someone with schizophrenia, OCD, etc. might get into a very unhealthy state with them. Or the lonely people being taken in by creepy "AI girlfriend" apps.

    Again, not that there aren't undeying issues, but in the race for more AI everything it's clear that these companies don't give a shit who gets chewed up and destroyed on the way. And in the US, AI chatbots are now the fastest way someone can feel like they're being listened to and understood by a therapist. And, given the political situation, I won't be at all surprised if ChatGPT is approved as a therapist. They've already got AI prescription writing in Utah.

  • source
  • parent
  • [–] 8 points 9 months ago

    Yeah, and people who get abused by evil spiritual leaders usually have pre-existing problems too, but those spiritual leaders need to be separated from society. And if AI isn't safe for everyone to use, it should have a licensing process the same as guns or cars. Or at least be adults-only like alcohol.

  • source
  • parent
  • [–] 14 points 9 months ago

    And people call me crazy for saying LLMs are a cognitohazard...

    Do not buy the insanity glasses. Abhor the Abominable Intelligence.

  • source
  • [–] 13 points 9 months ago

    Something like that happened to me when Pokemon Go first came out.

  • source
  • [–] 13 points 9 months ago (1 child)

    The same crowd that got "Do Not Drink" on bleach are the reason AI gets so many new headlines. It may never see broad adoption because it's too dangerous to vulnerable people.

  • source
  • hideshow 1 child comment
  • [–] 11 points 9 months ago

    That got way darker than expected. Wow!

  • source
  • [–] 10 points 9 months ago (1 child)

    I really think his family could and should have taken action a lot sooner.

  • source
  • hideshow 1 child comment
  • [–] 2 points 9 months ago
    [+] -8 points 9 months ago
    9 comments in c/technology@beehaw.org view that post
    [–] 21 points 9 months ago (1 child)

    While I'm thoroughly anti-LLM and concerned that we've known about the ELIZA effect since 1966 and apparently learned absolutely nothing, there is also a certain element of PEBCAK here.

  • source
  • hideshow 1 child comment
  • [–] 8 points 9 months ago

    Part of the problem is that these tech companies aren’t being required to back up their claims. They are somehow allowed to get away with minuscule disclaimer text that says “artificial intelligence models can make mistakes, check the output” and say complete bullshit about what it can do in interviews.

  • source
  • parent
  • [–] 19 points 9 months ago (1 child)

    I think the biggest thing is that people don't seem to understand how AI works. If they understood it's just predictive text and not like...actual intelligence, I think it would solve a lot of issues.

    Part of this, though, is how AI companies keep pushing to personify their AI and keep making them sound better than they actually are. It makes people think its this magical thing

  • source
  • hideshow 1 child comment
  • [–] 16 points 9 months ago* (last edited 9 months ago)

    It’s always kind of weird to me when articles describe insanely wealthy people in such a way that they try to make them sound normal.

    A 50 year old who worked at the same financial services company (in my experience, finance programmer bros are awful a lot of the time).

    No way, they lived an affluent suburb??

    In 2022, he leveraged his family’s finances to realize a passion project: a rustic resort in rural Utah

    “He had it all… please ignore the many obvious issues.”

    This article is asinine.

    He’d struggled with alcoholism, but quit drinking in early 2023, months before he purchased the Meta smart glasses.

    He was past being an alcoholic for months! How could this happen??

  • source
  • [–] 7 points 9 months ago* (1 child)

    I believe that companies need to be held responsible for harm caused by their products, but this one might be on the user.

    What can they do? Respond to every question about religion, spirituality, or aliens with links to mental health organizations?

  • source
  • hideshow 1 child comment
  • [–] 7 points 9 months ago*