throws_lemy comments on Father sues Google, claiming Gemini chatbot drove son into fatal delusion

[–] man_wtfhappenedtoyou@lemmy.world 12 points 8 months ago (5 children)

How do you even get these chat bots to start telling you shit like this? Is it just from having a conversation for too long in the same chat window or something? I don't understand how this keeps happening.

permalink

fedilink

source

hideshow 5 child comments

[–] throws_lemy@reddthat.com [S] 21 points 8 months ago (3 children)

This could happen to anyone including people without having mental issues, simply by having long conversations with AI.

On 7 August, Kate Fox received a phone call that upended her life. A medical examiner said that her husband, Joe Ceccanti – who had been missing for several hours – had jumped from a railway overpass and died. He was 48.

Fox couldn’t believe it. Ceccanti had no history of depression, she said, nor was he suicidal – he was the “most hopeful person” she had ever known. In fact, according to the witness accounts shared with Fox later, just before Ceccanti jumped, he smiled and yelled: “I’m great!” to the rail yard attendants below when they asked him if he was OK.

Her husband wanted to use ChatGPT to create sustainable housing. Then it took over his life.

permalink

fedilink

source

parent

hideshow 3 child comments

[–] sudo@lemmy.today 5 points 8 months ago (2 children)

So it sounds like he was in fact not 'great'

permalink

fedilink

source

parent

hideshow 2 child comments

[–] XLE@piefed.social 4 points 8 months ago (1 child)

In the same way that homelessness correlates to drug addiction. There are many cases where a person becomes homeless, and then becomes addicted to drugs. You could, but probably shouldn't, say that the state of homelessness just proved they had addiction issues.

permalink

fedilink

source

parent

hideshow 1 child comment

[–] echodot@feddit.uk 1 point 8 months ago

Ok but walk it back a bit, why did they become homeless?

If somebody is completely 100% mentally healthy I can't see how an AI can convince them to kill themselves any more than another person could convince them to kill themselves. Only vulnerable people join cults, because it's difficult to pray on people who have proper defences.

I'm still not convinced that the AI isn't just triggering some underlying mental condition that other people in their lives are just not aware of or not willing to accept.