Who knew that "simulating" human conversations based on extruded text strings that have no basis in grounded reality or fact could send people into spirals of delusion?
post
Talking to a hallucination is, in fact, not good for you.
One recent peer-reviewed case study focused on a 26-year-old woman who was hospitalized twice after she believed ChatGPT was allowing her to talk with her dead brother
I feel like the bar for the turing test is lower than ever... You can't tell ChatGPT apart from your own relatives??
My cousin lost her young daughter a few years back. At Christmas, she had used AI to put her daughter in her Christmas photo. I didn't have words, because it made her so happy, and I can't fathom her grief, but man. Felt pretty fucked.
So the developing psychosis could be causing the AI use?
That's what the article says, yes:
“The technology might not introduce the delusion, but the person tells the computer it’s their reality and the computer accepts it as truth and reflects it back, so it’s complicit in cycling that delusion,” Sakata told the WSJ.
Thing that tells you exactly what you want to hear causes delusions?
Whaaat?
I completely understand why articles like this need to exist. Information about what 'AI' actually is needs to be spread. That being said, I also can't remove myself from the impression that this is just incredibly obvious. Like one of those studies about whether a dog actually loves their owner by going to lengths such as an MRI of their brain while looking at their owner.
Like, thank you mystery researcher on the internet — but you could have saved the helium by just sticking to Occam's Razor.
Hey now, my walls are perfect companions, they may be silently judging me but they are always supportive and never sycophantic.
Good small talk tutorial. Terrible everything else
You increase the sample size, you increase the number of hits.
Do you think statisticians aren't well aware of this?
If the statisticians involved in this case study are anywhere close to as unhinged as you are then it's no wonder they got those results lol
Huh? The whole point of this emerging scientific debate is that AI use might be proportionally unsafe, i. e. it might be a risk factor causing and/or exacerbating psychosis. Now sure this is still just a hypothesis and it's too early to make definite epidemiological statements, but it's just as wrong to blankly state that AI is "still just as safe".
Alright, but the point is that the "X level of safety" AI is at might be a dangerous level in the first place. I don't think anybody is arguing that AI got more dangerous as a psychosis risk factor over the past year or so, they're arguing that AI was a risk factor to begin with, and with increased AI use more evidence of this turns up. So you saying that the inherent risk of AI hasn't changed is kind of a moot point because that's not what the debate is about.
Also notice that I clearly said it's too early to tell one way or the other, so there's no reason to malign me as uncritical.
I can agree with that. (As an aside, I think scientific findings are almost always exaggerated like this in popular journalism.)
I'd say the long and short of it is that we simply don't (and can't) know yet. But I think more research on possible links between AI and psychotic delusions is definitely useful, because I find the idea of a connection plausible.
How do LLM interactions compare to… Kinder eggs or lawn darts in terms of safety?
all 26 comments