nyan comments on Kids Hooked on AI Chatbots Are Showing Dramatically Worse Mental Health: They're turning to AI chatbots for help, but their machine confidantes are doing more harm than good.

[–] nyan@lemmy.cafe 21 points 1 day ago (5 children)

Someone telling you what they think you want to hear doesn't help when what you need is a gently and delicately delivered reality check. This is true even if you're talking to a human.

permalink

fedilink

source

hideshow 5 child comments

[–] otp@sh.itjust.works 7 points 1 day ago (4 children)

Some chatbots do reality checks. But it's usually only for extreme situations. I can only imagine the kinds of things that people, especially young people, would be asking LLMs to validate them on...

permalink

fedilink

source

parent

hideshow 4 child comments

[–] biggerbogboy@sh.itjust.works 2 points 1 day ago (3 children)

They also assume you're out of control of everything, like talking about how you overcame a mental health issues without following popular advice, then it delivers an unnecessarily condescending "reality check"

I'm glad I've stopped using the mainstream AI sites entirely over a year ago, they may be more helpful compared to local LLMs and SLMs but they assume you're using it because you can't depend on yourself.

I hope these reality checks improve enough to actually be helpful and be based on the described situation, not just be a cookie cutter response enforced by a system prompt

permalink

fedilink

source

parent

hideshow 3 child comments

[–] RumRunningDevil@lemmy.zip 11 points 1 day ago (2 children)

Or, here's an idea, ban the fuck out of these things.

permalink

fedilink

source

parent

hideshow 2 child comments

[–] biggerbogboy@sh.itjust.works 4 points 1 day ago (1 child)

I think banning it from being a business venture is a good idea, and realistically the technology for generative AI will stay even if there's an outright ban.

People will still be able to build their own models and cybersecurity defense will continue keeping up with black hat hacking, but corpos like OpenAI, or divisions like Google's numerous AI divisions, should be banned unless it has an explicit purpose for research in things like the medical field, and have generative AI as we know it right now be culled.

permalink

fedilink

source

parent

hideshow 1 child comment

[–] RumRunningDevil@lemmy.zip 6 points 1 day ago

I would be on board for this. Regulate use to very select applications, ban commercial use without specific permits.

I have kids, I stay awake at night a lot these days wondering what I'm supposes to tell them when they look up at me and tell me they want to be a doctor, engineer, or lawyer when they grow up. What the fuck do I get them to aspire to when we're hurtiling towards a world where there's nothing to aspire to anymore? How do I convince them to study hard and learn things when there is no economic incentive to do so? What kind of kids are we raising when they exist in a world of infinite dopamine and a personal familiar that grants your every magic wish?

permalink

fedilink

source

parent