Cherry comments on Top AI Researchers Terrified of a “Chernobyl Moment”: a Mass Casualty Event, or Worse, That Turns the World Against AI Forever

[–] Cherry@piefed.social 18 points 4 months ago (1 child)

That implies an actual AI when the truth is in current form human error using the tool behind it.

Personally I am more concerned by it will be used by design of the techbros who are pretty open in their desire to be rid of some of the masses. Supporting emerging wars just masks their part….for now.

permalink

fedilink

source

hideshow 1 child comment

[–] Fondots@lemmy.world 8 points 4 months ago* (last edited 4 months ago)

I don't think it needs to be an actual AI to cause a "Chernobyl Moment" maybe almost literally.

We have tech bros and random clueless idiots trying to shoehorn these glorified chat bots into basically everything, and an administration that doesn't seem interested in putting meaningful guardrails on the technology. What happens when it gets put in charge of something it really shouldn't and starts to hallucinate?

If it somehow ends up in charge of critical safety systems in a nuclear plant? (Remember that some of these tech bros want to have their own plants to power their data centers)

Or air traffic control and causes multiple crashes? (Pretty sure I've already seen that idea being floated)

Maybe every cybertruck goes haywire stuck on self-driving mode and they cause tons of damages and deaths for a few hours until their batteries run out.

Maybe it gets used to route navigation in Google maps and it ends up causing massive gridlock in every major city around the world for a day or two

Perhaps it gets used for identifying vehicles on traffic cameras and automatically issuing citations, but ends up citing everyone on the highway for a week whether or not they actually did anything plus a bunch of cars that it hallucinated before someone catches on. Millions of tickets are issued and need to be sorted out, if anyone actually pays the fines refunds need to be issued, some people maybe get their license revoked and maybe even get arrested because of it and all of that needs to be set straight

If any of these kinds of things happen on a big enough scale, I think that could be a Chernobyl Moment for AI

permalink

fedilink

source

parent

[–] Cherry@piefed.social 1 point 4 months ago (-1 children)

Yes. I just think the concept is more imagined as a sentient entity making an error rather than overconfidence or incompetence with the tool at hand.

And of course we all know it will be used as a scapegoat regardless. Question is what’s the magic number of humans lost to confidence in the machine ratio, before pushback occurs. It sounds horrific even typing it.

permalink

fedilink

source

parent

hideshow -1 child comments

[–] echodot@feddit.uk 1 point 4 months ago (-1 children)

I don't think it's about number of people I think it's about perceived sense of urgency on the part of various governments. A lot of people aren't very happy with AI but the threats are all existential at the moment. The moment something happens all the people who are already not happy with AI will suddenly have a threat to point to and then the governments around the world will have no choice but to act.

Although I suspect the Trump administration will still try and weedle out of regulating anything because they have so much business interest in the industry.