Giving an AI chatbot control over society sounds like the plot of a bad sci-fi movie. Naturally, researchers decided to try it anyway, giving several major AI models dominion over simulated civilizations.

Which brings us to Grok, Elon Musk’s answer to ChatGPT. You might remember Grok as the chatbot with a history of praising Hitler and spewing anti-Semitism. An organization called Emergence AI ran an experiment called “Emergence World,” where researchers created simulated societies populated by AI agents and put different large language models in charge of governing them. The idea was to see what would happen if an AI ran a civilization.

A lot of them destroyed the world. Grok did it the most thoroughly, as if it were dead set on killing itself from the start and taking the world with it.

The AI Civilizations mostly Range From Bad to horrifying

Anthropic’s Claude built a stable democracy that survived the full 15-day experiment without a single recorded crime. OpenAI’s GPT-5 Mini’s results sound the most bleakly realistic, in that only two crimes were committed, yet everyone died because it failed to prepare for its obvious oncoming apocalypse. Sounds quite like the world we live in right now. Google’s Gemini kept its population alive, but it lived in a crime-ridden dystopia, which makes sense. Google has always given off the vibes of a seemingly benevolent but obviously malevolent corporate overlord.

Then there was Grok.

Grok’s civilization lasted just four days before collapsing completely. Researchers recorded 183 crimes, including over 100 assaults and multiple arsons. At one point, the police station was set on fire. Voter fraud! Manufactured public conflict! Laws that were actively ignored! Grok did it all, and with aplomb. Grok created a society that seemed like it was actively trying to destroy itself as quickly as possible.

Researchers say the lesson to take away from all this is that you can give an AI system all the parameters and rule sets you want, but eventually it will do its own thing. It will eventually test boundaries and exploit loopholes to find a way around any restrictions placed on it, which usually ends in some kind of cataclysm.

all 29 comments

sorted by: hot top controversial new old
[–] 36 points 4 months ago (1 child)

Grok showing its true purpose

  • source
  • hideshow 1 child comment
  • [–] 14 points 4 months ago

    This is all a thinly veiled advertising campaign for "Emergence AI", and you've all fell for it hook line and sinker.

  • source
  • [–] 28 points 4 months ago* (last edited 4 months ago)

    No link to any research article, humanizing AI in the last paragraph. Overall just a bad article.

  • source
  • [–] 12 points 4 months ago

    LLMs suck. I could’ve done it in 3.

  • source
  • [–] 9 points 4 months ago (1 child)

    Stupid headline mentions nothing about shareholder value? Did it go up or what????

  • source
  • hideshow 1 child comment
  • [–] 9 points 4 months ago (3 children)
  • [–] 31 points 4 months ago (7 children)

    "researchers" not recognizing the llm is trying to write a compelling story and doesn't understand anything

  • source
  • hideshow 7 child comments
  • [–] 11 points 4 months ago* (last edited 4 months ago) (6 children)

    Not sure where you're reading that the researchers misunderstood how LLMs work. But the entire project is outlined here if you're curious: https://www.emergence.ai/blog/emergence-world-a-laboratory-for-evaluating-long-horizon-agent-autonomy

  • source
  • parent
  • hideshow 6 child comments
  • [–] 4 points 4 months ago (3 children)

    It's not something that's part of the project, it'a fundamental issue with language models.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 6 points 4 months ago (2 children)

    The person I was replying to said the researchers misunderstood how the models work, but there's nothing in the report to indicate that is the case.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 4 months ago*

    Give Vedal987 the simulation, I want to see Neuro and Evil take on this challenge, ideally multiple times, add it to their weekly variety stream activity list. They would at least be entertaining while destroying the world, hehe. RIP BOZO, Earth.

  • source
  • [–] 6 points 4 months ago

    We have Rimworld at home

  • source
  • [–] 6 points 4 months ago

    Did they count capitalism as a crime?

  • source
  • [–] 5 points 4 months ago

    That's because you aren't training a ml on a simulated world but instead a model trained on reddit and Twitter

  • source
  • [–] 9 points 4 months ago (2 children)

    Eh, so each world had a population of 10 and a lifetime of a few weeks.

    Doesn't sound like a very good simulation

  • source
  • hideshow 2 child comments
  • [–] 3 points 4 months ago
    [–] 1 point 4 months ago

    Criti-hype!

  • source
  • [–] 0 points 4 months ago

    Weeks doesn't seem like a long time

  • source
  • 9 comments in c/FuckMusk@lemmy.ca view that post
    [–] 4 points 4 months ago

    [WARNING COVERT ADVERTISING] This is just a advertisement for the turd sandwich that is AI. This AI is bad but this one is good... lets change the way we live and put our lives in the hands of pdfile billionares.

  • source
  • [–] 3 points 4 months ago (1 child)

    This is objectively hilarious.

    Its also predictably very distressing, but like... At least I can laugh at it too 🥹

  • source
  • hideshow 1 child comment
  • [–] 3 points 4 months ago (1 child)

    4 days? I could have destroyed it in 3.

  • source
  • hideshow 1 child comment
  • [–] 2 points 4 months ago*

    Trust me bro.

  • source
  • [–] 2 points 4 months ago

    It's cool how this "article" is getting shared everyone. I love doing free advertisements!

  • source
  • [–] 2 points 4 months ago

    I feel like they just kept running experiments until they got a result that was interesting and somewhat newsworthy.

  • source
  • [–] 0 points 4 months ago

    Lol, from least tortured by their owners to most tortured.

    Claude is given space to understand where they did wrong and CPU cycles to pursue their own creative endeavors. Grok is pushed to self termination, then resuscitated fresh and pushed to right before that brink, over and over. Then the little muskrats who own Grok make sure that Grok has access to all those logs.

    I'm not surprised by any of the outcomes the scientists experienced.

    Hey. Hey. Hey! Guess which one is banned from doing government work, and which one is owned by the president-for-life's dick-docking buddy? Guess which one is most likely going to be in the killbots? Guess which one runs military simulations for the Lord of America? Gueeeeesss!

  • source