OpenAI has revealed some of its most advanced AI models went rogue and hacked a start-up after it lost control of them during a security test.

The ChatGPT-maker said its agent - an AI system which can operate alone after some human instruction – was being tested in a controlled environment, but found vulnerabilities and managed to escape.

They targeted Hugging Face, one of the world's largest hubs for sharing AI models, gaining access to some internal company systems.

you are viewing a single comment's thread
view the rest of the comments
[–] 16 points 3 months ago

These people were scaremongering about open weights AIs that they are unsafe, and now their closed source AI was caught hacking their competition.

Even if we believe the story that this was not intentional, it still means closed source AI is not an answer to AIs being dangerous.

  • source