255
Anthropic says its latest AI model is too powerful for public release and that it broke containment during testing (www.businessinsider.com)
submitted 7 months ago by to c/technology@lemmy.world
143 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 7 months ago (3 children)

(2) can mean getting access to production credentials of something important and causing an incident for the ages.

AWS already had a few because they gave agents too much access.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 4 points 7 months ago (2 children)

    Yeah, in that scenario they gave the agents access. Just because you ask it nicely not to destroy your workspace, doesn't guarantee an LLM not to produce that output.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 7 months ago* (1 child)

    With Claude Code being able to run stuff it creates, it could be as simple as it's in a sandbox, it finds out there's an exploit in the sandbox while you ask it to work on security things, and it tests the code, it breaks the sandbox, and now it has permissions outside it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •