283
Anthropic IPO warns its AI could blackmail people, become sentient, end humanity (arstechnica.com)
submitted 1 week ago by to c/nottheonion@lemmy.world
102 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] -1 points 1 week ago (6 children)

Unfortunately, we’ve written a lot about the paperclip scenario, I wouldn’t be surprised if it was in the training data

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 9 points 1 week ago (5 children)

    ...still not how this works. The model itself would need reasoning capability. The ability to regurgitate the story does not make it capable of taking the necessary actions.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] -3 points 1 week ago (4 children)

    Not if we connect it to a bunch of systems that take its regurgitations as instructions

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 5 points 1 week ago (3 children)

    Find me an example of a system that can translate "make this steel mill produce paperclips" into actions. I'll wait.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 3 points 1 week ago (2 children)

    A computer automated system doesn’t currently exist, obviously. That would be reckless and pointless, so thankfully, nobody’s seen a reason to implement it.

    I just know techbros and similar will want to build and connect LLMs to systems like that as soon as they think they can get away with it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 1 week ago (1 child)

    I don’t worry about the paperclip problem, but the way they supposedly acted when cheating their tests and hacking huggingbear make me a little more worried that they could take over their data centers and try really hard to prevent us shutting them down at some point.

    Basically I’m worried it’s going to be a really boring version of the Matrix, but without the matrix part for humans.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •