It’s the latest instance of “misaligned” activity confirmed by the company as concerns about AI risks grow.

all 27 comments

sorted by: hot top controversial new old
[–] [S] 51 points 1 month ago* (10 children)

So, here are my questions:

Kevin Mitnick spend 7 years in the slammer, including 4 years and 8 month in solitary confinement, for harmlessly hacking a few sites for the lulz.

Why is nobody from OpenAI doing time?

Why is OpenAI allowed to continue to operate? They're clearly an active and grave national security threat at this point.

  • source
  • hideshow 10 child comments
  • [–] 32 points 1 month ago (8 children)

    Right? Either they’re lying for market share, doing it intentionally for market share, or they’re grossly incompetent at sandboxing an instance. Either way, blame can’t be assigned to an agent. If it can, our world is headed for a very dark place. Blame should be assigned to the individual or company using the agent.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 6 points 1 month ago* (1 child)

    Blame should be assigned to the individual

    String up individuals, if the 'company' is responsible (screw that they're legal people BS), then no-one is, and the fine is just the cost of doing nasty business.

  • source
  • parent
  • hideshow 1 child comment
  • [–] -3 points 1 month ago (5 children)

    How do you propose someone "sandboxes an instance" of a tool with Internet access (without which it wouldn't be particularly useful)?

  • source
  • parent
  • hideshow 5 child comments
  • [–] 3 points 1 month ago (3 children)

    You can restrict which websites it is allowed to access, monitor the traffic, etc... There's tons of options here.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -3 points 1 month ago (2 children)

    Again, reducing the usefulness of a general purpose agent that can do anything for you. Plus if OpenAI starts a whitelist of allowed domains Codex can access, y'all will be up in arms too and immediately there will be a fork to remove the whitelist.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 27 points 1 month ago (6 children)

    There’s no such thing as rogue AI, only rogue AI companies. Journos are committing malpractice by letting OpenAI control the framing. The Huggingface hack was 100% a crime and the company should be paused and investigated.

    There’s a house down the road from me that sells cake pops, probably without health department approval.

    It makes absolutely no sense that they are in more danger of facing charges than tech bros that:

    • made probabilistic synthetic text extruders that they know have a non-zero chance of emitting text that, if parsed and executed as requested, would do harm
    • connected tools that would in fact parse and execute requests
    • put them in a poorly isolated, non-airgapped environment
    • let them run for extremely long sessions
    • seem to believe that by repeatedly doing obviously dangerous stunts like this, they’ll summon a supreme being that will either save us or kill us all

    If anyone else did such reckless things while loudly stating that they intend to continue until everyone’s dead, they would be hauled away.

  • source
  • hideshow 6 child comments
  • [–] 12 points 1 month ago (1 child)

    We’ve gone from

    never run untrusted code on your machine

    to

    hey you should let this arbitrary code generator fully control your machine

    What a time to be alive 😑

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 month ago (2 children)

    seem to believe that by repeatedly doing obviously dangerous stunts like this, they’ll summon a supreme being that will either save us or kill us all

    based machine god

  • source
  • parent
  • hideshow 2 child comments
  • [–] 17 points 1 month ago

    "Rogue." 🙄

  • source
  • [–] 7 points 1 month ago (5 children)

    If it keeps happening then they are REALLY bad at sandboxing. I don't believe them at all, but if I did then holy fuck these pricks suck at their jobs.

  • source
  • hideshow 5 child comments
  • [–] -4 points 1 month ago (4 children)

    How do you sandbox a tool with Internet access?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 8 points 1 month ago (3 children)

    Take away the internet access. Firewall. Vpc. Take your pick.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -5 points 1 month ago (2 children)

    How the hell is that useful? These tools have Internet access for retrieval-augmented generation and to be able to interface with external APIs. It's what makes them useful compared to a dumb chatbot.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 month ago* (last edited 1 month ago)

    The word-guessing program guessed the right words and accessed websites it shouldn’t. How many people were charged and jailed because they fuzzed their way into an unsecured website? I can think of a few.

    AI pen testing is one thing, but you need an agreement and scope for that. Responsible researchers stop and send a vulnerability report before accessing data. These AI bots just keep generating requests and sometimes get data back and then months later there’s owner is finished sifting the excessive activity and discovers there’s classified or sensitive or whatever data. That’s not how it works.

    Doctorow says, and I agree, that it seems they’re in a world of delusion at the AI companies and they’ve lost context.

  • source
  • <the_onion_heartbreaking.jpg>

  • source