top 32 comments

sorted by: hot top controversial new old
[–] 126 points 1 month ago (5 children)

So, this is going to continue to escalate, until whoever gave the text generator the software tools needed to do this and gave it the access without any kind of firewall, gets charged with the appropriate felonies and is put in jail.

To be clear, this is illegal activity, and the LLM can only do this if a human provides the means. That human == criminal scum.

  • source
  • hideshow 5 child comments
  • [–] 46 points 1 month ago (2 children)

    Don't forget whoever instructed it to preform the action.

    An LLM can't just unprompted get the idea to do this.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 13 points 1 month ago* (1 child)

    I mean, hallucinations are possible, especially if you have long-running agents. However, I also suspect direct instruction, simply as the alternative would take too long, be excessively expensive and the "newsworthy" result subject to chance.

    Can't build a PR strategy on that.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 15 points 1 month ago

    Yeah,all of these news articles about AI going "rouge" and attacking other companies and even the government happening at roughly the same time, without any real evidence to show what actually happened to trigger the events...

    I am hammering X like I was performing the intro to the song Them Kinda Monkeys Can't Swing by Slade, as I keep reading about this crap.

    For reference, here is the song mentioned above:

    https://youtu.be/Ojk8gAEdat4

  • source
  • parent
  • [–] 0 points 1 month ago

    So, this is going to continue to escalate, until whoever gave the text generator the software tools needed to do this and gave it the access without any kind of firewall, gets charged with the appropriate felonies and is put in jail.

    there's hacking nearly every week and no ones in jail. Medibank, Qantas, Optus blah blah blah These arent climate protestors, they'll not see jail time.

  • source
  • parent
  • [–] 76 points 1 month ago* (8 children)

    So who is going to jail now? I am sure a company is responsible for its actions, right?

  • source
  • hideshow 8 child comments
  • [–] 23 points 1 month ago*

    I think there is enough here for a judge to order a search warrant. It doesn't mean yet a crime has been committed, but there is enough to start some kind of compelled discovery process to find out what the fuck is going on.

    Since it's an important enough corporation that got caught, in a sane society it should not make a difference, but we low key have a two-tiered justice system from the looks of it.

  • source
  • parent
  • [–] 8 points 1 month ago* (last edited 1 month ago)

    The government can choose to sue (civil) or prosecute individuals/executives (criminal liability).

    Assuming there is some legitimate explanation (I'll be interested in hearing this one!) they likely won't, but will now establish higher level reporting channels with OpenAI and Anthropic, and perhaps check their important email boxes more often regardless. ;-)

  • source
  • parent
  • [+] 12 points 1 month ago* (4 children)
  • [–] 20 points 1 month ago* (1 child)

    Its easy. There are laws against hacking. If you used a script its still you who go in jail. If you used an Ai its still you who go to jail.

    Do not let them try to spin this into the autonomy narrative.

    Someone set up the agent, somebody gave it the prompt that caused this to happen. Some one did not do their job properly.

    Ai agents are not independent actors, they are tools.

    If I missmanage a forklift, I am held responsible. Breaks failed? I failed to do the right maintenance. Load fell down? I did not secure it right.

    This is not some impossible gordian knot to solve...

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)
  • [–] 53 points 1 month ago* (last edited 1 month ago) (2 children)

    The breach happened in June but Open AI only became aware of it in August. It notified the government via an email, external to a general inbox on 10 September

    This is just atrocious on every level. First of all, they're hacking everyone with impunity. Then, they're taking 2 months to find out about it, and a further month to report it. So not only can they not control their AI, as a company they clearly have no systems in place to report it either.

  • source
  • hideshow 2 child comments
  • [–] 35 points 1 month ago

    They use AI to hack into governments, they say it was AI agent or something I didn't know.
    They bomb a school in Iran, they say it was AI.
    Sure, let's throw it to AI! Not USA who does war crimes.

  • source
  • [–] 49 points 1 month ago* (last edited 1 month ago) (2 children)

    Its Anthropic OpenAI. Didnt notify government for more than three weeks. No apology. Meanwhile Albanese and Labor party to water down copyylaws so AI can pillage Australia content creators for no money.

  • source
  • hideshow 2 child comments
  • [–] 17 points 1 month ago

    accountability is needed here; heads need to roll

  • source
  • [–] 16 points 1 month ago

    It's not an agent, it's whoever used whatever piece of software in whatever which way to connect to those systems, that's who is responsible and both them and the people who set up an insecure Medicare network should be in jail. For a long time.

  • source
  • [–] 16 points 1 month ago

    Why do I feel like the word "known" is doing some heavy lifting here?

  • source
  • [–] 11 points 1 month ago

    Now watch, in the US, an agent will infiltrate the election process somehow in November which will lead the government (Trump Mafia) to declare the election invalid despite the fact that the democrats won. I'm just waiting for the headlines.

  • source
  • [–] 11 points 1 month ago (2 children)

    Reading the story it's not clear who set up the agent. It's an agent running on OpenAI but it's not clear whether they're saying a customer instructed an agent to hack the Australian medical board and got around guardrails to prevent that, or that they're saying their own internal work agent decided to hack the Australian medical board at random.

    In both cases OpenAI has culpability. In the latter case, they should be held fully responsible.

  • source
  • hideshow 2 child comments
  • [–] 10 points 1 month ago

    And then...?

    What?

    Still, nothing?

  • source
  • [–] 7 points 1 month ago

    This is US state sponsored.

  • source
  • [–] 1 point 1 month ago

    Awesome. More, I want AI to hack way more government shit everywhere. Fucking love it.

  • source
  • [–] 1 point 1 month ago

    Hold on, they might be onto something. (Not this target, obviously.)

  • source