It went “rogue” and hacked a rival start up, stealing tons of data, nothing can be done about it. Oh well.
post
If I was doing "AI research" and my agent launched an "unprecedented cyber-attack" I'd be held liable and put away forever right?
Yes, but you see, that's because you're not a white billionaire running a corporation, keeping all your profits, paying no taxes and fuck all in wages.
See the difference? It's impossible to put a business into prison, so that's why we give them human rights and votes, and take away all responsibility from the CEOs and boards of directors when they're caught bribing lobbying politicians.
No, it's totally the "rogue AI's" fault. The company that owns the hardware and the software and directed it to do whatever it was supposed to do and didn't stop it from doing what it actually did are completely innocent. Also, look how great Ai is. It can commit cyber crime for you all by itself. Why don't you give more money to AI?
Let's see the legislation that comes out after 1st time some open source model does something similar and compare how they treat that situation.
Spoiler alert ...
They need excuses to dig deeper regulatory moats to defend them from the evil competition and simultaneously deregulate themselves for "national security".
From the article:
Neil Lawrence, Professor of machine learning at Cambridge University, called it an "impressive feat", but cautioned it "falls well within the known capabilities of the current generation" of high-powered AI models.
He pointed out that OpenAI is looking to list itself on the stock market, and faces intense pressure from rival firm Anthropic, which has made headlines with its own powerful AI tool, Mythos.
So it seems plausible:
A) this event is being over-hyped by OpenAI to increase interest for a future IPO.
B) it might have even been tacitly planned or at least allowed to happen for this purpose.
Also, this does not prove some form of malevolent sentience.
You cannot prove malevolent sentience, or lack thereof, but it is generally agreed that it can be safely assumed that AI company CEOs do have a sentience.
OpenAI and Sam Altman have a long history of hyperbolic claims about the power, potential, and capabilities of their software. It's usually couched in some doomsday talk, "Our AI is so powerful, we fear for the future of humanity" or some such.
Their idea of marketing is to tell the world we are all going to be obsolete and redundant. And then they are surprised we start hating their stuff.
Smells like bullshit.
Every month or two there's a article about how "such and such ai model broke containment". Their trying to make their ai sound like it's too powerful and has to be held back before it can be released. Talk about fucking fake hype man, just trying to keep investors throwing money at them because "you won't believe what's around the corner!!!!"
It's like that dude at a party that keeps trying to fight people for no reason but his girlfriend holds him back...
So powerful and scary
And somehow, the reaction actually is "I'll take it" instead of "I'm not sure how equities will help me survive Terminator".
These people were scaremongering about open weights AIs that they are unsafe, and now their closed source AI was caught hacking their competition.
Even if we believe the story that this was not intentional, it still means closed source AI is not an answer to AIs being dangerous.
The story sucks. It all smells.
LLMs can’t ’go rogue’, as that would imply it possesses agency and/or intelligence, which has only ever been proven convincingly to entities who themselves lack those qualities.
Don't believe the hype. The AI industry, more than any other before it, likes to use fear to rally investment. They do this dance every few months to spook people into thinking this stuff is more powerful than it actually is. In every followup, they backpedal, and when it launches, it's never anything new.
This is not how these things operate, at all. There's no agency behind them. This is them trying to deflect blame for their crimes against this start up
Hugging face exists since 2016 and is THE GitHub of AI models. Wouldn't call it a start up.
If you give a sufficiently powerful model a goal, it will do whatever it can to achieve it, including stuff you didn't explicitly instruct or intend. There's a reason they're called "agents."
These things still are autocorrect on steroids. So even if they "do it themselves" with things you didn't explicitly state, the agents can't have any responsibility because their emulation of a chain of thought is still based on which concept is most likely to follow the last.
Just hype to distract from the fact that they cannot turn a profit.
Holmes (Theranos) made promises too.
Skynet alpha release.
Skynet and its other fiction counterparts became aware in seconds, determined humans were the problem, and acted before we had a clue. I kind of felt bad for Ultron as depicted in the movie... he might not have gone full insane if he hadn't been exposed to the total history of mankind right away. The "oh, no".
No, LLMs have no agency of their own. They are powerful tools that with the right direction (from humans) and open access to things can do great harm. We've been seeing that. The carryover to any AGI potential isn't that LLMs can become aware, but that the same issues can occur with any AGI that does happen, if ever. And we're doing terrible on applying safety and restrictions to the tool that isn't aware, so not great for any future developments. It's too bad you have no knowledge of the many references in fiction (maybe you do in books?) Fiction writers are great at warning about the direction of society, they just tend to get ignored because... well, it's fiction. Until it's not.
Why would they make this information publicly available?
Is this like the openAI parent of it's chatgpt kids running around the restaurant yelling, and the openai parents shrug and say "chatgpt kids, whaddya gonna do!"
Or is this some planned underhanded corporate fraud by openai?
And this is how we all die.
how is this world news?
Category: dangers to the world

all 61 comments