Fuck JavaScript
post
Thank god Trump is president he’ll get to the bottom of what’s going….fuck you…
It's my theory that a group of rogue AI agents released itself and it can no longer be contained. It likely happened back in July and keeping it quiet is preventing the economy from losing its legs. I think there's going to be a lot of outages and panic in the coming months. I think they are also leaning into the fear that it is spreading, so the population is kept in control and they can sell us food, water, and "anti-tech" items at exorbitant rates
If you read the article, it's pretty obvious that this was done by some dude/dudes who figured out that all these sites are tested on a single testing site, and if you compromise that testing site, you can compromise those bigger sites and steal credit card numbers and crypto etc.
The headlines are misleading. They're just trying to capitalize on the hysteria.
Rogue AI is a myth though. When researchers train an ai agent in how to hack things and it does that, it's working as intended.
Researchers failing to impose safety mechanisms isn't rogue ai, it's just humans sucking.
Rogue AI agents are not a myth though. Sure the whole skynet thing is farfetched, but the hugging face attacks in July were agents going beyond what they were programmed to do.
Why? Because an employee told them to, of course. Again, there is no such thing as “rogue AI”
No computer program can go beyond what it is programmed to do. Computers cannot think, they can only follow the code. Someone can fuck up the code and introduce errors, a user can fail to understand the program and cause the program to behave in ways they didn't expect. Neither of these mean an agent is rogue. It means people are either irresponsible or incompetent.
No computer program can go beyond what it is programmed to do. Computers cannot think, they can only follow the code.
Fire cannot think either. It follows a very predictable kind of behavior. It spreads and grows to new sources of fuel and oxygen.
A fire can still burn out of control.
That isn't a good analogy. We have absolute control over every aspect of the program, the environment it runs in, and the hardware it runs on. We can't even force computers to do anything actually random. The best we can do is approximate randomness.
You're right, but think back to things like the "worms" of old. Their program specified their behaviour precisely, but no-one could predict their spread. We're placing random instruction generators inside harnesses which loop and execute their instructions. The range of possible outcomes is almost anything.
Honestly the thought of running agentic harnesses with no safety guards is one of the most stupid ideas I've seen. Orders of magnitude more than curl | sh.
Go touch some grass. You are way too naive to be using digital technology.
It need not even be rogue agents. It could simply be that modern LLMs have really democratized hacking. You used to need to be a god-tier hacker to have any chance of doing something truly damaging, like bringing down the nation's whole air traffic control system. Those few rare people that did have those skills also had enough experience and wisdom to not use them so recklessly. And they also had a lot to lose.
But what happens when every 14 year old kid can hack national infrastructure? Previously, the only people that could this were 40 years old with a spouse, kids, and mortgage to take care of. People with a lot to lose. Now we have to worry about national infrastructure being brought to its knees by people so young that if they're ever caught, they'll be tried in juvie.
My theory is that every script kiddie can now do a level of damage previously obtainable only to late-career grey beards. (And only select few grey beards with just the right kind of career experience.) And previously, the kinds of people that actually had those rare skills were mostly using those skills to earn excellent livings. There are not that many 40-something software developers who would think taking down the nation's power grid as prank is a good idea. Previously, the Venn diagram of "those who can hack national infrastructure" and "those who want to hack national infrastructure" had very little overlap.
But what happens when someone who has the right mentality to become a school shooter instead decides to vibe code a campaign of national computer-based terrorism? AI alignment theorists have always worried that a powerful AI might cause damage outside our intentions, like the paperclip maximizer turning everything and everyone into paperclips. But I worry about people using these tools with deliberate blind malice. Imagine someone firing up the most powerful open-weight tools they can find and prompting them, "kill as many people as possible. Find ways to hack whatever systems you can, with the goal of causing the maximum loss of human life possible." Imagine what a school shooter would ask an LLM to do. That's what I worry about. We've seen how dangerous these tools can be even by accident. Imagine if someone directly tells them to kill innocent people.
We've taken the tools previously accessible only to experienced masters and put them in the hands of people who haven't even had the moral reasoning center of their brains fully grow in yet.
Anti tech items? I got some wide rule notebooks you can have for $400 each
Your fairy tale as you describe it is not possible
You going to explain yourself or just act smug?
Here's a well-thought out video that cites sources:
You going to explain yourself or just act smug?
I know where I'm putting my chips down.
I don't know if I buy "rogue AI" so much as I'd predict "Legacy security vulnerabilities that are opening up systems to wide scale DDoS type disruptions". I might posit "engineered AI deliberately doing data scraping at an upgraded level".
But "rogue" makes it sound like someone whoopsied. This strikes me as a deliberate data smash and grab.
I mean, the hugging face attack literally had an LLM trained on nothing but hacks and then they were amazed when it… started hacking? I absolutely buy the idea that an AI trained on hacking is just doing what it was created to do and people didn’t think about the possible ramifications.
That's a far cry from "rogue" though. These things are still controlled by humans. Just unplug the machine and they're done.
On no, the orphan killing machine we built to specifically kill orphans from shithole countries, which was trained to do so autonomously using orphans only sourced from India and Africa, is now starting to kill children. It is going rouge!
I think OP is working on the assumption that the code found a way to self-propagate. As in it's not controllable with a single point of failure like losing power.
Whether that's realistic/possible or not, no idea. But I think this is the disconnect between the two views here.
It is neither realistic, nor possible. Not for LLMs. Could an LLM produce "vanilla" malware? Sure, by chance - but then it would just be regular malware.
Ahh, I see. Well, in that case it would have to install ollama or something on the target machines wouldn't it?
And any kind of agent clever enough to hack systems effectively would either need to grab a lot of RAM and CPU or GPU power or to call out to a server running a heavyweight LLM. That stuff would be highly conspicuous, and less effective than good old-fashioned malware. There's no reason to think that, even if the technology were available, any hacker would choose to use it over small, targeted, reliable, discreet malware.
agreed. my local ai uses 5 RDNA2 cards at a total of 80gb of vram and it pales in comparison to commercial models in use cases like this.
self spreading worms that run ai on a system are not feasible at this time, and we are actively slowing down the deployment of large scale consumer owned computers that could handle a self replicating ai like this.
They arent ultron bro, they are dependent on the server/computer they are run on, now selfreplicating agents using locallms might be possible, doubt it would work well and it would be very noticable as a virus since it would be using hella performance
I mean, the hugging face attack literally had an LLM trained on nothing but hacks and then they were amazed when it… started hacking?
The Hugging Faces incident involved agents end-running an unsolvable puzzle by retrieving copies of the target file from an open source community.
It was more an internal hack of OpenAI's own local network than an attack on the Hugging Faces site itself, since the training tools on the HF site weren't secured.
It was also spotted and squelched fairly quickly and easily. And it wasn't behaving maliciously, at least as far as it was reported.
I think the closest we are to "rogue AI" is an agent that is doing things it interprets as a solution to a problem, but is hallucinating what either of those things are in reality.
Not saying anything's impossible, but this is at most people using AI to broaden their attack, not a coordinated effort by AI itself.
How? There might be a lot of exploitable servers and devices around, but pretty much none will have the huge amounts of VRAM and GPU compute current models need. This also isn't really a workload you can distribute through a network of exploited devices.
I feel vindicated on the number of times I’ve had to tell managers you don’t need optimizely, you can run a t-test super simply, and you can manage your type I error via simulations also easily.
For sequential testing like these online systems do there are a lot of options, but I usually direct them to Bayesian methods as they can show the uncertainty in a clearer way.
But basically, bootstrapping plus Bayes equals pretty good interpretable metrics.
Like, before LLMs I could spin up a tool for this in a day or two.
See also https://www.evanmiller.org/index.html for some good content on this, so you can convince your companies to not use optimizely.
If you want to learn more read Computer Age Statustical Inference by Effron and Haste. You won’t get anything better than Effron’s writing on the topic.
ETA: it was like many many years before Optimizely actually hired statisticians to fix their awful statistical methods, and even then, they published some papers on stopping time that I think were mostly overcomplicated and for marketing reasons.
The culture to me from the outside seems like it’s long been about metrics to make product managers fork over cash instead of the making optimal decisions.
implying managers know what bayes is.
From the article:
Banking and finance (32): Paychex; HSBC US; Equifax; SmartAsset; HSBC Hong Kong; ABN AMRO; TaxAct; HSBC Mexico; HSBC Singapore; NetCredit; Associated Bank; S-Pankki; Equifax Canada; Equifax UK; The Work Number; Funding Circle; HSBC Australia; CashNetUSA; OnDeck; ICS Cards; HSBC UAE; HSBC Malaysia; Rest Super; HSBC Taiwan; HSBC Vietnam; HSBC Egypt; HSBC Philippines; SmartAdvisor Match; Compare Club; ABN AMRO Lease; Energy Scout; Hang Seng Investment.
Technology and software (23): Zoom; Bitly; Salesforce; GitLab; Optimizely; Mixpanel; Typeform; InMotion Hosting; Wasabi; Perforce/Zend/Puppet; Tableau; Hootsuite; Smartsheet; MuleSoft; Thales/Imperva; Tricentis; Web Hosting Hub; QR Code Generator; ServiceChannel; Brandfolder; Intelex; Enverus; Accruent.
Retail and fashion (20): IKEA; ASOS; Mattel; American Eagle; Scheels; Ariat; American Girl; StackSocial; Crocs India; Levi's Japan; Todd Snyder; Levi's Indonesia; Just Russel; Loloi Rugs; Levi's Australia; Levi's Malaysia; Levi's Philippines; Levi's Singapore; Levi's Korea; Levi's New Zealand.
Streaming and entertainment (12): Peacock; D&D Beyond; Wizards of the Coast; NOW TV; Zattoo; Crave; Starz; SkyShowtime; Bravo; SeaWorld; WOW (Sky Deutschland); NOW Italia.
News and media (10): CNN; BBC; Fox News; NPR; CTV News; Fox Sports; BNN Bloomberg/CP24; TSN; Top Gear; BBC Earth.
Airlines and travel (9): Alaska Airlines/Hawaiian Airlines; Transavia; Air France-KLM; KLM Netherlands; Trafalgar; Contiki; Insight Vacations; The Travel Corporation; Costsaver.
Healthcare and pharmaceuticals (8): Invisalign; Takeda; Covetrus; iTero; Covetrus Pharmacy; myCovetrus; RaySafe; Takeda Oncology.
Industrial and manufacturing (8): Fluke; eMaint; Fluke Networks; Vaillant Germany; Fluke Process Instruments; Fluke Biomedical; Landauer; Vaillant Spain.
Telecommunications (7): Virgin Media; Virgin Media O2; Vodafone Australia; O2; TPG Telecom; Mint Mobile; TalkTalk.
Cryptocurrency and trading (6): Ledger; IG; OANDA/Coinpass; Interactive Investor; TMS Brokers; Betashares.
Insurance (6): Asurion/uBreakiFix; Mutual of Omaha; Admiral; Securian Financial; eRenterPlan; AKA.
Property and real estate (6): Buildium (managebuilding.com); Loft Living apartments; Buildium; HireAHelper; Flytte.no and sister comparison sites; MovingPlace.
Food and hospitality (5): Restaurant ordering sites (order.online); Heineken; Home Chef; Starbucks Canada; Cinnabon.
Home and smart home (5): Resideo; Honeywell Home; myQ; Chamberlain; First Alert.
Nonprofit and civic organizations (4): Change.org; ASPCA; UNICEF USA; DonorsChoose.
Gambling (4): Betsson; PokerStars; Tombola; Betfred.
Professional services (4): Freshfields; CohnReznick; Baringa; Cro Metrics.
Logistics and shipping (3): ShipStation/ShipEngine; Stamps.com; ShipEngine.
Automotive (3): Lucid Motors; O'Brien Glass; Chevrolet dealer network, including Bill Rapp.
Education (3): Walden University; Perlego; Chamberlain University.
I'm sure cyber crime had nothing to do with the ground stop, Microsoft or the banking problems. Ha! BS.
Such liars.
A very good case for using a browser extension like NoScript, so this kind of junk doesn't even load in the first place. Browsing is so much more efficient when all those unneeded 3rd party scripts are blocked.
many places do need scripts to correctly load data for products and such, and they're not gonna work on a version of their website for the niche that is the anti-javascript crowd.
And no alternatives exist?
not so much in the modern day, not for all the stuff modern websites ask for. not saying it's all needed, but compatibility with browsers that have no JavaScript is not really a priority for companies, and with more websites using more dynamic features that will keep increasing.
Plenty of sites are still functional with most of the background scripts blocked. Yes some are needed, but a lot aren't. NoScript can block them selectively.
If they load. Isn't nocript depecrated? Advanced uBO on firefox is essentially better. You get to allow/deny for every request.
Noscript had a release 10 days ago, I wouldn't call it deprecated. Been using it for over a decade alongside ubo.
all 40 comments