The "There's no way we can stop our agents from going rogue" people, suddenly have a burst of ability to reign in their creation when it suits their interests.
Funny that.....
The "There's no way we can stop our agents from going rogue" people, suddenly have a burst of ability to reign in their creation when it suits their interests.
Funny that.....
The purpose of Al is to allow wealth to access skill while removing from the skilled the ability to access wealth.
This is part of the reason they don’t want anyone running models locally offline, the models and their entire business are commoditized
Government bales out AI companies and the bill they write to do it will make local LLMs illegal.
I think you are right, but that seems VERY unenforceable.
Successful enforcement doesn't look like catching every pivate LLM owner.
Except the people I hear running “local models” report a lot of hardware, like a half dozen graphics cards. The common person is screwed, they have a smartphone.
Two or three years ago sure. Now...not even close. Tons of models run on basically shit now. Especially with MOEs. I run new lightweight models on an i9 and 64gb of ddr4 ram with a 4gb quadro card...in a laptop from 19'.
I think this is why a lot of these tech bros are saying silly shit about suggesting people need to rent from them. That's their entire shtick. Otherwise they got nothing else.
Got some references and keywords for research?
This guy does a great brain dump on how little is needed to run LLMs on basically old junk.
If you've got at least 8 gigs of VRAM and at least 32 gigs of RAM you can run some pretty beefy Qwen models using Strata, far more than you normally could. Upgrade that to 12 or 16 and 64 gigs respectively and you can run a pretty decent quant of Qwen 3.8 flash next. It's a LOT bigger than the usual 27 and 35 billion models people run locally that themselves require pretty beefy hardware. Strata is doing some magic by deciding which experts stay in VRAM vs which ones are in RAM vs which ones are so rarely used that they can just be read from the SSD as needed (though it's best if you don't have to result to the SSD as a backup option at all)
Piracy is illegal and they are of course doing a great job at stopping that...
Local LLMs will never be illegal, because that genie is out of the bag
With what money? No one is buying bonds. The US would have to print so hard it'd cause hyperinflation, which still means the bubble pops
The fed balance sheet gets bigger like it did with AIG.
Again, how? No one is buying American bonds right now. You can't raise the debt if no one will loan you money
The federal debt and the US treasuries part of the fed balance sheet is how much taxes should increase. They're different things, the fed can just buy bonds and put them on its balance sheet.
How much taxes should increase?
Wait, is this just printing money with extra steps? Cause it sounds a lot like printing money with extra steps
It is printing money with extra steps. The fed can sell off the bonds, and it has done it to reduce the balance sheet, but not fast enough. The last few crises though, it has been used as an option, and maybe it will happen to save the AI companies too.
Taxes should increase for the billionaires and the super rich.
hardware that people cant USE, they are solely used for AI in those datacenters, its just going to be e-waste.
You used to be able to BIOS flash workstation GPUs to make them somewhat usable for gaming.... not sure how far these AI GPUs have diverged from gaming cards these days and if a BIOS flash could make them playable.
They don’t even have headers for soldering a display output to them. They’re purely a compute card.
No it isn't. 0h come on. Yeah thy couldn't possibly take the same or similar hardware components and make them work in PCs.
They are already putting NPUs in PCs.
You'd have to start soldering the HBM and the GPU chips off the boards they're on. Those aren't PCI-E boards much of the time. Also, they don't have display outputs.
I'd absolutely buy one of those servers to run open-weight models locally, but let's not kid ourselves here: We're talking about an ungodly amount of power for a single machine, think it was a few megawatts for a rack, or at least hundreds of kilowatts. A single server luckily should still be in two digit kilowatts. Could realistically only use it in the winter though.
I can. Compute is compute. Even if it's extremely niche you give me enough cycles I'll find something to run on it.
There is a geniuly cool idea floated a last year I think at xorg conf for a Linux driver that used GPGPU instructions to do the traditional GPU processing as well. So theoretically you could use some of the AI accell to instead compute things like rastors.
Those poor billionaire corpos! Why won't somebody think of the poor billionaire corpos!?
A struggle for power.
When it hurts jobs, AI is the future, when it hurts rich friends needs moderation.
This was literally destroying indie games. Look at the deluge of slop that came out when 'sort items onto shelves' kicked off as a game type.
Now only the people that have enough money to pay for the privilege get to use it!!! Hurray?
Indies have been copied since Unity introduced the asset store, don't fool yourself, this is made to stop the reverse engineering of big company games and apps, not the little guy.
It's interesting to see modern day "shovelware" is still around. The problem of shitty clones and rip offs of popular games has always been around. Or the classic bait and switch of advertising vs actual gameplay.
The proliferation of these things made possible through the internet and sites like itch.io and sped up by lazy AI slop has certainly made it even more pronounced. The difficulty of finding good indie games amongst a huge pile of trash has only grown.
That's what late stage capitalism mixed with desperation, delusion, and the desire to get rich quick will get you though.
I can't understand why anyone would play such a "game". You'll get more satisfaction and results from actually tidying your room!
So they took out two of the most useful things that LLMs can do.
Yes, apparently they’re suddenly worried that stealing other people’s work—which is their business model—might backfire on them. I assume this is a measure intended to give the impression—in the face of one of the countless lawsuits against Anthropic—that they’re actually taking licensing or intellectual property rights seriously. I can’t think of any other explanation, because Anthropic simply can’t afford to have questions raised about where the training data used by their models actually comes from.
Pulling up the stolen ladder before anyone can steal it to use to steal more stuff while it's still enforceable to do so.
Mabey just make all ladders illegal, unless you have a government contracted monopoly.
The entire idea of copyright is going to be tested at many levels, and most people don't even understand why yet.
Interesting times.
No, they just enabled Chinese LLMs to be the forefront of reverse engineering. Because people will do what they want to do.
No, they just enabled Chinese LLMs to be the forefront of reverse engineering. Because people will do what they want to do.
Their goal is simple... everything they are doing right now is striving to make the US ban individual hardware.
Chinese models are open, anyone can get them... stopping the flow of data on private computers is impossible. Hardware however is getting more expensive, hardware manufacturers are already deciding to move out of the consumer market on their own. The US government is already establishing laws to prevent shipping foreign hardware into the country.
Altman's giving the game away when he does this "it's so sad that all this ram is sitting around in people's home computers unappreciated when it could do so much more in a data center".
The idea is to sell the message "AI is out of the bag, and it's world ending technology. Basically they are going to imply that the guardrails in their data centers are the only thing that's preventing all AIs from destroying the software industry, and teaching teenagers to build bombs and hacking the CIA, and the only possible response would be to stop all direct to consumer hardware sales with anything more than the bare minimum needed to stream a PC out of a data center.
This is all pretty obvious and I agree. They can no longer protect their imaginary property if they allow it to be ran in your computer's memory or stored on your computers hard drive.
The cat is definitely out of the bag, as in their own AI models are making them obselete. The race to make money before the end is what motivates them. They will ride the roller coaster to our societal demise because they only care about money. These people shouldn't be in charge of a small fast food restaurant let alone multi-billion dollar companies.
If private hardware becoming scare would send America back to the stone age, completely choke technological progress.
probably, but don't you know, everything in the cloud is the FuTuRe!! owning things yourself is the way of the past, it's like physical disks you can resell or something.
Sad thing with the exception of price, it's probably not that far off that most average people's usages will be similar. but yeah the idea of paying by the hour or cpu grade etc... for a computer is going to suck... and be far more expensive for gamers, hobbyists etc...
world ending technology.
Read that as "democratic and free word ending", and it's on purpose as they saw cyberpunk and wanted to become a mega-corporation that rules the world too.
Just ran into Qwen's version of guardrails myself, and am quite annoyed. Guess I'm gonna have to look into abliterated models next.
Oh, abliterated models are awesome! Just be aware that they’re a little too agentic at times. Once they start ignoring guardrails, they happily keep ignoring them!
My concern at the moment is I've heard some of them have performance issues due to the abliteration process. What's your experience with that?
Like, TTFT? Or speed of tokens? Or something else? BTW what was the gate you initially hit with Qwen?
Some abliterated models had lower reliability and quality, I heard. Is that still an issue, or has the dev community figured out how to avoid those pitfalls?
Was spitballing about various ideas, and occasionally Qwen would go all Chinese-ethical on me, no using open systems outside of stated design, no avoiding govt blocklists, etc etc.
depends on what their base model is. Most abliterated models start off with an already quantized model, so depending on the type and level of quantization, you've already lost some capability. Plus, I think there are two types of abliteration, so ymmv.
My current go tos, in order are -
I've tried and hated - hf.co/DavidAU/L3.1-Dark-Reasoning-Dark-Planet-Hermes-R1-Uncensored-Horror-Imatrix-MAX-8B-GGUF:latest
If you're set on trying out Qwen, I highlugh recomment orcarouter's models. Very well done and they start off with a good base model - well, actually now that I think about it, Qwen3.8 basically has one base model - the 27b one, right? So that's that.
I like the Gemma-4-E4B for speed for response, and HauhauCS has done a good job of abliterating the model appropriately. However, it's nothing compared to the A4B models, so if your hardware can take it, go for A4B over E4B always.
Yeah, I tried asking it how to flash a modded tv webOS and it flagged the chat.
I asked it to fuzz my own code (a jwt integration) and it flagged the chat. There was an unbounded buffer that could have been exploited, but it’s happy to hide that since I’m not a large corpo.
Honestly the shit Claude does is unusable anymore. It’s developed a habit of dropping requirements when problems are hard now.
ETA: Chinese models and Mistral were happy to help. I discovered I could use eMuhdra against an iot device in my house that way, I found various input errors, these things have improved my security so much more than they create risks.
I work with embedded devices that use canbus. Last week it was happy to read the manufacturer's published .DCF files for a couple of joystick panel interface boards. Not anymore, conversation flagged and halted any time I get near them.
Claude. You can download these files from the manufacturer's website. They only describe how analog and digital inputs get converted into canbus packets. I am not trying to hack Adobe here. Nope.
Oh well, DeepSeek, Mistral, GLM, Beam et. al. are all happy to read these files and continue work on the project. Anthropic's usefulness to me has ended, it was nice while it lasted.
That reminds one, my dishwasher leaked so I went to download the manual from the manufacturer.
That got me a ban from Cloudflare. Apparently downloading a pdf from a website is bot behaviour.
American tech companies are going too far.
Semi-related. I switched to Firefox about a year ago, when the Manifest v3 was forced into Chrome. About 2 months ago, I started getting prompted to solve a captcha when using google search, since my traffic was "unusual". This appears to be a javascript issue where FF doesn't respond to some server-side tracking correctly.
I now use DuckDuckGo.
I'm tech savvy, but have sometimes been willing to sell my data for convenience (don't shoot me). But I'm not willing to sell my convenience for convenience: break my ad-blocker or make me captcha to search - fuck right off.
Getting off gmail is going to be hard, but I'm exploring options. Big Tech companies are doing a lot of foot-shooting right now.
They think they won, and can enforce their will, but I'm optimistic that they haven't.
I’ve been moving off Gmail for years, it’s not easy.
I have family that will not update their contact books, old contacts, sites that won’t let you change address or move off Google sign in.
All the important stuff was easy, the rest is forwarding or making sure my app checks the legacy Gmail
Claude. You can download these files from the manufacturer’s website.
If it's on the publicly available internet, they probably did, without permission.
these things have improved my security so much more than they create risks.
The fact they exist is what significantly increases the risk.
I am a hard worker and workaholic. Is it just me or does Claude try talking you out of doing stuff? It will be like 10am and Claude/opus will try this: "great session , you deserve some rest, go enjoy your family and we'll come back to it tomorrow, have a good night Wut?
Actually, figured this out, it happened to me today
Claude was pulling UTC time and not integrating my locale, so it things is scary hours later than it actually is. Update your agent markdown with your locale and it’ll work.
No idea the incompetence that led to this change.
I’ve never had that happen.
For me it just pretends it did something fully and drops requirements.
Don't worry! Its STILL okay to reverse engineer the work of photographers artists writers actors voice over musicians modelers animators academics etc etc (feel free to add. the exploitation is literally everywhere!)
Only if you're a corporation! If you're a filthy worker then you have no rights.
Jokes on them when they face the consequences of usurping the jobs of all these professions, causing mass exit, and replacing with their error prone output of their slop and unoriginal thinking/artistry. I'm excited to see this outcome, not going to lie.
The new deep seek 4.1 one is doing it and giving you a biscuit for 1/10 the price
top 99 comments