That sounds like 1) 2.5 Years are the new 10+ years and 2) My 15 year old Laptop can write Space invaders in Js, it just needs someone to touch the keyboard
post
So can my 12 year old ThinkPad. You do not need brand new hardware to run ai models, average hardware can do the same.
I still contend that this sort of task is uniquely positioned to show off LLMs. The idea that they’ll turn into agents that can do real-world tasks remains a fantasy. Despite how impressive this is, they’re losing money and have no real path to profitability.
I'm curious. What would it take to change your mind? I'd like to check in with you in two years to see what you think then.
A demo that was open to the public (as in, not stage managed) where people could have the "agents" perform complex tasks without failing on a regular basis. Large training models are notoriously bad at anything they haven't been trained to do. They're worlds away from being able to interpret a new situation and "figure it out."
but can it do it in assembly?
The local model scene is getting really good, I just wish I’d sprung for more RAM and GPU when I bought my macbook m1.
Even then, I can still run 8-12gb models that are decently good, and I’m looking forward to the new Qwen3 30b to move my tool use local.
Be sure to grab a DWQ quant, like this:
https://huggingface.co/nightmedia/Qwen3-30B-A3B-Instruct-2507-dwq3-mlx
https://huggingface.co/models?sort=modified&search=DWQ
DWQ is like an enhanced MLX that's much stronger with tight quants around 3-4bpw.
Im really hoping to see this as a new graphics thing. Specialized chips to bring down power consumption and having oses built around it where you have an ai installation interface.
The new Ryzen AI chips and Apples Neural Engine (or whatever is called) have great efficiency for performance and can run strong local models.
Intel also announced they’re going this route.
I know soldered memory isn’t popular, but right now the performance/energy benefits are big — you just have to buy the premium models.
I think NVIDIA will keep doing their massive GPU toaster ovens, Project Digits was supposed to be their low energy competitor and has been underwhelming.
1 comment