I do find value in LLMs as a tool for specific uses, but no way I’m paying through the nose for an expensive subscription to support greedy, shithead tech bros plundering the world for profit and government agencies using the tech to spy on everyone.
Open weight models running on consumer hardware are getting pretty good, though. After learning some tricks from the Codacus YouTube channel, I’m running the Qwen 3.6 MoE model on my 4060 gaming laptop with 200k context and usable performance for about the same electricity cost as playing a game. Open source agents like OpenCode are also getting really good. I’m using the beta desktop version of OpenCode and it’s pretty close in capability and UX to the Claude agent I am forced to use at work.
There are still some rough edges and performance issues, but the local LLM scene is already quite decent and is rapidly evolving. Qwen 3.7 open weight models are supposed to be released soon and I’m also looking for things like TurboQuant, speculative prefill (PFlash), etc. to mature and smooth the rough edges.