For what stuff do you want to use them? I don't think they come remotely close to today's commercial models. Maybe for a specific purpose?

For small model bonsai series seems getting the spotlight. Natively trained on1bit and ternary 1.58bit, 8B runs on ~1GB memory. I'm curios on local models but haven't tried because of lack of gaming rig but it seems work enough for regular pc

This weekend I had an LLM walk me through setting up some home server stuff and networking. I tried using Proton's Lumo and Qwen 3.6 locally. I have to say Qwen was the more impressive of the two models. When I first tried running models locally like llama 4, I remember thinking to myself that this was a dead end and big servers would always have the advantage, but it seems like we're hitting a turning point where many things can be done locally.

For me, anything less than gpt oss 20b (a2b) is just for messing around with or for basic categorisation and basic text or data processing with highly structured prompts.