Linux doesn't deserve this
Imagine taking the lightweight, privacy-focused appeal of Linux and completely ruining it by hardwiring AI models straight into the OS. Nobody is switching from Windows for more forced AI features.
Its just not worth it to rent from cult, facist, or megacorps willing to destroy the world to do it. Local LLMs though are cool, and hopefully we set up for better distributed training again.
KORA is built around that idea. Their "Cortex" engine runs workloads on local LLMs first and will use resources on other computers on the network before it sends work to the cloud.
It's a very good idea and if it works as advertised I suspect Microsoft will offer them a LOT of money for it because it's almost exactly what Microsoft's "Hybrid Intelligence" is trying to do.