Imagine taking the lightweight, privacy-focused appeal of Linux and completely ruining it by hardwiring AI models straight into the OS. Nobody is switching from Windows for more forced AI features.
Sure, "LLMs and GPTs are just tools" is a potentially defensible take.
But, Copilot and Claude and Gemini and Apertus and every other model, "open weight" or not, that has been studied enough will (unknown the the user) sometimes generate output that infringes on the copyrights of the training data AND most, if not all, of the models with high-quality output involved human rights abuses as part of their training process (per Amnesty International).
Maybe, in the future, we'll have models that are trained only on freely redistribute content without human rights abuses and without setting environmental goals back 10-15 YEARS. Maybe.
If that happens, I might be willing to use those tools myself, and I'll certainly stomach their output as part of my won workflows. Until we have those ethical models, FUCK all of them and their output, they aren't just tools; using there output is apologia for immoral acts and using the models is collaboration immoral people.
EDIT: Reworded for clarity: fails to generate output that will not infringe the copyright terms of the training data