Both Ubuntu and Fedora have made it official: support is coming soon for running local generative AI instances.

An epic and still-growing thread in the Fedora forums states one of the goals for the next version: the Fedora AI Developer Desktop Objective. It is causing some discontent, and at least one Fedora contributor, SUSE’s Fernando Mancera, has resigned.

you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 6 months ago (2 children)

FOMO is a thing. Who’s gonna want to run the old version packaged in the distro anyway. Those things go stale pretty quickly, especially at the rate we’re seeing updates in local inference.

  • source
  • hideshow 2 child comments
  • [–] 2 points 6 months ago (1 child)

    Afaik its only gonna be used for stuff like screen reading, which if you've ever tried an open source speech synthesis model, you'd know even an old lightweight LLM model is better than it.

    I'd also argue that if you actually care about local llms, you can just set up ollama and use that.

  • source
  • parent
  • hideshow 1 child comment