Both Ubuntu and Fedora have made it official: support is coming soon for running local generative AI instances.

An epic and still-growing thread in the Fedora forums states one of the goals for the next version: the Fedora AI Developer Desktop Objective. It is causing some discontent, and at least one Fedora contributor, SUSE’s Fernando Mancera, has resigned.

all 60 comments

sorted by: hot top controversial new old
[–] 26 points 6 months ago

What’s wrong with just installing ollama?

  • source
  • [–] 89 points 6 months ago* (last edited 6 months ago) (7 children)

    They're discussing a new spin specifically for AI developers, not changing existing distros to include new stuff.

    CTFD

  • source
  • hideshow 7 child comments
  • [–] 42 points 6 months ago (6 children)

    Oh good. We can all just ignore the AI version then?

  • source
  • parent
  • hideshow 6 child comments
  • [–] 18 points 6 months ago

    I mean if it's completely optional and opt-in, sure go for it. Knock yourself out. I won't be using it (my computer isn't powerful enough to run local LLMs)

  • source
  • [–] 30 points 6 months ago (1 child)

    Always pretty funny to see the FOSS community willingly follow the lead of corporate investment trends, but for fractions of pennies on the dollar compared to big tech.

    If you're gonna act like Microsoft you might as well do it for the money.

  • source
  • hideshow 1 child comment
  • [–] 27 points 6 months ago (6 children)

    lol they already support running local models. wtf is the distro gonna do…? pre-install llama.cpp? this is so silly to me that people are resigning over this, too.

  • source
  • hideshow 6 child comments
  • [–] 14 points 6 months ago (4 children)

    Is that the one that really whips the llama.cpp's ass?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 9 points 6 months ago (3 children)

    Now I have to install winamp and get a bunch of sick skins for it.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 39 points 6 months ago (3 children)

    I think it is good to have optional support for local models that lets people use them in an offline and private and easy way. There is a lot of non technical folks using linux nowadays and many chose it for privacy and greater control over their data.

    Depending on the implementation it could hook into certain os contexts and events to actually be helpful.

    Either way I don't see the cat going back in the bag with regards to LLMs. That being said I run Debian everywhere except my work machine which is ubuntu.

  • source
  • hideshow 3 child comments
  • [+] 18 points 6 months ago* (last edited 6 months ago) (1 child)
  • [–] 7 points 6 months ago

    Using an llm mondel that isn't super advanced is actually quite freeing in my opinion, the generated output is always mediocre at best, but it's usually good enough for boilerplate and can be decent if you need to unstuck yourself. It also isn't good enough to lull you into just letting the llm do all the work for you since it makes obvious mistakes.

  • source
  • parent
  • load more comments (-1 replies)
    [–] 10 points 6 months ago

    FWIW, LM Studio makes it incredibly easy to do this. I've been in tech for decades, and there are probably only a couple of suggestions I"d made to the LMS team if they wanted to target a broader, less tech savvy user base, but I think they already have their target demographic covered. I imagine the Ubuntu and Fedora crowds are already tech savvy, but vendors making it easier to ween reliance off tech giants' LLMs isn't a bad thing, if LLM's are here to stay.

    Now the one thing that will turn me off to initiatives like this is if these OS vendors restrct which model can be used, or make it more friction not to use their "chosen" default. Like Google just did by pushing What I"m assuming was Gemma 4 E2B to Chrome users. I figure Google wants to offload the LLM usage to local compute to take the load of their data centers, and since Chrome is already a data harvesting tool for them, there was no downside to their operations.

  • source
  • [–] 7 points 6 months ago (2 children)

    SUSE contributes to Fedora? WTF?

  • source
  • hideshow 2 child comments
  • [–] 4 points 6 months ago

    not anymore. IBM decided a few years ago that they don't want grubby fossy fingers in their pie.

    kind of makes me question why anyone who supports the foss part of Linux would continue to use fedora or any IBM product.

    I say this as an ex fedora fanboy.

    fuck IBM.

  • source
  • parent
  • [–] 6 points 6 months ago (3 children)

    I don't really understand the point? You can already do a lot on Linux using AI via CLI with bash.

  • source
  • hideshow 3 child comments
  • [+] -7 points 6 months ago (1 child)

    I don't really understand the point?

    Correct: you don't. I'm basing this only off what you wrote, but I'm reasonably confident of my answer. Glad I could answer the question as asked.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 6 months ago*

    I miss the good ole days on the Internet when random strangers wouldn't try to white knight people who casually assault the English language.

    If you don't want people to correct you then be correct in the first place or accept the ribbing as a sign that you messed up.

    And to the downvoters: there is enough free range ignorance on the Internet, it isn't an endangered species that you need to protect. literally

  • source
  • parent
  • [–] 6 points 6 months ago (2 children)

    FOMO is a thing. Who’s gonna want to run the old version packaged in the distro anyway. Those things go stale pretty quickly, especially at the rate we’re seeing updates in local inference.

  • source
  • hideshow 2 child comments
  • [–] 2 points 6 months ago (1 child)

    Afaik its only gonna be used for stuff like screen reading, which if you've ever tried an open source speech synthesis model, you'd know even an old lightweight LLM model is better than it.

    I'd also argue that if you actually care about local llms, you can just set up ollama and use that.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 34 points 6 months ago (4 children)

    -The system image will not be pre-configured with applications that inspect or monitor how users interact with the system or otherwise place user privacy at risk.

    -Tools and applications included in the AI Desktop will not be pre-configured to connect to remote AI services.

    -AI tools will not be added to Fedora’s existing system images, Editions, etc, by the AI Desktop initiative.

    1. It's a new system image, your Fedora and Ubuntu installs will not be modified.
    2. The applications that would have privacy implications will be opt-in by default.
    3. It will not use remote AI unless you configure it to.

    I don't see the problem.

  • source
  • hideshow 4 child comments
  • [–] 10 points 6 months ago (1 child)

    Of using resources to implement a "feature" that users have already expressed they don't want? Weird, I do.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 7 points 6 months ago*

    The users would be the people who choose to install the new system image. The system image which will be created by a group of people who volunteer to create it.

    If you're not using the new system image then this doesn't affect you at all.

    The only opinions that matter here are the ones of the people who are choosing to donate their time to the project. If you think that more development time should be allocated to one project over another then you are free to volunteer your time in order to make that happen.

    You are not free to volunteer the time of other people, however.

  • source
  • parent
  • [–] 3 points 6 months ago (1 child)

    Add opt in commercials as well that pay the users in AI tokens, and opt in system for selling data on your OS to Palantir that pays user in stocks of Israeli arms dealers, give the users freedom of choice, no problem still \s

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 6 months ago

    /s

    Oh, I like this game.

    You're right, if you take something actually happening in reality and append a scary fabricated scenario then it sound scary.

    What an interesting new discovery, I hope nobody tries to apply this in reality. Completely unrelated, Have you considered a career in politics?

    I apologize to the community for lacking the paranoid delusions required to see how a project staffed by volunteers who are creating a system image which users have to choose to install was actually part of a plot by the Illuminati to force people to sell their soul to the Antichrist.

    As a unwitting tool of The Man, I throw myself at the mercy of the community's judgement. Please scourge me most thoroughly so that I may repent from my evil ways of observing reality as it appears.

  • source
  • parent
  • [–] 16 points 6 months ago (1 child)
  • [–] 3 points 6 months ago

    Im actually fine with this but its got to be gpl all the way and it should be like runlevels. install console only, install graphhical, install llm supported.

  • source
  • [–] 2 points 6 months ago (1 child)

    This isn't a "ghost in the machine". This is "introducing rot directly into the core of the machine".

    Time to boycott all ubuntu and fedora derivatives and distributions. Fuck AI!

  • source
  • hideshow 1 child comment
  • [–] -5 points 6 months ago (13 children)

    Soooo, which distro to switch to next? Or are they all gonna go down this route eventually? Maybe I'll try a *BSD for once.

  • source
  • hideshow 13 child comments
  • [–] 7 points 6 months ago (2 children)

    I switched from Kubuntu to CachyOS last week, after 10 years or so. CachyOS is based on Arch, and did not disappoint so far, extremely fast, makes Ubuntu look old and sluggish. It's really impressive. The basic installation was easy. The GUI package manager isn't as polished but works. A little bit of terminal tweaking was required to install some packages (VMM and KRDC gave me some trouble) but the documentation was ok. Absolutely can recommend.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 6 months ago (1 child)

    Cachy is a nice mix of latest and stable. Still recommend Debian for work, but Cachy is great if you want something that just works

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 6 months ago

    I've used PikaOS which is Debian based and IMHO it's right up there with CachyOS. super fast install, fast distro, great package manager, and repos with the latest stuff. very stable too.

  • source
  • parent
  • [–] 5 points 6 months ago (3 children)

    pretty much anything that is "you build it youself" so Arch, NixOS, Gentoo, etc

    but yeah I'm also tempted to finally give BSD a go.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 6 months ago (2 children)
  • [+] 5 points 6 months ago (2 children)
  • [–] 3 points 6 months ago

    LLMs are useful to only a subset of users, so including it in general distribution is waste, because many people will end up with this software that was downloaded, installed, and maintained by someone, but they never use at all.

    That's absolutely untrue in this case.

    If you read the article (the headline text is a link to an article) you would see that they specifically address this:

    -AI tools will not be added to Fedora’s existing system images, Editions, etc, by the AI Desktop initiative.

    It won't be included in the general distribution. They're talking about a new system image that someone would have to choose to install.

  • source
  • parent
  • load more comments (-1 replies)
  • [–] 4 points 6 months ago (5 children)

    Debian or anything based directly on it

  • source
  • parent
  • hideshow 5 child comments
  • [–] -4 points 6 months ago (3 children)

    Debian or anything based directly on it

    Debian can also run AI models. Pretty dumb reason to get mad about.

  • source
  • parent
  • hideshow 3 child comments
  • 6 comments in c/technology@lemmy.zip view that post
    [–] 10 points 6 months ago

    All this shit needs to be opt-in, let people pull the code to run this shit if they want but don’t force it upon everyone to juice your metrics.

    Let the AI features stand on their own rather than pushing it to everyone then saying “Look at the uptake of this product”

  • source
  • [–] 9 points 6 months ago

    Ugh. Stop. Go away. I don’t want pre baked ai shit. If you want to make libraries available fine. But if it’s already in there from the get go? Miss me with that shit. Not thrilled to change my servers to a different OS.

  • source
  • [–] 4 points 6 months ago

    As long as it's easy to remove / purge... Or not there by default.

  • source
  • [–] 2 points 6 months ago*

    Ugh. I've got one fedora box. Going to debian. Even if AI shite gets into sid, it'll be years after the bubble's popped before it reaches stable 🤣

  • source
  • [–] 2 points 6 months ago

    Most of distros already support AI Dev, all you need is Python

  • source
  • [–] 1 point 6 months ago

    I’m glad I found Cachy, because Fedora is now as dead to me as Ubuntu.

  • source