I'm kind of new to local AI and wondering what's the move here? Are they trying to pull off a chrome/android situation? Obviously I don't trust any of these gafam giants but I would be really interested in running a local LLM on my M1 max (briefly used deepseek last year). My use case would be mostly chat functions to help with academic and text analysis tasks (don't worry I don't just blindly trust LLMs, I know what I'm doing), so recommendations are welcome.

all 24 comments

sorted by: hot top controversial new old
[–] 8 points 6 months ago* (last edited 6 months ago)

Probably because they play the same game as Mark Zuckerberg, the Chinese, to some degree OpenAI... They all release open-weights models.

They'll generate some hype for their company that way, so it's advertising. They build good will. They undercut the competition. Or make it clear how they outperform them. Maybe they get some more investor money if they do expand to the local models market. I bet there's a million reason why it makes sense from a business perspective.

  • source
  • [–] 7 points 6 months ago

    It's called commoditizing your complements. It's a complex strategy which Google has done before with Android and Chrome. They're masters at it.

  • source
  • [–] 6 points 6 months ago (2 children)

    These gemma models are small enough to run on your laptop or phone. They'll be bundling them with phones and Chromebooks anyway.

    Might as well get some goodwill and let the horses run free before someone extracts them from the edge device anyway.

    It can give them some plausible deniability if they just ship them off as tech-previews. I'm thinking for when that taking kitty app starts feeding into your delusions and telling you to hurt people.

  • source
  • hideshow 2 child comments
  • [–] 2 points 6 months ago (1 child)

    Prophetic since a week later people found Google pushing AI secretly on Google Chrome. Hexavalent chrome is banned, why can't chrome be banned?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 6 months ago

    I'll further prophesize that we'll start seeing mixed on-device and cloud calling. Cloud for heavy thinking is probably in the books right now.

    Next week your local tiny gemma4 will be feeding the cloud models with predicted tokens to speed up and reduce work for gemini. It only has to get it right 66% of the time for a 2x speed-up.

  • source
  • parent
  • [+] 3 points 6 months ago (1 child)
  • [–] [S] 2 points 6 months ago

    Yeah, I'm thinking they want phone devs to start adding their models to android and create a similar situation where it becomes so integrated that it's almost impossible to get rid off. Like they did with chromium, where most browser are now stuck with it and they can change the rules whenever they want.

  • source
  • parent
  • [–] 4 points 6 months ago

    A lot has been said, but to add to the list I'd say it gives them access to quite a large pool of free testers.

    LLM architectures and optimization techniques change rapidly and by releasing open-weight models a lot of enthusiasts will evaluate new models for free, help implement support in inference engines, catch bugs etc. (and in turn, ofc, get a new model to run for free, so it's at least somewhat symbiotic).

    We have at least seen this quite obviously when Alibaba released Qwen3-Next, which was a somewhat undertrained but still useful model which introduced the architecture that their latest models now use "in production" (also their paid "Max" models).

  • source
  • [–] 3 points 6 months ago

    Random suspicion: It is correlated to how much compute US have. That's the only reason I can think of. I also wondered why they would do that when US tech are grabbing the global hardware. They'd like to keep control of inference in the cloud but are missing power thus lack compute. But they also benefit from a western AI ecosystem that have much more compute available. Pure guess, but maybe something like that ?

  • source
  • [+] 3 points 6 months ago* (last edited 6 months ago) (4 children)
  • [–] [S] 1 point 6 months ago (3 children)

    co-opt em, set the de-facto standards and own the “attention”

    That's what I'm suspecting too. They're trying to pull a chrome-like situation and become some sort of standard so devs eventually are stuck with their tech and whatever bullshit "manifest" update they release.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 6 months ago (2 children)

    While not impossible, there's a lot of variables when it comes to LLMs that I don't really see how they'd do that, especially since it's not particularly better then the competition.

  • source
  • parent
  • hideshow 2 child comments
  • [–] [S] 1 point 6 months ago (1 child)

    I agree. I'm thinking they are trying anything hoping it will stick because clearly, they are losing the AI race. So offering models that can run locally was their best bet. And deepseek might have just fuck their shit up a little more with V4.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 5 months ago

    Personally, I don't think they have any kind of grand plan beyond capturing as much of the market as they can. They'll keep using the strategies that have been effective, but I doubt they can predict what the market will do, or what ground-breaking discoveries are coming. "No plan survives first contact with the enemy."

  • source
  • parent
  • [+] 2 points 5 months ago* (last edited 4 weeks ago) (1 child)
  • [–] 2 points 6 months ago

    Cause no one really cares about them and Google doesn't want to fade into obscurity in this AI race.

  • source
  • [–] 1 point 6 months ago
    [–] 1 point 6 months ago

    https://youtu.be/sXgZhGzqPmU?si=hrVq2gd9BqcU2YBS this guy explains it from different angles

  • source
  • [+] -7 points 6 months ago (4 children)

    "i know what I am doing" has been heard also from the overseer of that nuclear power plant, how was that called? Ah, Chernobyl....

  • source
  • hideshow 4 child comments
  • [–] [S] 5 points 6 months ago (3 children)

    Lol, you have no clue about my use of AI.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 6 months ago (2 children)

    Sarcasm is such an underrated skill

  • source
  • parent
  • hideshow 2 child comments