you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 11 months ago (5 children)

I mean, most people have a local LLM in their pocket right now.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 4 points 11 months ago (4 children)

    Unless I am missing something:

    Most people do not have a local LLM in their pocket right now.

    Most people have a client app that talks to a remote LLM, which 'lives' in an ecologically and economically dubious mega-datacenter, in their pocket right now.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 11 months ago (2 children)

    Plenty of the AI functions on phones are on-device. I know the iPhone is capable of several text-based processing (summarizing, translating) offline, and they have an API for third party developers to use on-device models. And the Pixels have Gemini Nano on-device for certain offline functions.

  • source
  • parent
  • hideshow 2 child comments