you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 11 months ago (4 children)

Unless I am missing something:

Most people do not have a local LLM in their pocket right now.

Most people have a client app that talks to a remote LLM, which 'lives' in an ecologically and economically dubious mega-datacenter, in their pocket right now.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 11 months ago (2 children)

    Plenty of the AI functions on phones are on-device. I know the iPhone is capable of several text-based processing (summarizing, translating) offline, and they have an API for third party developers to use on-device models. And the Pixels have Gemini Nano on-device for certain offline functions.

  • source
  • parent
  • hideshow 2 child comments