you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 7 months ago (2 children)

Termux + CPU inference +llamacpp can get ~4B models running, even if slowly, on 5 year old flagship phones.

  • source
  • parent
  • hideshow 2 child comments