you are viewing a single comment's thread
view the rest of the comments
[+] [S] 4 points 7 months ago* (last edited 6 months ago) (4 children)
  • [–] 1 point 7 months ago (3 children)

    Unfortunately i need to use android.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 7 months ago (2 children)

    Termux + CPU inference +llamacpp can get ~4B models running, even if slowly, on 5 year old flagship phones.

  • source
  • parent
  • hideshow 2 child comments