you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 7 months ago (3 children)

Unfortunately i need to use android.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 7 months ago (2 children)

    Termux + CPU inference +llamacpp can get ~4B models running, even if slowly, on 5 year old flagship phones.

  • source
  • parent
  • hideshow 2 child comments