you are viewing a single comment's thread
view the rest of the comments
[+] [S] 4 points 7 months ago* (last edited 6 months ago) (6 children)
  • [–] 2 points 7 months ago (5 children)

    I am waiting for the day when you can run this kind of models directly on the phone.

  • source
  • parent
  • hideshow 5 child comments
  • [+] [S] 4 points 7 months ago* (last edited 6 months ago) (4 children)
  • [–] 1 point 7 months ago (3 children)

    Unfortunately i need to use android.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 7 months ago (2 children)

    Termux + CPU inference +llamacpp can get ~4B models running, even if slowly, on 5 year old flagship phones.

  • source
  • parent
  • hideshow 2 child comments