14
Totally new to running local LLM. How are you connecting to your model via mobile? (lemmy.world)
submitted 6 months ago by to c/fosai@lemmy.world
20 comments fedilink hide all child comments
 

I’m connecting to llama.cpp on my laptop through my phone via Tailscale but when my laptop sleeps I can’t access it anymore on my phone.

What are yall using for this? Thanks!

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 weeks ago (1 child)

You can run Ollama locally on a phone through Newsboat, though beware it can be very heavy on the device.

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •