I’m connecting to llama.cpp on my laptop through my phone via Tailscale but when my laptop sleeps I can’t access it anymore on my phone.

What are yall using for this? Thanks!

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 6 months ago (1 child)

Use https://anythingllm.com/ on your mobile with its own local models? You'll be limited with your phone's hardware but it will do on a pinch where you can't reach or use your laptop. It's open source and everything works locally.

  • source
  • hideshow 1 child comment