14
Totally new to running local LLM. How are you connecting to your model via mobile? (lemmy.world)
submitted 6 months ago by to c/fosai@lemmy.world
20 comments fedilink hide all child comments
 

I’m connecting to llama.cpp on my laptop through my phone via Tailscale but when my laptop sleeps I can’t access it anymore on my phone.

What are yall using for this? Thanks!

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 6 months ago* (3 children)

Disable sleep/hibernate on your laptop. Disable sleep/hibernate/poweroff when lid is closed. If you're going to treat your laptop as a server, probably better to configure it as a server.

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
  • [–] [S] 1 point 6 months ago (2 children)

    If I configure it as a server is there a mode that pulls very little power like sleep, but it’s ready to be activated?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •