14
Totally new to running local LLM. How are you connecting to your model via mobile? (lemmy.world)
submitted 6 months ago by to c/fosai@lemmy.world
20 comments fedilink hide all child comments
 

I’m connecting to llama.cpp on my laptop through my phone via Tailscale but when my laptop sleeps I can’t access it anymore on my phone.

What are yall using for this? Thanks!

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 6 months ago* (5 children)

I use my homeserver for it. It's located in the broom closet and on 24/7. But there's ways to do it with a laptop. You can inhibit standby and let it run contunuously. Or configure Wake on Lan and wake it up before you use it... I mean a switched-off computer obviously can't do any computation.

  • permalink
  • fedilink
  • source
  • hideshow 5 child comments
    •
  • [–] [S] 2 points 6 months ago (4 children)

    Thanks! Ik interested in Wake on LAN. I don’t wanna keep drawing power when I’m not using it. Any recommendations for setting that up?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 6 months ago (3 children)

    Uh, it is a bit more involved. The Arch Wiki has a lengthy article on it: https://wiki.archlinux.org/title/Wake-on-LAN

    Basically, you'd enable it in your BIOS/firmware. Make sure it's enabled in the network driver. And then you need to figure out a way to send such a magic packet. You can make your router or another device in the network send it. Or do a port-forward or send it through a VPN.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] [S] 2 points 6 months ago (2 children)

    Ah yeah I’m not trying to do all that. Is there a way to keep your computer almost asleep just waiting for a signal?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 6 months ago* (1 child)

    Laptops are designed to be fairly power-efficient. I don't know what yours does. But mine goes down to only a very few watts if idle and the display is switched off. There's the Linux tool "powertop" which shows power consumption and it can also tune most components to go to low power. Sometimes there's also a power profile setting. That shouldn't be on "performance" or anything like that. I don't think Linux has more to offer, except sleep with wake-on-lan.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •