you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 9 months ago (6 children)

The "else-hosted" LLM AI is really not my thing, but selfhosted even less...

  • source
  • hideshow 6 child comments
  • [–] 5 points 9 months ago (5 children)

    If I had the proper equipment, I'd run AI if it were self contained and not pinging out to another LLM.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 9 months ago (4 children)

    @irmadlad @selfhosted That is precisely the challenge. I’m not sure it is possible.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 9 months ago (2 children)

    I mean, I can run a few of the private AI stacks, but it is excruciatingly slow as to make it not worth the time. I would want something pretty responsive.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 9 months ago

    The hardware requirements are quite steep, but I've got local AI running in my house. It's mostly just there for when I want to screw around with it, but technically I could setup OpenClaw and point it to my AI server to use as its brain.

    I'm not stupid enough to do that on any real computer I use, but it might be cool to do on a VM where I can tightly control what it can see and have access to. Of course, that limits its usefulness, but security has a cost.

    At the same time, I can see the allure of a real digital assistant. I'm old enough to remember when professionals had personal assistants that not only helped them keep track of their work life, but also their personal life. Scheduling their personal life like doctors appointments or house repairs. Dealing with vendors to make sure stuff actually gets done, and making sure they are in the right place at the right time. That would be rad to have.

  • source
  • parent