you are viewing a single comment's thread
view the rest of the comments
[–] 33 points 17 hours ago (8 children)

But chatgpt actually sucks though, its one of the worse ones.

  • source
  • hideshow 8 child comments
  • [–] 21 points 16 hours ago (5 children)

    When deepseek came out I never looked back.

    Open source should be the standard for supposedly world ending technology.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 3 points 15 hours ago* (2 children)

    Locally run AI should be the standard. All you have to do is download a .gguf file from hugging face (around 8 gig) and load it into Koboldcpp's GUI... Or AnythingLLM if Kobolcpp is too technical for you.

    Some models run faster, others run slower (depending on hardware, model size, and structure). Models like LFM2.5 for instance runs pretty fast because it's more like 3 small models cowriting responses.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 4 points 12 hours ago (1 child)

    Minimal viable local AI that can actually solve problems in agentic mode is qwen 3.8 dense/flash. You are looking at fat ass pc with 16 gb vram 64 ram for flash or 32vram for dense.

    Maybe if not for AI bubble prices on hardware, that would be affordable. But today it costs a whole lot for a machine that ideally shouldn't be the same you are working on - cause whatever you use will eat vram/ram.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 0 points 8 hours ago*

    If by "solving problems" you mean - you yell your criteria at it enough times that it actually listens and does what you asked for half an hour ago... then sure.

    Let's face it, most of the time that's what interacting with AI is like. It feels like repeatly asking for the same thing and getting variations that you didn't really ask for... Then eventually settling for what it's done.

  • source
  • parent