you are viewing a single comment's thread
view the rest of the comments
[–] 11 points 4 months ago* (4 children)

Same. Its somewhat useful on some very small scripting or tasks...but its mostly just to try out a new model or two. Its not really useful for anything big.

I will have to say....even my tiny models are about as good as Chatgpt/Claude/etc... which makes me think about how much people are spending on tokens regularly. I was able to get the same kind of python script started with my local tiny model that was comparable to the newest Claude code offerings.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 4 months ago (3 children)

    What local models have you been using? And what hardware are you running them on? I've been playing with local LLMs a bit for exactly your use case.

    I have zero interest in vibe coding or full agentic workflows. But having a local LLM generate a Bash script to help me automate parts of my home lab infrastructure would be nice.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 4 months ago (2 children)

    What are your hardware specs?

  • source
  • parent
  • hideshow 2 child comments