you are viewing a single comment's thread
view the rest of the comments
[+] [S] -14 points 5 months ago (2 children)
  • [–] 12 points 5 months ago

    I have to use them for work. Even the cloud hosted ones (which are arguably better than self hosted as they can have more resources thrown at them) need all of their output reviewed. They just aren't up to the level of code generation as a senior dev yet (and if you think they are, I feel sorry for how unskilled your team is).

  • source
  • parent
  • [–] 8 points 5 months ago*

    Locally hosted LLMs are a better option, but it doesn't change the fact that the technology is designed outright to give a statistically likely result (based on the training data), instead of a correct one. LLMs make "guesses" about what the output should be and are not capable of internal regulation. They do not understand concepts and merely regurgitate jumbled data back at you with no consideration for content beyond that what can be analyzed statistically. It's not a question of if they will make a mistake, but where and when.

    https://youtube.com/shorts/ZMP8_jD-y0s?si=SXNyzYiWfWt2iWUG These kinds of responses are an inherent feature of how they function, they cannot be fixed or tweaked out of the system.

  • source
  • parent