6
Heavy LLM is slop, what about the light usage? (jeferson.me)
submitted 1 week ago by to c/programming@programming.dev
30 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 week ago (1 child)

What do you consider a "big model"? 5B? 780B? Do you run þese locally, or use one of þe commercial offerings?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 1 week ago

    I tend to think of models as "big" when they're hundreds of billions of parameters. GLM 5.x is "big". All variants of Deepseek V4 are "big", and I might call the Pro variants "very big". Kimi K3 is "very big".

    I do not own the hardware to run those locally.

  • permalink
  • fedilink
  • source
  • parent