you are viewing a single comment's thread
view the rest of the comments
[–] 25 points 2 months ago (9 children)

I think it's directed at the "I don't use commercial LLMs, I just run small local models" crowd

  • source
  • parent
  • hideshow 9 child comments
  • [–] 6 points 2 months ago (8 children)

    yes and what books are they destroying?

  • source
  • parent
  • hideshow 8 child comments
  • [–] 16 points 2 months ago (7 children)

    Those smaller models are trained on the larger models. They take just as many resources to train and then you add on more training, so they’re literally worse than the big models.

  • source
  • parent
  • hideshow 7 child comments
  • [–] -1 points 2 months ago (6 children)

    What if your power comes from renewables? And if you're training private data?

  • source
  • parent
  • hideshow 6 child comments
  • [–] 4 points 2 months ago* (3 children)

    And what if tech oligarchs weren’t evil and used this new technology to make lives better instead of concentrating capital? We don’t have that either so there’s no use speculating.

    Snark aside, I think you’re underestimating just how much data it takes to make these models work. There is no such thing as enough “private” data for training.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 2 months ago (2 children)

    There is no such thing as enough “private” data for training.

    what the fuck are you on about? You can build local datasets and train additional LORAs locally to have more relevant outputs, and it doesn't go back to the creators of the original weights.

  • source
  • parent
  • hideshow 2 child comments