you are viewing a single comment's thread
view the rest of the comments
[–] 8 points 1 month ago (2 children)

Think of it like making a xerox copy of a xerox copy. The copy of the copy is always shittier.

Using synthetic data can escalate model collapse, as a model is only as good as its training data, which is partly why these LLM models "hallucinate", having been trained on a wealth of garbage from Reddit.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 1 month ago

    I was going to make a snarky comment about

    "How's it thinking then?! I was trained by adults and so forth back generations!"

    Then I looked at the quality of people trained by other humans instead of nature, comparing myself to my ancestors, looking at the society around me.

  • source
  • parent