you are viewing a single comment's thread
view the rest of the comments
[–] 181 points 5 months ago (27 children)

The death of Stackoverflow is one of these events where the site has been completely killed by AI and yet its contents is completely necessary for AI to know about solving programming problems. Its death will mark the end of AIs ability to learn how to solve programming issues. Its cannibalizing itself in the process, as it destroys its sources it destroys its own ability to learn.

  • source
  • hideshow 27 child comments
  • [–] 91 points 5 months ago* (24 children)

    It's not just that, it's shitting where it eats. People are using it to fill the internet with disinformation, then it trains itself on it's own disinformation, and breeds even worse disinformation. This is why AI can never be smarter than it was in 2021.

    On top of that, due to the indiscriminate DDOSing of the entire internet by AI bots, websites have been blocking any web crawlers that are not Google, which just contributes to their monopoly.

  • source
  • parent
  • hideshow 24 child comments
  • [+] -23 points 5 months ago (11 children)

    I'm pretty sure AI is objectively smarter today than it was 5 years ago.

  • source
  • parent
  • hideshow 11 child comments
  • [–] 14 points 5 months ago (4 children)

    How can something with no intelligence be smarter?

  • source
  • parent
  • hideshow 4 child comments
  • [+] -8 points 5 months ago (3 children)

    It is evident that it has intelligence, it outputs intelligent responses usually adequate to its input, even if it’s badly phrased. What it doesn’t have is sentience, conscience, and a learning loop.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 5 months ago (2 children)
  • [–] -1 points 5 months ago (1 child)

    To anyone who interacts with it? Would you deny that a program automate mental labor in the same way that a sawmill automates manual labor? Isn’t that some degree of intelligence?

    Now, we have very imperfect LLMs who nevertheless can be instructed not with program code, but actual natural language, and they react accordingly. Isn’t that also intelligence? Computers that understood natural language was the realm of science fiction just five years ago.

    I get it that people hate LLMs, both because how idiots use them, and how corporations push them everywhere; but not recognizing the intelligence in those programs is naive at best.

  • source
  • parent
  • hideshow 1 child comment
  • [+] -7 points 5 months ago* (4 children)

    This is why AI can never be smarter than it was in 2021.

    You're completely wrong. First of all, datasets are getting bigger and objectively better. Secondly, technologies and methods of model training become dramatically more complex. Yes, AI content can create echo for itself, but it's a solvable issue.

    Anyone who disagrees with this fact should do a reality check and learn a little more about the current AI state. In 2021 we didn't even have reasoning in models.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 5 months ago* (3 children)

    I see someone's been suckling the OpenAI teet.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 5 months ago* (last edited 5 months ago) (2 children)

    What it have to do with OpenAI? It’s not what I’m talking about.

    Nonetheless, it’s kind of fun to see so much downvotes on my comment. Some people are so blinded by their hate (well deserved, by the way) that they will deny something that obvious.

  • source
  • parent
  • hideshow 2 child comments
  • [+] -18 points 5 months ago (6 children)
  • [–] 29 points 5 months ago (2 children)

    Our key finding is that by injecting information through an external synthetic data verifier, whether a human or a better model, synthetic retraining will not cause model collapse.

    Yeah if you have a source of truth then your model is basically getting trained on that.

    It’s like already having the answer

  • source
  • parent
  • hideshow 2 child comments
  • [–] 21 points 5 months ago*

    Our key finding is that by injecting information through an external synthetic data verifier, whether a human or a better model, synthetic retraining will not cause model collapse.

    Lol, so to make a great model, they just need to have an even better one available first or a human who can verify every single thing it ingests.

    Hmm, call me skeptical on this claim.

  • source
  • parent
  • [–] 10 points 5 months ago

    This assumes everything is valid on the external. If one slop cluster feeds off another - a slopveyor? - then there is nothing external for the validation hall-monitor to compare against. They're trusting another model's output as if it were gospel.

  • source
  • parent