you are viewing a single comment's thread
view the rest of the comments
[–] 35 points 1 year ago (11 children)

heh I wonder if all the "old" content getting messed with and/or removed is causing issues with the algorithm/scraper.

  • source
  • hideshow 11 child comments
  • [–] 37 points 1 year ago (10 children)

    For unauthorized scrapers? Definitely

    For paid API usage? That tends to not be public for obvious reasons but, allegedly, people have, allegedly, done tests and found "deleted" content in the results.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 10 points 1 year ago (3 children)

    Ive heard the same but I haven't seen real evidence anywhere, so im skeptical. But yes I agree, if they CAN get that data, it means the training data is better-ish....

    But we are still on this site for a reason :)

  • source
  • parent
  • hideshow 3 child comments
  • [–] 21 points 1 year ago (1 child)

    I mean... if the reason you left is because you didn't want your data scraped then... the fediverse is one of the worst places to go? Because anyone can run a modified lemmy instance to pull everything through the tools specifically designed to do that.

    Let alone just scraping websites that don't have teams of big corporate lawyers.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago

    What kinda of data would be valuable that people leave behind on Reddit? Personal information? Personally I don't really do that when it comes to commenting, though Reddit probably knows where I live through my unsecured connection online. When it comes to comments or posts on Reddit, it's not real data anyways because I always lie online.

  • source
  • parent
  • [–] 3 points 1 year ago

    It's all relative I guess. I can see why the original GPT's used the Reddit corpus for training. However I've always been a little sceptical about the quality of the training set in any social media given how much it exaggerates the extremes of people's behaviour.

  • source
  • parent
  • [–] 6 points 1 year ago (5 children)

    That's why I edited everything before deleting it.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 6 points 1 year ago (1 child)

    I edited everything before deleting it, double-checked it was still deleted periodically, and it all got restored sometime earlier this year.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 1 year ago

    Version control mother fucker, do you speak it?

    But, in all seriousness: That is what they use for the comments. It is why a lot of the mass delete tools were "accidentally" undone during The Exodus. Because it was literally just rolling back. Theoretically there might be a limited number of revisions available but if you believe that I have a bridge to sell you. Because imagine if A Brown Person wrote a message then edited it five times so that Chloe couldn't alert Jack Bauer to who to torture

  • source
  • parent