I know there are tools that supposedly make it harder for AI to be trained on your images. But what about text or code? Is there any way to share things outside of a small group while minimizing the risk that some fucker will scrape them or otherwise use them for building an LLM?

you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 3 months ago (6 children)

AFAIK it was a glue trap / tarpit that one guy I know tried. Sure, it did result in the scraper getting a lot of useless data. OTOH, they dedicated massive resources to trying to get those non-existent documents, so his website was effectively DDOSed as a result. That's why he's now blocking entire countries.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 4 points 3 months ago (5 children)

    yeah slowing down access and using a cheap generation method is important there.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 3 months ago (4 children)

    Even that isn't enough if they respond to that by just throwing more crawlers at your site.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 3 months ago (3 children)

    yeah it's not the only thing you want on there of course. i run a tarpit, fail2ban, and anubis.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 3 months ago (2 children)

    Yeah, at one point he posted that fail2ban was only able to ban about 20 IPs/second, but he was getting 200 requests per second, and the bans weren't having a meaningful impact on that (i.e. the requests were all coming from different IPs). From what I remember, his system load was over 1000.

  • source
  • parent
  • hideshow 2 child comments