Just a thought - if you design a system to prevent AI crawlers, instead of booting them off, serve crypto-mining JavaScript instead. It would be very funny.

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 1 year ago

My understanding of Anubis is that it just leads the crawler into a never-ending cycle of URLs

That's not how Anubis works. You're likely thinking of Nepenthes

  • source
  • parent