you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 1 year ago

The problem is Ai doesn't follow robots.txt,so Cloudflare are Anubis developed a solution.

  • source
  • parent