you are viewing a single comment's thread
view the rest of the comments
[–] 8 points 1 year ago

AI crawlers ignoring robots.txt and trying to vaccum wisdom of the fediverse?

  • source