everytime i check nginx logs its more scrapers then i can count and i could not find any good open source solutions

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 1 year ago

since its the frontends i run getting scraped its the robots.txt included there

  • source
  • parent