6
AI crawlers user-agent strings? (lemmy.zip)
submitted 1 year ago by to c/ai_infosec@infosec.pub
3 comments fedilink hide all child comments
 

Hi

Any recommandations for an actively maintained AI user-agent list please ?

This is not perfect but I use that trick to block or slow down some of them... If you have a better way I'm all ears.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 3 points 1 year ago

Thanks for the link, I will compare the user-agent regex they use like this one for Claude and the list I've build over time.

They match IP range too, it may be a nice addition too.

  • permalink
  • fedilink
  • source
  • parent