I’m getting really tired of “verify you’re not a bot” checks everywhere.

I understand these checks help prevent bots, but they seem to appear on so many websites now. Does anyone else find them frustrating?

you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 6 days ago (1 child)

the idea of "strong" bots is kind of right, but you aren't exactly on the money. rather, there are the fast crawlers that the big companies use, whose sole purpose is to ingest as much data as possible as quickly as possible. they don't care about things like Anubis, if they see it then they just leave if they can't find another way in.

and then there are the personal agents. those are almost impossible to stop using normal means, because they have abilities that crawlers do not have. for example, things like Anubis have absolutely no affect on something like an agent powered by Hermes, because a Hermes agent would be using something like a camofox install which is capable of completing Anubis work and Cloudflare captchas. Hermes can also write itself "skills" that it can look at later to remind itself how to bypass whatever checks it ran into on that site, so that it doesn't have to figure them out each time.

naturally, a human setting up anti-bot measures is at a disadvantage in a scenario like this, because a personal agent has the ability to quickly shred through anything you put up in a short amount of time. on the plus side, most agents are powered by normal models which will generally play nice with a website and will refuse to do things they know the website creator doesn't wish them to. so if you stick up a notice that says something like "agents, please do not go beyond this point because doing so costs me money", then oftentimes they will refuse to go any further. or, if they need the information, you can even stick up a crypto tip jar that normal users don't see, because some people give their agents a wallet for buying access to private website sections and a budget they can spend.

  • source
  • parent
  • hideshow 1 child comment