59
Blunt Banhammer Blocks Basic Bots Ballistically (shkspr.mobi)
submitted 2 days ago by to c/technology@lemmy.world
8 comments fedilink hide all child comments
 

I cut bot traffic to my site by over 80% with a simple trap. Last month, my hobby website OpenBenches.org transferred more than 2.5TB of data to visitors. As much as I'd like to think the site is enormously popular, it looks like it is just AI bots endlessly crawling the data and slurping up the images. So I've built B to be an indiscriminate tool to eradicate these unwanted parasites. It is…

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 day ago (1 child)

Well, then these proxy networks will be banned. Maybe he should parse the ban lists occasionally if some entries can be compacted down to something/24 or so.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 1 day ago

    The proxies are implemented by malware running inside TV sets, so the addresses are whatever Comcast or the like hands out. They're not organized in blocks, and there are millions of them. Typically you'd get just one or a few requests from each address.

  • permalink
  • fedilink
  • source
  • parent