191
Lemmy.ca & piefed.ca now behind anubis (lemmy.ca)
submitted 6 months ago by to c/main@lemmy.ca
44 comments fedilink hide all child comments
 

Thanks to a particularly annoying botnet, everyone's favorite anime cat girl firewall is now helping protect piefed.ca & lemmy.ca from bots and scrapers.

This is requests per second and these are all thousands of scrapers on residential IPs hammering us:

They'd increase their usage until the site started struggling, then move on. I banned their user agents, but have no interest in a cat & mouse game. Anubis should hopefully keep things running much smoother for everyone.

Let me know if you have any trouble!

you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 6 months ago (2 children)

tbh i would prefer something silent instead of a full screen block page while it figures out whether I'm a bot or not

I don't even like cloudflare click to confirm you're not a bot pages which auto confirm

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 9 points 6 months ago*

    To my knowledge, which is often wrong, that's necessary.

    It's a proof of work system, so your browser has to receive the challenge work, create background workers to do it, then submit the results and get authenticated.

    If the work wasn't challenging (slow), then it wouldn't be any impediment to scrapers and bots.

    Whether there are alternatives to proof of work that work well, I do not know. But fingerprinting alone is actually very difficult.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 6 months ago

    FWIW I think cloudflare and similar do the full screen thing too, they just render a blank page though so it just feels like more load time.

    I don't run Anubis on my stuff currently, but I'd be surprised if it doesn't have a similar feature

  • permalink
  • fedilink
  • source
  • parent