rtxn comments on lads

Programmer Humor

34,028 readers

8,324 active

1,492 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

Keep content in english
No advertisements
Posts must be related to programming or programmer topics
- If the mod doesn't find it funny, you're banned. Ha-ha!... For real: do not use the community for "statements". There are other places for such content. Keep it chill and funny.

founded 3 years ago

moderators

[–] rtxn@lemmy.world 12 points 1 year ago* (2 children)

Correct. Anubis' goal is to decrease the web traffic that hits the server, not to prevent scraping altogether. I should also clarify that this works because it costs the scrapers time with each request, not because it bogs down the CPU.

permalink

fedilink

source

parent

hideshow 2 child comments

[–] Xylight@lemdro.id 1 point 1 year ago (1 child)

Why not then just make it a setTimeout or something so that it doesn't nuke the CPU of old devices?

permalink

fedilink

source

parent

hideshow 1 child comment

[–] rtxn@lemmy.world 1 point 1 year ago

Crawlers don't have to follow conventions or specifications. If one has a setTimeout implementation that doesn't wait the specified amount of time and simply executes the callback immediately, it defeats the system. Proof-of-work is meant to ensure that it's impossible to get around the time factor because of computational inefficiency.

Anubis is an emergency solution against the flood of scrapers deployed by massive AI companies. Everybody wishes it wasn't necessary.

permalink

fedilink

source

parent