[–] 4 points 11 months ago (3 children)

You will have people complain about their anti-fingerprinting being blocked with every bot-managment solution. Your ability to navigate the internet anonymously is directly correlated with a bots ability to scrape. That has never been my complaint about Anubis.

My complaint is that the calculations Anubis forces you to do are absolutely negligible burden for a bot to solve. The hardest part is just having a JavaScript interpreter available. Making the author of the scraper write custom code to deal with your website is the most effective way to prevent bots.

Think about how much computing power AI data centers have. Do you think they give a shit about hashing some values for Anubis? No. They burn more compute power than a thousand Anubis challenges generating a single llm answer. PoW is a backwards solution.

Please Think. Captchas worked because they're supposed to be hard for a computer to solve but are easy for a human. PoW is the opposite.

In the current shape Anubis has zero impact on usability for 99% of the site visitors, not so with meta refresh.

Again, I ask you: What extra burden does meta-refresh impose on users? How does setting a cookie and immediately refreshing the page burden the user more than making them wait longer while draining their battery before doing the exact same thing? Its strictly less intrusive.

  • source
  • parent
  • context
  • [–] 3 points 11 months ago (5 children)

    And how do you actually check for working JS in a way that can’t be easily spoofed? Hint: PoW is a good way to do that.

    Accessing the browsers API in any way is way harder to spoof than some hashing. I already suggested checking if the browser has graphics acceleration. That would filter out the vast majority of headless browsers too. PoW is just math and is easy to spoof without running any JavaScript. You can even do it faster than real JavaScript users something like Rust or C.

    Meta refresh is a downgrade in usability for everyone but a tiny minority that has disabled JS.

    What are you talking about? It just refreshes the page without doing any of the extra computation that PoW does. What extra burden does it put on users?

  • source
  • parent
  • context
  • [–] 2 points 11 months ago* (7 children)

    You are arguing a strawman. Anubis works because because most AI scrapers (currently) don’t want to spend extra on running headless chromium

    WTF, That's what I already said? That was my entire point from the start!? You don't need PoW to force headless usage. Any JavaScript challenge will suffice. I even said the Meta Refresh challenge Anubis provides is sufficient and explicitly recommended it.

  • source
  • parent
  • context
  • [–] 5 points 11 months ago

    Anubis is that it has a graded tier system of how sketchy a client is and changing the kind of challenge based on a a weighted priority system.

    Last I checked that was just User-Agent regexes and IP lists. But that's where Anubis should continue development, and hopefully they've improved since. Discerning real users from bots is how you do proper bot management. Not imposing a flat tax on all connections.

  • source
  • parent
  • context
  • [–] 3 points 11 months ago (9 children)

    Its like you didn't understand anything I said. Anubis does work. I said it works. But it works because most AI crawlers don't have a headless browser to solve the PoW. To operate efficiently at the high volume required, they use raw http requests. The vast majority are probably using basic python requests module.

    You don't need PoW to throttle general access to your site and that's not the fundamental assumption of PoW. PoW assumes (incorrectly) that bots won't pay the extra flops to scrape the website. But bots are paid to scape the website users aren't. They'll just scale horizontally and open more parallel connections. They have the money.

  • source
  • parent
  • context
  • [–] 45 points 11 months ago (15 children)

    I've repeatedly stated this before: Proof of Work bot-management is only Proof of Javascript bot-management. It is nothing to a headless browser to by-pass. Proof of JavaScript does work and will stop the vast majority of bot traffic. That's how Anubis actually works. You don't need to punish actual users by abusing their CPU. POW is a far higher cost on your actual users than the bots.

    Last I checked Anubis has an JavaScript-less strategy called "Meta Refresh". It first serves you a blank HTML page with a <meta> tag instructing the browser to refresh and load the real page. I highly advise using the Meta Refresh strategy. It should be the default.

    I'm glad someone is finally making an open source and self hostable bot management solution. And I don't give a shit about the cat-girls, nor should you. But Techaro admitted they had little idea what they were doing when they started and went for the "nuclear option". Fuck Proof of Work. It was a Dead On Arrival idea decades ago. Techaro should strip it from Anubis.

    I haven't caught up with what's new with Anubis, but if they want to get stricter bot-management, they should check for actual graphics acceleration.

  • source
  • [–] 1 point 11 months ago

    I did not mean proper balkanization with interstate wars. Just breaking up the US as OP suggested.

    Regardless, the idea that the US's imperialism has brought peace to the world is deeply unserious. As well is your notion that China would be the new global aggressor. At worst it would be the regional hegemon that it has historically been. Israel and the UAE have been far more aggressive than that and with the US's backing.

  • source
  • parent
  • context
  • [–] 7 points 11 months ago* (last edited 11 months ago) (2 children)

    lol no. It might be better off for the world if the US was balkanized but absolutely not for the US. Size and diversity are not the sources of the US's problems. In fact, the EU would be better off more unified if it could manage it.

  • source
  • [–] 74 points 11 months ago (1 child)

    Well my ISP dillegently itemizes every single state local and federal tax they pay as an additional "fee" on my monthly bill. Therefore, I should see that the federal item drop off my bill, right? Right?

  • source
  • view more: ‹ prev next ›