Support

hideshow 9 child comments

parent

[–] Dave@lemmy.nz 1 point 2 months ago (7 children)

For the last 3 days (since turning on the block) there has been a dead spot from China from 4:00 to 14:00 NZST.

@Dave@lemmy.nz you seeing the same drop?

Ah i missed your edit. I don't have per country data like that, I've only very recently played with removing Cloudflare from the equation and haven't set up any geo-location stuff yet. My requests are coming pretty evenly over the day though, up and down a bit bit depending on time but nothing like what you're describing. I'm looking at all traffic though, not just China.

hideshow 7 child comments

parent

[–] BlueEther@no.lastname.nz [S] 2 points 2 months ago (6 children)

It's was getting worse, near 1,000,000 requests blocked in only 14 hours, peaking at 67/s blocked

When I get home I'll gig into the peak

hideshow 6 child comments

parent

[–] Dave@lemmy.nz 1 point 2 months ago (5 children)

Damn, good luck! At least those are all blocked rather than killing your server.

hideshow 5 child comments

parent

[–] BlueEther@no.lastname.nz [S] 2 points 2 months ago* (last edited 2 months ago) (3 children)

This would have been a hectic 5 min.

Can you tell when I turned CF off?

vs.

hideshow 3 child comments

parent

[–] Dave@lemmy.nz 1 point 2 months ago (2 children)

Do you know how many of those are being caught by iocaine?

These are my stats for anubis (this is only UI requests - LemmyUI and Mlmym mostly, no federation or app usage in this). A total of about 600k requests. Weigh and Challenge are the options given a proof of work challenge to solve (weigh just means the rules for the user agent or whatever mean the challenge difficulty was adjusted, often to make it harder for suspicious requests).

Out of the challenges issued in this time period, around 11% were validated (so 89% of the weigh and challenge traffic was also denied in addition to "deny" which was denied without issuing a challenge due to rules).

hideshow 2 child comments

parent

[–] BlueEther@no.lastname.nz [S] 2 points 2 months ago (1 child)

I've not set up nice graphics for iocaine (or any of the host stats) bu this is the last 5 days and that is with the asn-blocks and AI block turned on in CF

curl -s http://127.0.0.1:42042/metrics | grep '^qmk_'
qmk_garbage_generated{host="127.0.0.1:42069"} 3888
qmk_garbage_generated{host="no.lastname.nz"} 1147955554
qmk_requests{host="127.0.0.1:42069"} 2
qmk_requests{host="172.18.0.1:42069"} 6
qmk_requests{host="no.lastname.nz"} 1386448
qmk_ruleset_hits{outcome="default",ruleset="default"} 490771
qmk_ruleset_hits{outcome="default",ruleset="trusted-agent"} 2
qmk_ruleset_hits{outcome="default",ruleset="trusted-path"} 134
qmk_ruleset_hits{outcome="garbage",ruleset="ai.robots.txt"} 1689
qmk_ruleset_hits{outcome="garbage",ruleset="major-browsers"} 48928
qmk_ruleset_hits{outcome="garbage",ruleset="poisoned-url"} 844868
qmk_ruleset_hits{outcome="garbage",ruleset="unwanted-visitors"} 64

parent

hideshow 1 child comment

[–] Dave@lemmy.nz 1 point 2 months ago

Hmm it looks like it's working, right? Like a billion (!) garbage pages generated. Still 500k getting through but over 5 days that seems minimal.

parent

[–] BlueEther@no.lastname.nz [S] 2 points 2 months ago

It does look like that since 9am it's back to not much above background sort of levels, although at 6k/15min it would be more that doubling the server load.That 60K/15min may have made it struggle

parent

[–] Dave@lemmy.nz 1 point 2 months ago

It's just crazy, these indescriminate scrapers are the worst. They think they are getting more data but they are just scraping the same data over and over via different instances 🙄