▲ 178 ▼ New York Becomes First State to Ban Bots That Scrape News Sites (news.bgov.com) submitted 5 months ago by TryingToBeGood@reddthat.com to c/technology@lemmy.world 19 comments fedilink hide all child comments
[–] pelespirit@sh.itjust.works 9 points 5 months ago (2 children) Soooo, that means archive.is too. This fucking sucks. permalink fedilink source parent hideshow 2 child comments replies: [–] XLE@piefed.social 4 points 5 months ago* I hope those tools are exempt because, just like a browser, they respond only to specific commands issued by a human user. They don't "crawl" pages in the way we describe bots that jump from page to page. permalink fedilink source parent [–] Prove_your_argument@piefed.social 2 points 5 months ago Isn’t there something like 340 news sites that actively block them already? permalink fedilink source parent
[–] XLE@piefed.social 4 points 5 months ago* I hope those tools are exempt because, just like a browser, they respond only to specific commands issued by a human user. They don't "crawl" pages in the way we describe bots that jump from page to page. permalink fedilink source parent
[–] Prove_your_argument@piefed.social 2 points 5 months ago Isn’t there something like 340 news sites that actively block them already? permalink fedilink source parent