And there's a fine if the company doesn't comply which is basically now gonna be considered the cost of doing business

The New York measure defines a stealth crawler as any software that retrieves, scrapes or otherwise accesses a website, including AI agents. Under the bill, the attorney general’s office would be able to sue companies that fail to disclose such activity. Violations could net civil penalties of up to $15,000 per day.

🤔

The article is about "stealth bots" that don't identify themselves as such. The Internet Archive bots have always been clearly identifiable.

I'm guessing it's to eliminate the issue of a site not getting clicks because the article you were about to read is already summarized for you. It also opens the door for revenue negotiations for allowing their content to be scraped for that purpose, as the scraper bots would now be identified.

What are you on about?

For AI purposes the really useful part of a news site is the actual news - you know, the stuff that changes practically every minute - not the "structure" of the site.

These news sites aren't being scraped for training data anymore but to provide near-realtime up to date information to the models.

Meaning e.g. Gemini can scan your news article, extract the useful information for the user, and deliver it to the user, without them ever going to your news site and providing the interaction that at the end of the day is converted to money - money your site needs to run.