OpenAI, Meta, Google, and others are positioning AI agents as personal assistants that can perform a range of tasks online. But the web is becoming increasingly unfriendly toward agents, undermining their usefulness.

you are viewing a single comment's thread
view the rest of the comments
[–] 18 points 3 weeks ago

As someone who hosts a few websites without ads, I still had to block them because of their aggressive crawling. Anthropic's crawler has DOS'd my webservers and caused them to be overwhelmed.

  • source
  • parent