you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 9 months ago

AmazonBot follows robots.txt. I don't so what Huawei and Azure ASNs have to do with it - that sounds like those requests simply come from inside a Huawei and an Azure network, respectively, but could otherwise be anything.

  • source
  • parent