None of those things work well is the problem. It doesn't stop the bots from hammering you site. Crawlers will just timeout and move on.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
None of those things work well is the problem. It doesn't stop the bots from hammering you site. Crawlers will just timeout and move on.