New answers tagged crawl-rate
2
votes
Too many hits from GoogleBot
Late ressponse, but I think Google still has this problem...
I have seen the same behavior. Over the course of just a couple days millions of rapid fire request were made effectively shutting down the ...
Top 50 recent answers are included
Related Tags
crawl-rate × 49googlebot × 31
web-crawlers × 25
seo × 14
google × 10
google-search-console × 10
robots.txt × 7
search-engine-indexing × 4
crawl-errors × 4
technical-seo × 4
crawl-budget × 4
performance × 3
ranking × 2
url × 1
apache × 1
search-engines × 1
sitemap × 1
google-index × 1
advertising × 1
blog × 1
pagerank × 1
xml-sitemap × 1
page-speed × 1
webserver × 1
google-ranking × 1