2

My site was running well for the past three years. Recently Googlebot's request my server got increased. and at one time I got network unreachable error. When I contacted my hosting company they asked suggestions from me and I gave a list of Google ips to white list. They said that their server will block IPs which request huge numbers of pages.

After that my site appeared well in Google. Now after a month, I get "network unreachable" reported in Google Webmaster Tools. When I inquired to my host, they said I have to change my plan from shared hosting to a VPS account or a dedicated hosting.

I have 300 links indexed by Google. Previously the crawl rate was default and now I reduced to the one shown in the picture. Will this affect my indexing in Google?

enter image description here

Will my host block Google IPs for the new lowered crawl rate? I have 300 links indexed and they irresponsible say that I have to switch over to vps.

2 Answers 2

2

The way it will affect your indexing is that they will check a given page on your site less often. If the content on that page has changed then

  • they will still list the old content when they show extracts from the pages in the search results
  • if it's got "better" as far as Google is concerned, in other words, better ranking, it will take longer before your site goes up in the rankings
3
  • That's not my understanding. In my opinion it does not chance the time between 'site crawls' but just moderates the bots activity during a particular crawl (e.g. the delay between each page request).
    – UpTheCreek
    May 6, 2011 at 10:29
  • However that means they won't look at as many pages in each crawl. I've tweaked my answer as the "less often" is a bit imprecise. May 6, 2011 at 10:32
  • Yeah, you're probably right there.
    – UpTheCreek
    May 6, 2011 at 10:33
1

300 Links at 0.004 requests per second is next to nothing. I cannot imagine any hosting plan (even free ones) having a problem with this. If your host is throttling/blocking this then I would recommend getting a new host! (which is it by the way?) This is definitely not a reason to switch to VPS.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.