Tell me more ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.
up vote 2 down vote favorite

I think I read somewhere that Google could stop crawling/indexing a site/blog if there was a lot of work performed on it (like many pages are modified, deleted or loaded daily). It would wait until the site stabilizes.

Unfortunately, I cannot find the post or video mentioning this. Am I making this up or is there any truth behind this? If Google indeed suspends its crawling/indexing, when does it come back?

Can someone clarify?

share|improve this question
If this was true then a site like StackExchange would suffer - it does not. Perhaps if a site went through massive structural changes that suddenly resulted in a mass of 404's ?? – w3d Dec 29 '12 at 15:39
If the site is getting modified, pages getting deleted generating 404's or even 301's etc - if site is in flux - then i think Google should wait. But a stablized site generating new content or content getting modified will be positive and important points in rankings. – John Dec 29 '12 at 17:05
What do you mean by "can" in the title? Do you mean, "does Google do that automatically", or "is it possible to make Google do that"? – DisgruntledGoat Dec 30 '12 at 16:21
I mean "does"... – JVerstry Dec 30 '12 at 16:26

2 Answers

up vote 1 down vote accepted

I would like get link from you read this because I think the opposite!

Google likes so much websites which are often modified because it means that websites are "alive" and Google wants to present "alive" websites on its index. I don't think Google likes present websites which didn't change for many time because they maybe aren't relevant any more.

More websites are updated and more Google like them and crawl them. Stack exchange sites like StackOverflow proved it in the past.

share|improve this answer
1  
From here: productforums.google.com/forum/#!msg/webmasters/shKwyqVoEiI/…;, we can conclude that no, google does not stop crawling a site, but it can significantly slow down the crawling rate if the site cannot deliver 'constant' content. – JVerstry Dec 30 '12 at 14:33
Thanks for the link. – Zistoloen Dec 30 '12 at 16:14
up vote -1 down vote

You can put a robots.txt file in your root. You can write that in notepad or so

More about it you can find here:

http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449

share|improve this answer
1  
Ok, but that is not my question... – JVerstry Dec 29 '12 at 14:30
How does that answer the OP's question? – DaveP Dec 29 '12 at 14:36

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.