Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

Currently my site is being crawled by the Googlebot on a daily basis. Is a daily crawl from the Googlebot a good thing or bad thing?

share|improve this question
1  
Uh... It's good if you want it to be searchable, and bad if you dont. This is not a programming question. –  asawyer Jan 18 '11 at 18:30
1  
send us the url, and we have a look first and determine if its good or bad. –  c2h2 Jan 18 '11 at 19:22
    
@c2h2 I hope that's a joke –  abel Jan 18 '11 at 20:19
add comment

migrated from stackoverflow.com Jan 18 '11 at 18:31

This question came from our site for professional and enthusiast programmers.

4 Answers

Is a daily crawl from the Googlebot a good thing or bad thing?

Good/Bad will depend on ...

  • Does the content change daily ?
  • Can you afford the bandwidth/transfer bill ?
  • Is it the whole site or specific pages ?
  • Have you solved any canonicl and duplicate issues ?

And of course, far more importantly ... is it translating into more visitors and more sales ?

share|improve this answer
add comment

It's a good thing. This means that Google will find your new content faster which means it can be included in their index sooner. It's got to be in the index to be found in searches.

Keep in mind that this doesn't mean your pages will rank well. It doesn't even necessarily mean your pages will be indexed. But under normal circumstances being visited regularly by Googlebot means your content is being found and indexed relatively quickly. And that's a good thing.

share|improve this answer
add comment

Google crawling your site is the first step to being indexed. But, crawling in itself is more of an indicator of what is going on rather then good or bad. IE if Google is crawling your site real hard every day but none of your pages show in Google search it's probably a bad sign and you need to figure out why they are not including your site even though they know about it. On the other hand if your site is new and large and they are crawling a lot of deep pages on your site it's probably a good sign that Google likes what you have to offer and wants it in their index ASAP. Looking at your logs to see crawl patterns will also help you find issues with your site structure in terms of crawling and indexing. So I'd say rather then good or bad think of it as an opportunity.

share|improve this answer
add comment

It's a good thing because it means Google is indexing your site so that it can show up in search results.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.