Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I'm working on a fairly large site, that generates a dynamic sitemap hourly. Now in Google Webmaster Tools the sitemap isn't submitted yet and I'm shying away because I'm afraid that the new content (which appears in the dynamic sitemap) won't get crawled as quickly. So my question is: How often do the GWT check the sitemap once submitted?

Any other thing I should be aware of when working with GWT and dynamic pages?

P.S. I checked this thread How often are sitemap.xml checked for updates by crawlers? and from what I understand Google crawls more often when the site gets updated regularly - but does the same apply for the GWT?

share|improve this question
add comment

1 Answer

The fetching of sitemap files is actually performed by googlebot. The frequency of fetching sitemaps appears to be governed by pagerank and change frequency, similar to how other urls are scheduled for re-crawl.

I have several sites with sitemap ranging in PR from two to five. Googlebot appears to fetch the sitemap files between once a month and six times a month. My sitemaps are rarely updated (less than once a month on average).

In any case, submitting the sitemap should only help. If Googlebot does find new urls to crawl in the sitemap, it should do that crawling right away. If it doesn't find the urls in a sitemap, it will crawl them just as quickly as it would have otherwise.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.