I have actually pretty simple question. Having new sitemap every week and get it indexed immediately. How can I guarantee that the new fresh content will be indexed immediately by Google without building new sitemap. I suspect there are should be kind of trigger to index just one particular URL that will be working with huge sitemap created early.


There is no way to guarantee it. Google will crawl your site whenever it feels like it. Typically sites that are updated often and have a lot of quality links are crawled more frequently then those that do not.


In response to your comments: Your sitemap should reflect all of the content on your website that you wish to have crawled and indexed. So if you keep adding pages to your site then your sitemap should grow accordingly.

Like I said in my answer above, Google isn't going to find your changes or update its index quickly for a site like yours. You need to be patient and continue to add content and seek links to your site. Google will eventually find your changes and update its index accordingly. If and when this happens is beyond your direct control.

  • I just found very interesting topic FAQ take a look at question Q: I changed some text on my pages, why isn't it updated in the search results? My question is can I create sitemap incrementally, such that I have cumulative sitemap every week, and small update every day with ping. Will this wort properly, or everyday update will overwrite the cumulative sitemap? – com Nov 15 '11 at 14:16
  • Thanks for your answer! I wish I could vote. In your opinion how frequently can I build sitemap? If there is any way to know that google already have indexed my site? (of course not from search string). Sorry for being annoying, but I really need to know the details. Thanks! – com Nov 15 '11 at 14:29
  • You can build a sitemap as often as you want. In fact, many sitemaps are dynamic and add new pages immediately upon their creation. If you want to know more about how Google sees your content sign up for a Google webmaster account. – John Conde Nov 15 '11 at 14:32

The sitemap isn't all that useful unless you have over 1000 pages or so, so large that Googlebot isn't likely to crawl it all at once. As long as you have clear navigation and URL structure, Googlebot will find your content, new and updated, when it crawls your site. If your site appears more active, it will get crawled more frequently than a less active one. In other words, don't worry so much about the sitemap unless you have a highly complex or large site where Googlebot will need help in finding everything.

You can use pinging to alert search bots of new/updated content. Many CMS scripts have this built into them. You only need to ping once since additional pings are ignored.

It's also effective for indexing purposes to use Twitter, Facebook and other social media to highlight new content. If you can get other people repeating your new content links, so much the better.

Lastly, getting strong, long term, links to your content is essential to having your site rank well and for it to be crawled more often.

  • Do you know, If there is any way to know that google already have indexed my site. I can come up with two of them, searching for robots.txt in your web server log and searching for google user-agent in log. Do you know any other way? Thanks – com Nov 16 '11 at 5:15
  • I check Google itself by using site:mydomainname.com to show the indexed pages. I usually do this via the SEOQuake toolbar in Firefox. You can also use Google Webmaster Tools for some additional information if you want it. – jfrankcarr Nov 16 '11 at 11:56

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.