Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I have actually pretty simple question. Having new sitemap every week and get it indexed immediately. How can I guarantee that the new fresh content will be indexed immediately by Google without building new sitemap. I suspect there are should be kind of trigger to index just one particular URL that will be working with huge sitemap created early.

share|improve this question

migrated from stackoverflow.com Nov 15 '11 at 14:02

This question came from our site for professional and enthusiast programmers.

add comment

2 Answers 2

up vote 1 down vote accepted

There is no way to guarantee it. Google will crawl your site whenever it feels like it. Typically sites that are updated often and have a lot of quality links are crawled more frequently then those that do not.

Update

In response to your comments: Your sitemap should reflect all of the content on your website that you wish to have crawled and indexed. So if you keep adding pages to your site then your sitemap should grow accordingly.

Like I said in my answer above, Google isn't going to find your changes or update its index quickly for a site like yours. You need to be patient and continue to add content and seek links to your site. Google will eventually find your changes and update its index accordingly. If and when this happens is beyond your direct control.

share|improve this answer
    
I just found very interesting topic FAQ take a look at question Q: I changed some text on my pages, why isn't it updated in the search results? My question is can I create sitemap incrementally, such that I have cumulative sitemap every week, and small update every day with ping. Will this wort properly, or everyday update will overwrite the cumulative sitemap? –  com Nov 15 '11 at 14:16
    
Thanks for your answer! I wish I could vote. In your opinion how frequently can I build sitemap? If there is any way to know that google already have indexed my site? (of course not from search string). Sorry for being annoying, but I really need to know the details. Thanks! –  com Nov 15 '11 at 14:29
    
You can build a sitemap as often as you want. In fact, many sitemaps are dynamic and add new pages immediately upon their creation. If you want to know more about how Google sees your content sign up for a Google webmaster account. –  John Conde Nov 15 '11 at 14:32
add comment

The sitemap isn't all that useful unless you have over 1000 pages or so, so large that Googlebot isn't likely to crawl it all at once. As long as you have clear navigation and URL structure, Googlebot will find your content, new and updated, when it crawls your site. If your site appears more active, it will get crawled more frequently than a less active one. In other words, don't worry so much about the sitemap unless you have a highly complex or large site where Googlebot will need help in finding everything.

You can use pinging to alert search bots of new/updated content. Many CMS scripts have this built into them. You only need to ping once since additional pings are ignored.

It's also effective for indexing purposes to use Twitter, Facebook and other social media to highlight new content. If you can get other people repeating your new content links, so much the better.

Lastly, getting strong, long term, links to your content is essential to having your site rank well and for it to be crawled more often.

share|improve this answer
    
Do you know, If there is any way to know that google already have indexed my site. I can come up with two of them, searching for robots.txt in your web server log and searching for google user-agent in log. Do you know any other way? Thanks –  com Nov 16 '11 at 5:15
    
I check Google itself by using site:mydomainname.com to show the indexed pages. I usually do this via the SEOQuake toolbar in Firefox. You can also use Google Webmaster Tools for some additional information if you want it. –  jfrankcarr Nov 16 '11 at 11:56
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.