1

it sounds a silly question, but I actually could not find a reference to it. I have created a sitemap_index with about 100-ish sitemaps. No errors.

I submitted only the sitemap_index to Google webmaster. It displayes only one sitemap indexed (1 Url) that should contain 50K links, but if a test: site:example.com does show in fact only ten pages which were crawled not from the sitemap, with no links from the sitemaps.

enter image description here enter image description here

I uploaded the sitemap_index and sitemaps more than one week ago (I re-uploaded everything today, as a test - dates refers to today).

I read through similar question: [Too much delay for indexing Sitemap in Webmaster Tools?

all urls are live ones, not redirected.

URLs in sitemaps have are like:

example.com/path/my-string-id-for-item-example-64fdjbJfan/item-slug-name

The type of content that should get indexed contains names of topics. The site is about data-visualisation: data is then manipulated via ajax, but html page contains meta populated via server side: a url was successfully indexed as test for a single submit, not from the sitemaps.

I just cannot understand if my sitemaps are actually getting crawled and eventually indexed or not. If not, I cannot understand why not, and cannot understand the discrepancy for having at least 1 sitemap in sitemap_index, indexed, but a test site:example.com not showing any result from it.

I would be happy to share sitename in private, in case you would like to have a closer look at how pages are created - I don't want to post it not to make it sound as advertisement or such!.

UPDATE

My robots.txt includes only the sitemap_index (here sitemap.xml) :

User-agent: *
Allow: /

Sitemap: http://example.com/sitemap.xml

Should I include all sitemaps mentioned in sitemap_index also in robots.txt?

  • This may help to clarify things a bit: webmasters.stackexchange.com/questions/72610/… It can take quite a while for Google to go through all these files so be very patient. – closetnoc Apr 11 '16 at 17:20
  • thank you @closetnoc I ve read your other answer, it gives some more details and my site is definitely new. However, I don't undertand the discrepancy between Google Index > Index Status and the only sitemap.xml that have been indexed from sitemap_index.xml : those 50K links should appeared as indexed, right? Why only one sitemap.xml is indicated as indexed, if all of them have been read in the same time? Just to be sure everything is in in place and not misconfigured, robots.txt is ok with only sitemap_index in it, right? – user305883 Apr 11 '16 at 18:10
  • 1
    The number of pages indexed within a sitemap is mostly a junk number. This is part of an audit of the sitemaps that will go up and down in fit and spurts and will never match reality. Do not get hung up on this number. It is not important. Index Status and Site: will tell you something. – closetnoc Apr 11 '16 at 21:11
1

Your sitemaps are getting crawled. To say they are being indexed would be a misnomer as the sitemap is simply giving Google a list of URL's to crawl and index, but while the sitemaps are getting crawled by Google to get the URL's they contain the sitemaps don't get indexed themselves.

The screenshot you are showing indicates that all of the sitemaps in the sitemap index have been detected by Google and all of the URL's have been added to the queue to be crawled. This is where the "web pages" box comes into play. What this indicates is how many URL's have been pulled out of the sitemap files and submitted to the crawling queue to be crawled, and out of them how many have actually been indexed thus far.

From what you have provided ion your question and comments everything appears to be going fine. The fact that you have over 5 million URL's will inevitably mean that it will take some time for Google to finish crawling and indexing them all so best thing is to hang tight and keep an eye on it. As each page is crawled and indexed you will see the number 1 start go higher and higher.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.