Tweeted twitter.com/#!/StackWebmasters/status/202265743037964288
2 deleted 103 characters in body
source | link

I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files.

Sorry I had a lovely image to display here but I can't because I don't have enough rep

My question is: In my robots.txt file how do I specify the sitemap file?

Do I refernce the sitemap.xml only? As in the following:

User-agent: *
Allow: /
Sitemap: www.mysite.com/sitemap/sitemap.xml

Or do iI have to specify ALL the *.xml.gz files in the sitemap too?

Thanks!

I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files.

Sorry I had a lovely image to display here but I can't because I don't have enough rep

My question is: In my robots.txt file how do I specify the sitemap file?

Do I refernce the sitemap.xml only? As in the following:

User-agent: *
Allow: /
Sitemap: www.mysite.com/sitemap/sitemap.xml

Or do i have to specify ALL the *.xml.gz files in the sitemap too?

Thanks!

I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files.

My question is: In my robots.txt file how do I specify the sitemap file?

Do I refernce the sitemap.xml only? As in the following:

User-agent: *
Allow: /
Sitemap: www.mysite.com/sitemap/sitemap.xml

Or do I have to specify ALL the *.xml.gz files in the sitemap too?

1
source | link

Do I reference all my *.xml.gz sitemap files in robots.txt

I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files.

Sorry I had a lovely image to display here but I can't because I don't have enough rep

My question is: In my robots.txt file how do I specify the sitemap file?

Do I refernce the sitemap.xml only? As in the following:

User-agent: *
Allow: /
Sitemap: www.mysite.com/sitemap/sitemap.xml

Or do i have to specify ALL the *.xml.gz files in the sitemap too?

Thanks!