I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files.
Sorry I had a lovely image to display here but I can't because I don't have enough rep
My question is: In my robots.txt file how do I specify the sitemap file?
Do I refernce the sitemap.xml only? As in the following:
User-agent: *
Allow: /
Sitemap: www.mysite.com/sitemap/sitemap.xml
Or do iI have to specify ALL the *.xml.gz files in the sitemap too?
Thanks!
I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files.
Sorry I had a lovely image to display here but I can't because I don't have enough rep
My question is: In my robots.txt file how do I specify the sitemap file?
Do I refernce the sitemap.xml only? As in the following:
User-agent: *
Allow: /
Sitemap: www.mysite.com/sitemap/sitemap.xml
Or do i have to specify ALL the *.xml.gz files in the sitemap too?
Thanks!
I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files.
My question is: In my robots.txt file how do I specify the sitemap file?
Do I refernce the sitemap.xml only? As in the following:
User-agent: *
Allow: /
Sitemap: www.mysite.com/sitemap/sitemap.xml
Or do I have to specify ALL the *.xml.gz files in the sitemap too?