Is it possible to have different sitemaps for different robots? I could put disallows in the robots.txt file, but that is a lot of work.
-
Why would you need to have different sitemaps for different robots?– Stephen Ostermiller ♦Jun 22 at 13:42
-
I am using some website checking sites in the free mode, where there is a limit to the urls. If I could have a different sitemap for these, then I could put the modified pages in there, or even rotate the pages.– Rohit GuptaJun 22 at 23:04
-
1How do you submit the sitemap to these website checking sites?– Stephen Ostermiller ♦Jun 22 at 23:32
-
Good point, unfortunately, They all take the url of the main page.– Rohit GuptaJun 23 at 10:59
-
2It sounds like they may not use the sitemap at all. It sounds like they crawl links from the main page.– Stephen Ostermiller ♦Jun 23 at 11:00
|
Show 1 more comment