1

Is it possible to have different sitemaps for different robots? I could put disallows in the robots.txt file, but that is a lot of work.

6
  • Why would you need to have different sitemaps for different robots? Commented Jun 22, 2022 at 13:42
  • I am using some website checking sites in the free mode, where there is a limit to the urls. If I could have a different sitemap for these, then I could put the modified pages in there, or even rotate the pages. Commented Jun 22, 2022 at 23:04
  • 1
    How do you submit the sitemap to these website checking sites? Commented Jun 22, 2022 at 23:32
  • Good point, unfortunately, They all take the url of the main page. Commented Jun 23, 2022 at 10:59
  • 2
    It sounds like they may not use the sitemap at all. It sounds like they crawl links from the main page. Commented Jun 23, 2022 at 11:00

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.