Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

The logs for a website I manage show a request for a non-existent file by Bingbot. The details of the request are

  • Path: /trafficbasedsspsitemap.xml
  • Useragent: "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
  • IP address: (reverse lookup resolves to msnbot-65-55-213-244.search.msn.com)

What reason is Bingbot looking for this file? What does "Traffic Based SSP Site Map" mean?

share|improve this question

migrated from serverfault.com Feb 27 '13 at 23:37

This question came from our site for system and network administrators.

been getting a few of these in the last 24 hours or so in one of my sites, curious too. –  Rodolfo Feb 28 '13 at 18:30
I've been seeing lots of these too –  user23818 Mar 2 '13 at 9:05

1 Answer 1

up vote 13 down vote accepted

This is Vincent from Bing Webmaster Tools.

This was a Bingbot checking for an XML sitemap generated by the Bing Sitemap Plugin (Beta) for IIS and Apache - see the following for more details:

You shouldn't see this kind of discovery request very often.

share|improve this answer
The crawler does not ask the robots.txt and it doesn’t look into sitemap.xml – it just uses some made-up path again and again? This should be fixed fast. –  toscho Mar 2 '13 at 19:23
I checked one of my hosts and it gets this request once per minute. I hope some Bingbot people are able to fix this soon. –  sigurdga Mar 3 '13 at 12:06
"You shouldn't see this kind of discovery request very often". We shouldn't see it at all. Full stop. It's my first blocking Bing requests, but I blocked all IPs associated with these requests and created a UA based filter. It falls well within the URL scanner running wild category. Scanning for sitemaps (or any other contents for the matter) should be subscription based and on webmaster's requests, and certainly not wildly assuming we're using one of your solutions just because you've written it (poorly, it doesn't even handle redirects). Block remains. –  TildalWave Mar 3 '13 at 15:52
I'm getting this request about once a day per site it seems (with and without "www."), though sometimes twice to the same site within 30 minutes. –  Rodolfo Mar 5 '13 at 16:51
Is there a directive in robots.txt to tell bingbot where this special sitemap is? (or if there are no such special sitemap) –  Joelbitar Mar 13 '13 at 9:48

protected by Community Mar 5 '13 at 0:29

Thank you for your interest in this question. Because it has attracted low-quality answers, posting an answer now requires 10 reputation on this site.

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.