Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

The logs for a website I manage show a request for a non-existent file by Bingbot. The details of the request are

  • Path: /trafficbasedsspsitemap.xml
  • Useragent: "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
  • IP address: (reverse lookup resolves to msnbot-65-55-213-244.search.msn.com)

What reason is Bingbot looking for this file? What does "Traffic Based SSP Site Map" mean?

share|improve this question

migrated from serverfault.com Feb 27 '13 at 23:37

This question came from our site for system and network administrators.

been getting a few of these in the last 24 hours or so in one of my sites, curious too. – Rodolfo Feb 28 '13 at 18:30
I've been seeing lots of these too – user23818 Mar 2 '13 at 9:05
up vote 12 down vote accepted

This is Vincent from Bing Webmaster Tools.

This was a Bingbot checking for an XML sitemap generated by the Bing Sitemap Plugin (Beta) for IIS and Apache - see the following for more details:

You shouldn't see this kind of discovery request very often.

share|improve this answer
The crawler does not ask the robots.txt and it doesn’t look into sitemap.xml – it just uses some made-up path again and again? This should be fixed fast. – toscho Mar 2 '13 at 19:23
I checked one of my hosts and it gets this request once per minute. I hope some Bingbot people are able to fix this soon. – sigurdga Mar 3 '13 at 12:06
I'm getting this request about once a day per site it seems (with and without "www."), though sometimes twice to the same site within 30 minutes. – Rodolfo Mar 5 '13 at 16:51
I m also seeing way too many requests of this type in my error_log on the few servers where I havent blacklisted bingbot already . . . well, one more reason to blacklist this buggy bot – neofutur Mar 13 '13 at 2:57
Is there a directive in robots.txt to tell bingbot where this special sitemap is? (or if there are no such special sitemap) – Joelbitar Mar 13 '13 at 9:48

protected by Community Mar 5 '13 at 0:29

Thank you for your interest in this question. Because it has attracted low-quality or spam answers that had to be removed, posting an answer now requires 10 reputation on this site (the association bonus does not count).

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.