268 reputation
37
bio website infotopie.nl
location Netherlands
age 34
visits member for 1 year, 8 months
seen May 15 at 21:48
stats profile views 15

May
15
awarded  Constituent
May
15
awarded  Caucus
Apr
18
comment Why is BingBot causing so many 404 errors by removing letters from url's?
Nope, it did stop after a while though, but they are still crawling content that has been redirected with a 301 permanent redirect to the new location for over 2 years now. I'm wondering how long I'll have to keep those redirects in place (sigh). Googlebot never crawls these any more. I'm still seeing strange BingBot or MSNbot quirks once in a while.
Sep
14
awarded  Yearling
Aug
9
answered How to inform search engines that my site support multilanguages?
Jul
27
awarded  Constituent
Jul
26
awarded  Caucus
May
25
comment Why is BingBot causing so many 404 errors by removing letters from url's?
Cool! Thanks for that tip. I compared what web-master tools indicated with what site:... says. For Google the numbers were equal (some rounding with site:..) but with bing site:... returns 3 times as many results than Bing's web-master tools indicate??? (still less than Google though) This all still does not explain where the urls missing the last letter come from. Am I the only one seeing this?
May
25
comment Why is BingBot causing so many 404 errors by removing letters from url's?
Yes sure I have (how would I know how many pages were indexed otherwise?) Any way, under Crawl -> Crawl Details they show a few URLs with 404's, which are correct because they have been removed. However the URL's missing the last letter are not listed there at all, and I'm still getting them (between 3 and 6 of them daily).
May
22
comment Why is BingBot causing so many 404 errors by removing letters from url's?
I just checked a few of them, and they are from Microsoft. These for example: 65.52.110.17, 65.52.109.25, 207.46.195.242
May
22
answered What is a good solution for UA testing multiple projects simultaneously?
May
21
asked Why is BingBot causing so many 404 errors by removing letters from url's?
Feb
29
comment Why does BingBot add “ForceRecrawl: 0” to URLs when crawling my sites?
Looks like they corrected the redirect. It also looks like they fixed the problem. The last ForceRecrawl error was on the 24th of november 2011. Before that date I got a few of them daily.
Nov
27
comment Why does BingBot add “ForceRecrawl: 0” to URLs when crawling my sites?
I have not configured any URL normalization in Webmaster tools, so that is not the cause. I'm still getting them, and it is annoying.
Nov
21
awarded  Student
Nov
4
answered Recommendations for an Inquiry request cart/form system
Nov
2
answered Can the webpage title be changed after site has been loaded.
Nov
2
answered Is it possible for web crawlers to see static pages without following a link to them?
Nov
2
awarded  Scholar
Nov
2
accepted Why does BingBot add “ForceRecrawl: 0” to URLs when crawling my sites?