Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I'm getting errors generated by Googlebot while following invalid URLs. Checking with Google Webmaster tools confirmed that the problem was the bot:

enter image description here

I've checked the source code and the HTML generated, but couldn't find out why Googlebot is finding and following this invalid URLs.

How do I troubleshoot the problem?

share|improve this question
up vote 4 down vote accepted

Have you tried to view your site like a bot would? Xenu's Link Sleuth is a great way to look for bad links and should report links like you have above in its report. That should tell you where your problem lies.

share|improve this answer
Great tool. Find the problem (was not in the code, but in the user generated content). Solved! – Eduardo Molteni Oct 12 '11 at 13:38

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.