Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I'm getting errors generated by Googlebot while following invalid URLs. Checking with Google Webmaster tools confirmed that the problem was the bot:

enter image description here

I've checked the source code and the HTML generated, but couldn't find out why Googlebot is finding and following this invalid URLs.

How do I troubleshoot the problem?

share|improve this question
add comment

1 Answer

up vote 4 down vote accepted

Have you tried to view your site like a bot would? Xenu's Link Sleuth is a great way to look for bad links and should report links like you have above in its report. That should tell you where your problem lies.

share|improve this answer
    
Great tool. Find the problem (was not in the code, but in the user generated content). Solved! –  Eduardo Molteni Oct 12 '11 at 13:38
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.