Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I've been optimizing my website for search engines, and for some reason I have a crawl error on a page that has not been found at 'www.peach-designs.com/a' which is not a page, is not a link, or is not anything on my site. I've checked my code and I'm only left to assume that this is a link to a page (a href, etc.).

Is this common for other websites?

share|improve this question

migrated from stackoverflow.com Apr 13 '11 at 13:39

This question came from our site for professional and enthusiast programmers.

2 Answers 2

hi ho googlebot has a pretty broad understanding of what URLs it deems worth crawling. as a matter of fact, if you have any string with a slash (/) somewhere in your HTML or on page javascript, google treats it as an (relative) URL and tries to crawl it.

but hey, if you just have one or two or below half a million of such crawl errors, don't worry. it does not matter. if you have a few million crawl errors because of such strings, well do worry and change the strings.

share|improve this answer

Such crawl errors come when some one else is linking you with wrong urls may be a forum or may when you are generating wrong links by mistake.

Generally I confirm is my mistake or wrongly linked by doing following

1. Just try to search for these link if you can find them in any other sites (That should cover most of your worries).  
2. Check them in your access logs and see if you can get referal urls.

If the number are low or within limits I generally ignore. But do monitor how many such request you get (404's).

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.