The tag has no usage guidance.

learn more… | top users | synonyms

0
votes
2answers
309 views

Redirect pages to fix crawl errors

Google is giving me a crawl error for pages that I have removed like www.mysite.com/mypage.html. I want to redirect this pages to the new page www.mysite.com/mysite/mypage. I tried to do that by ...
0
votes
1answer
148 views

Spiders crawling broken links

Tl:Dr Unknown bot crawling the same broken (HTTP 400) URL over and over again. Different User Agent and different country of origin. The Problem It seems at least once a week we're getting a big ...
2
votes
2answers
962 views

Large increase in 404 hits

We're running a Magento shop and we experienced a significant raise in 404 hits lately, almost 40,000 in one day. Most of the pages are old ones that once existed but don't anymore, and there are some ...
2
votes
3answers
600 views

GWT: Generate more complete crawl error report

I'm a developer in charge of managing Webmasters and related issues (including correcting crawl errors) for dozens (hundreds, maybe?) of active sites and as part of my duties I create a report of ...
2
votes
3answers
1k views

Weird 404 crawl errors in Google webmaster tools

If anyone can help, I'd be very grateful! We're getting strange domains coming up in Google webmaster tools - they seem to be breeding. When I look where the links are coming from, it's either: ...
1
vote
3answers
4k views

Google Webmaster Tools - Crawl errors with 500 status code

I will try to explain the situation: In December 2012 I deployed a website with a sitemap.xml, etc... there were circa 2000 URLs. After a while I changed something on my website, upgrading my pages ...
3
votes
1answer
397 views

SEO impact of server errors

Our website is up and running fine but a WordPress plugin is broken (we can't fix it very quickly) so a few hundred pages show server errors. The pages would load header and page of the page body but ...
4
votes
1answer
345 views

Weird URLs being access by Googlebot

Lately I've been seing all sorts of strange URLs show up as errors in my Webmaster tools account, but they're URLs that don't actually exist on my site, nor are linked from the pages that Google ...
2
votes
3answers
6k views

How to resolve “Google can't find your site's robots.txt” error?

I've recently found that "Google can't find your site's robots.txt" in crawl errors. When I tried Fetching as Google, I got result "SUCCESS", then I tried looking at crawl errors and it still shows ...
3
votes
1answer
426 views

Google Webmasters Tools strange 404 errors referred from same site

Starting about a month ago, I noticed a sudden increase in 404 errors in Webmasters Tools for one of my sites (over 1400 errors so far). All the errors are being referred from my own site to non ...
3
votes
2answers
128 views

Yandex frequently replaces page names with ampersands

The Yandex spider is a frequent visitor to one of the sites I manage. On occasion it replaces the page name with two ampersands and a space. So if the page is: /mypage.aspx?param=value then it ...
6
votes
1answer
1k views

How does Google Rank “Priority” for “Not Found” errors?

Google lists Not Found Errors in Webmaster Tools as Ranked by Priority, but what is Priority based on?
0
votes
1answer
91 views

Submitting a sitemap to take care of inherited Google crawler errors

I have an awful lot of Google Crawler errors (1000 or so) after I inherited a site that the previous owner migrated without moving much of their content. Would generating a map of the current site ...
2
votes
3answers
131 views

Can server errors cause major traffic drop from Google?

My web server was down for about 30 min. The next day (30~ hours from the event) I noticed major drop in traffic from Google. The normal traffic to my site is about 2500 unique/day and after the event ...
0
votes
3answers
165 views

Free standalone crawlers

Are there any free standalone crawlers that I can use apart from Google webmaster to analyze errors? Something that shows me all 404's, errors etc
2
votes
1answer
499 views

Google Webmaster Tools is reporting crawl errors for links that don't exist

In Google webmaster tools > diagnostics > crawl errors I'm seeing a bunch of errors that link to sub-pages like /tour/overview/Scripts/ForceDownload.asp The /tour/overview does exist, but this ...
2
votes
2answers
887 views

How does Google treat unlinked URLs?

In Google Webmaster Tools I've recently noticed several concatenated URLs appearing in the Crawl Errors. On investigation it seems Google is picking up these links from a page that shows a user's ...
3
votes
3answers
104 views

Crawl errors “src” in the last in URL

I was looking in the Google Webmaster Tools and realized the following crawl error: Pages that link to http://mysite.com/articles/my-stub/src/ URL: http://mysite.com/articles/my-stub I wonder ...
2
votes
2answers
170 views

Will setting a custom crawl rate in Google Webmaster Tools affects index or have other negative consequences?

My site was running well for the past three years. Recently Googlebot's request my server got increased. and at one time I got network unreachable error. When I contacted my hosting company they asked ...
3
votes
2answers
79 views

How to set crawl rate in Google Webmaster Tools for seven days or a month?

My web host is blocking IPs which make many requests. This includes Googlebot. I found this by checking my webmaster tools account. There it said "network unreachable" for all the URLs which are ...
2
votes
2answers
347 views

Googlebot requesting invalid URL

I have a web app which emails me exceptions automatically. This morning there was an error relating to a url: /Catalog/LiveCatalog?id=ylwpfqzts id is invalid (should be a guid) and caused an error ...