The tag has no usage guidance.

learn more… | top users | synonyms

0
votes
1answer
116 views

How can I create a sitemap for 2000 products powered by a single php page?

Usually I generate sitemaps using www.xml-sitemaps.com and the limit is 500 pages. My website has barely 30, but I have a lot of products in my database, so the page product.php becomes ...
1
vote
3answers
742 views

Too many “access denied” errors showing in Google Webmaster Tools

I get 18,000 "access denied" errors showing in Google Webmaster Tools every day! It's strange that it shows for URL's with www but not for those without it (i.e., just domain.com instead of ...
0
votes
1answer
81 views

What is the difference between not found and not followed in Google Webmaster Tools?

In Google Webmaster Tools under Crawl Errors I found 18 Not Found and 16 Not Followed errors. What does this mean, and what is the difference between them?
2
votes
3answers
291 views

Google Webmaster Tools keeps reporting not finding pages from the old website

About 3 months ago we've completely replaced the content of our domain, practically building up a new website. The sitemap for the new website has been submited to Google Webmaster Tools, the website ...
0
votes
1answer
826 views

404 errors How to deal with a large number of broken internal links for SEO

I have recently updated my website. In fact I have completely rewritten it using wordpress. It was originally constructed using ASP. In the process, I have recycled a a large amount of my original ...
0
votes
2answers
315 views

Redirect pages to fix crawl errors

Google is giving me a crawl error for pages that I have removed like www.mysite.com/mypage.html. I want to redirect this pages to the new page www.mysite.com/mysite/mypage. I tried to do that by ...
0
votes
1answer
152 views

Spiders crawling broken links

Tl:Dr Unknown bot crawling the same broken (HTTP 400) URL over and over again. Different User Agent and different country of origin. The Problem It seems at least once a week we're getting a big ...
2
votes
2answers
1k views

Large increase in 404 hits

We're running a Magento shop and we experienced a significant raise in 404 hits lately, almost 40,000 in one day. Most of the pages are old ones that once existed but don't anymore, and there are some ...
2
votes
3answers
618 views

GWT: Generate more complete crawl error report

I'm a developer in charge of managing Webmasters and related issues (including correcting crawl errors) for dozens (hundreds, maybe?) of active sites and as part of my duties I create a report of ...
2
votes
3answers
1k views

Weird 404 crawl errors in Google webmaster tools

If anyone can help, I'd be very grateful! We're getting strange domains coming up in Google webmaster tools - they seem to be breeding. When I look where the links are coming from, it's either: ...
1
vote
3answers
5k views

Google Webmaster Tools - Crawl errors with 500 status code

I will try to explain the situation: In December 2012 I deployed a website with a sitemap.xml, etc... there were circa 2000 URLs. After a while I changed something on my website, upgrading my pages ...
3
votes
1answer
409 views

SEO impact of server errors

Our website is up and running fine but a WordPress plugin is broken (we can't fix it very quickly) so a few hundred pages show server errors. The pages would load header and page of the page body but ...
4
votes
1answer
354 views

Weird URLs being access by Googlebot

Lately I've been seing all sorts of strange URLs show up as errors in my Webmaster tools account, but they're URLs that don't actually exist on my site, nor are linked from the pages that Google ...
2
votes
3answers
6k views

How to resolve “Google can't find your site's robots.txt” error?

I've recently found that "Google can't find your site's robots.txt" in crawl errors. When I tried Fetching as Google, I got result "SUCCESS", then I tried looking at crawl errors and it still shows ...
3
votes
1answer
450 views

Google Webmasters Tools strange 404 errors referred from same site

Starting about a month ago, I noticed a sudden increase in 404 errors in Webmasters Tools for one of my sites (over 1400 errors so far). All the errors are being referred from my own site to non ...
3
votes
2answers
129 views

Yandex frequently replaces page names with ampersands

The Yandex spider is a frequent visitor to one of the sites I manage. On occasion it replaces the page name with two ampersands and a space. So if the page is: /mypage.aspx?param=value then it ...
6
votes
1answer
1k views

How does Google Rank “Priority” for “Not Found” errors?

Google lists Not Found Errors in Webmaster Tools as Ranked by Priority, but what is Priority based on?
0
votes
1answer
91 views

Submitting a sitemap to take care of inherited Google crawler errors

I have an awful lot of Google Crawler errors (1000 or so) after I inherited a site that the previous owner migrated without moving much of their content. Would generating a map of the current site ...
2
votes
3answers
132 views

Can server errors cause major traffic drop from Google?

My web server was down for about 30 min. The next day (30~ hours from the event) I noticed major drop in traffic from Google. The normal traffic to my site is about 2500 unique/day and after the event ...
0
votes
3answers
207 views

Free standalone crawlers

Are there any free standalone crawlers that I can use apart from Google webmaster to analyze errors? Something that shows me all 404's, errors etc
2
votes
1answer
518 views

Google Webmaster Tools is reporting crawl errors for links that don't exist

In Google webmaster tools > diagnostics > crawl errors I'm seeing a bunch of errors that link to sub-pages like /tour/overview/Scripts/ForceDownload.asp The /tour/overview does exist, but this ...
2
votes
2answers
900 views

How does Google treat unlinked URLs?

In Google Webmaster Tools I've recently noticed several concatenated URLs appearing in the Crawl Errors. On investigation it seems Google is picking up these links from a page that shows a user's ...
3
votes
3answers
105 views

Crawl errors “src” in the last in URL

I was looking in the Google Webmaster Tools and realized the following crawl error: Pages that link to http://mysite.com/articles/my-stub/src/ URL: http://mysite.com/articles/my-stub I wonder ...
2
votes
2answers
176 views

Will setting a custom crawl rate in Google Webmaster Tools affects index or have other negative consequences?

My site was running well for the past three years. Recently Googlebot's request my server got increased. and at one time I got network unreachable error. When I contacted my hosting company they asked ...
3
votes
2answers
81 views

How to set crawl rate in Google Webmaster Tools for seven days or a month?

My web host is blocking IPs which make many requests. This includes Googlebot. I found this by checking my webmaster tools account. There it said "network unreachable" for all the URLs which are ...
2
votes
2answers
360 views

Googlebot requesting invalid URL

I have a web app which emails me exceptions automatically. This morning there was an error relating to a url: /Catalog/LiveCatalog?id=ylwpfqzts id is invalid (should be a guid) and caused an error ...