Tagged Questions
1
vote
1answer
48 views
Googlebot craw rate is too slow for a huge site
I have a new website with 140k pages, according to my sitemaps.
After submission of my sitemap index to Google, the Googlebot has started crawling the site a couple of hours ago, and at a steady ...
0
votes
2answers
130 views
Fake Links Cause Crawl Error In Google Webmaster Tools
Google reported Crawl Errors last week on my largest site though Webmaster Tools. Here is the message:
Google detected a significant increase in the number of URLs that
return a 404 (Page ...
2
votes
2answers
100 views
How to remove Ever crawled web Pages by Google
I know that we can use noindex, nofollow and robots for excluding the pages from Google Index. This process takes a long long time to clean up website from Google Index. In Webmaster Tools => Index ...
0
votes
2answers
148 views
GWT: reporting crawling errors for non existing links
Google Webmaster Tools is reporting crawl errors for links that never existed, and if i check the "Linked from" tab for a given error link, it shows another that never existed.
They all mention ...
1
vote
2answers
269 views
Google Webmaster Tools - Crawl errors with 500 status code
I will try to explain the situation:
In December 2012 I deployed a website with a sitemap.xml, etc... there were circa 2000 URLs.
After a while I changed something on my website, upgrading my pages ...
5
votes
4answers
192 views
Total Indexed 0, 99 not selected in webmaster tools
I recently changed domain names from xxx.com to xxx.ca I created all the 301's submitted sitemaps and submitted a change of address to google webmaster tools on Dec 16th. I've since seen urls change ...
3
votes
1answer
103 views
How to get rid of crawling errors due to the URL Encoded Slashes (%2F) problem in Apache
The Google web crawler has indexed a whole set of URLs with encoded slashes (%2F) for our site. I assume it has picked up the pages from our XML sitemap file. The problem is that the live pages will ...
3
votes
1answer
121 views
webmaster tools 500 crawl error for asp faceted navigation that does not exist
I am getting around 2,500 type 500 URL errors in Google webmaster tools. These pages are faceted navigation results that can not be reached by a site visitor. These pages do not exist. We are using ...
0
votes
0answers
147 views
Mobile Sitemap in Google Webmaster Tools [closed]
I have a problem with my mobile sitemap because google index the urls as web instead of mobile. Why?
You can check the sitemap and one url.
I need your help.
Thanks
1
vote
1answer
481 views
How to determine if Google's Crawl Rate for your site is eating up too much Bandwidth?
I was reading about changing Google's crawl rate and how there is a balance in which if the crawl rate is too fast, it will slow your site down; but if the crawl rate is too slow, then page ...
3
votes
1answer
283 views
How to interpret number of URL errors in Google webmaster tools
Recently Google has made some changes to Webmaster tools which are explained below:
http://googlewebmastercentral.blogspot.com/2012/03/crawl-errors-next-generation.html
One thing I could not find out ...
0
votes
1answer
826 views
404 Errors Showing in Google Webmaster Tools
My Google Webmaster Tools Account, Shows that I have crawling errors that are caused by links to pages that do not exist (404 not found).
But when I look at the source pages that are accused of ...
2
votes
1answer
136 views
What's the extent of the “damage” to having a broken URL found by the spiders (showing in Google Webmaster Tools)?
An error with our URL rewrite rules caused some pages to be not found (404 errors) when Google crawled our site.
I regularly watch for errors and fix database or coding issues when they arise. We ...
