Tagged Questions
0
votes
1answer
28 views
Problem with Google crawler and cached results
I have a client that has 3 domain names. For the sake of this argument I will call them www.website1.com www.website2.com and www.website3.com
He used to have a website package with VistaPrint and ...
0
votes
1answer
57 views
Googlebot getting “301 Moved Permanently” according to “Fetch as Googlebot” in Webmaster Tools
I launched a website four days ago, and now when I try to crawl the website like Google bot in "Google webmaster tools" I end up with a response like this:
HTTP/1.1 301 Moved Permanently
Date: Thu, ...
2
votes
1answer
78 views
“Google couldn't access your site because of a server connectivity issue”
In Google Webmaster Tools on my dashboard I have a notice that appeared 2-3 days ago that says "Googlebot can't access your site".
Under the Current Status it has:
DNS - SUCCESS
Server Connectivity ...
2
votes
1answer
51 views
Removing Google Webmaster URL Parameters
Some time before I have created a post for removing full site from Google Index, after following many advices I have removed large number of pages from Google Index but now facing another problem as ...
1
vote
1answer
72 views
Googlebot craw rate is too slow for a huge site
I have a new website with 140k pages, according to my sitemaps.
After submission of my sitemap index to Google, the Googlebot has started crawling the site a couple of hours ago, and at a steady ...
-2
votes
2answers
114 views
How do I prevent duplicate indexing by Googlebot-Mobile?
I have only one version of my web-site, and it is optimised for both the desktop and the smartphone.
I've noticed that Google crawls each page exactly twice: once with Googlebot/2.1, and again with ...
1
vote
2answers
164 views
Google Webmaster Tools complains about missing robots.txt
Nine days ago, I got a message Google Webmaster Tools:
Over the last 24 hours, Googlebot encountered 1 errors while attempting to access your robots.txt.
Well, but I don't have a robots.txt on ...
2
votes
2answers
112 views
How to remove Ever crawled web Pages by Google
I know that we can use noindex, nofollow and robots for excluding the pages from Google Index. This process takes a long long time to clean up website from Google Index. In Webmaster Tools => Index ...
0
votes
2answers
166 views
GWT: reporting crawling errors for non existing links
Google Webmaster Tools is reporting crawl errors for links that never existed, and if i check the "Linked from" tab for a given error link, it shows another that never existed.
They all mention ...
1
vote
2answers
845 views
How to resolve “Google can't find your site's robots.txt” error?
I've recently found that "Google can't find your site's robots.txt" in crawl errors. When I tried Fetching as Google, I got result "SUCCESS", then I tried looking at crawl errors and it still shows ...
3
votes
1answer
389 views
Webmaster Tools show the “Total Indexed” number to be zero
I recently switched my domain from yannbane.blogspot.com to www.yannbane.com, and added my new domain to my Webmaster Tools account. After a few days, I went there and checked the data, and I was a ...
0
votes
0answers
148 views
Mobile Sitemap in Google Webmaster Tools [closed]
I have a problem with my mobile sitemap because google index the urls as web instead of mobile. Why?
You can check the sitemap and one url.
I need your help.
Thanks
1
vote
1answer
490 views
How to determine if Google's Crawl Rate for your site is eating up too much Bandwidth?
I was reading about changing Google's crawl rate and how there is a balance in which if the crawl rate is too fast, it will slow your site down; but if the crawl rate is too slow, then page ...
1
vote
2answers
219 views
sitemap and crawler
I am still newbie in the entire world of SEO. Let's take a look at my example. I have a website very similar to blog style site. There few patterns for urls, all of the are very simple and allowed to ...
1
vote
1answer
3k views
How to fix Google 404 not found Crawl Errors?
I was checking on Google webmater tool for my blog site to see if there's any indication on why my blog traffic decreased to half in one day and i saw 43 Not Found crawl errors and 5 in Sitemap Not ...
1
vote
1answer
543 views
“Restricted by Robots.txt” in Google Webmaster Tools when no robots.txt exists
In Google Webmaster Tools, I have 832 errors in the sitemap with the error being "URL restricted by robots.txt". I don't have a robots.txt file, and the robots meta tag equals "index, follow".
I did ...
4
votes
3answers
597 views
nofollow doesn't stop crawling?
In my website, most of the pages has a linkedin sharing button written in this way:
<li>
<a id="share_linkedin"
...
2
votes
1answer
86 views
Crawl Errors (404) Showing Up in WMT
I see from WMT that my site has 4 (404) crawl errors, each Linked from 2 separate pages. As this is a small directory listings site it would be difficult to delete the missing URLs from the db each ...
2
votes
3answers
304 views
Google Webmaster Tools reporting crawl error 404 (Not found) for a page which has never existed
Google Webmaster Tools is reporting a crawl error "404 (Not Found)" for an .html page which has never existed on a web site I developed. The page being reported is "tyuiabmog.html", which doesn't ...
1
vote
2answers
130 views
google webmastertools will curtom crawl rate affects indexing what are the effects of custom crawl rate
My site was running well for the past three years. Recently googlebot's request my server got increased. and at one time i got network unreachable error. When i contacted my hosting company they asked ...
2
votes
2answers
365 views
Google webmaster Verification failed
I have a site created by Ruby on Rails. I had successfully verified the site with Google Webmaster Tools some months ago. However, recently Webmaster Tools has been asking me to verify my site. I ...
