Tagged Questions
0
votes
1answer
42 views
Googlebot getting “301 Moved Permanently” according to “Fetch as Googlebot” in Webmaster Tools
I launched a website four days ago, and now when I try to crawl the website like Google bot in "Google webmaster tools" I end up with a response like this:
HTTP/1.1 301 Moved Permanently
Date: Thu, ...
2
votes
1answer
40 views
“Google couldn't access your site because of a server connectivity issue”
In Google Webmaster Tools on my dashboard I have a notice that appeared 2-3 days ago that says "Googlebot can't access your site".
Under the Current Status it has:
DNS - SUCCESS
Server Connectivity ...
2
votes
1answer
37 views
Removing Google Webmaster URL Parameters
Some time before I have created a post for removing full site from Google Index, after following many advices I have removed large number of pages from Google Index but now facing another problem as ...
1
vote
1answer
50 views
Googlebot craw rate is too slow for a huge site
I have a new website with 140k pages, according to my sitemaps.
After submission of my sitemap index to Google, the Googlebot has started crawling the site a couple of hours ago, and at a steady ...
-2
votes
2answers
89 views
How do I prevent duplicate indexing by Googlebot-Mobile?
I have only one version of my web-site, and it is optimised for both the desktop and the smartphone.
I've noticed that Google crawls each page exactly twice: once with Googlebot/2.1, and again with ...
1
vote
2answers
126 views
Google Webmaster Tools complains about missing robots.txt
Nine days ago, I got a message Google Webmaster Tools:
Over the last 24 hours, Googlebot encountered 1 errors while attempting to access your robots.txt.
Well, but I don't have a robots.txt on ...
2
votes
2answers
101 views
How to remove Ever crawled web Pages by Google
I know that we can use noindex, nofollow and robots for excluding the pages from Google Index. This process takes a long long time to clean up website from Google Index. In Webmaster Tools => Index ...
0
votes
2answers
150 views
GWT: reporting crawling errors for non existing links
Google Webmaster Tools is reporting crawl errors for links that never existed, and if i check the "Linked from" tab for a given error link, it shows another that never existed.
They all mention ...
1
vote
2answers
615 views
How to resolve “Google can't find your site's robots.txt” error?
I've recently found that "Google can't find your site's robots.txt" in crawl errors. When I tried Fetching as Google, I got result "SUCCESS", then I tried looking at crawl errors and it still shows ...
3
votes
1answer
387 views
Webmaster Tools show the “Total Indexed” number to be zero
I recently switched my domain from yannbane.blogspot.com to www.yannbane.com, and added my new domain to my Webmaster Tools account. After a few days, I went there and checked the data, and I was a ...
0
votes
0answers
147 views
Mobile Sitemap in Google Webmaster Tools [closed]
I have a problem with my mobile sitemap because google index the urls as web instead of mobile. Why?
You can check the sitemap and one url.
I need your help.
Thanks
1
vote
1answer
482 views
How to determine if Google's Crawl Rate for your site is eating up too much Bandwidth?
I was reading about changing Google's crawl rate and how there is a balance in which if the crawl rate is too fast, it will slow your site down; but if the crawl rate is too slow, then page ...
1
vote
2answers
215 views
sitemap and crawler
I am still newbie in the entire world of SEO. Let's take a look at my example. I have a website very similar to blog style site. There few patterns for urls, all of the are very simple and allowed to ...
1
vote
1answer
3k views
How to fix Google 404 not found Crawl Errors?
I was checking on Google webmater tool for my blog site to see if there's any indication on why my blog traffic decreased to half in one day and i saw 43 Not Found crawl errors and 5 in Sitemap Not ...
1
vote
1answer
524 views
“Restricted by Robots.txt” in Google Webmaster Tools when no robots.txt exists
In Google Webmaster Tools, I have 832 errors in the sitemap with the error being "URL restricted by robots.txt". I don't have a robots.txt file, and the robots meta tag equals "index, follow".
I did ...
4
votes
3answers
549 views
nofollow doesn't stop crawling?
In my website, most of the pages has a linkedin sharing button written in this way:
<li>
<a id="share_linkedin"
...
2
votes
1answer
84 views
Crawl Errors (404) Showing Up in WMT
I see from WMT that my site has 4 (404) crawl errors, each Linked from 2 separate pages. As this is a small directory listings site it would be difficult to delete the missing URLs from the db each ...
2
votes
3answers
297 views
Google Webmaster Tools reporting crawl error 404 (Not found) for a page which has never existed
Google Webmaster Tools is reporting a crawl error "404 (Not Found)" for an .html page which has never existed on a web site I developed. The page being reported is "tyuiabmog.html", which doesn't ...
1
vote
2answers
127 views
google webmastertools will curtom crawl rate affects indexing what are the effects of custom crawl rate
My site was running well for the past three years. Recently googlebot's request my server got increased. and at one time i got network unreachable error. When i contacted my hosting company they asked ...
2
votes
2answers
348 views
Google webmaster Verification failed
I have a site created by Ruby on Rails. I had successfully verified the site with Google Webmaster Tools some months ago. However, recently Webmaster Tools has been asking me to verify my site. I ...
