Googlebot is the bot software that Google uses to crawl over 20 billion pages each day, the data obtained during a crawl is then analyzed and ranked on Google Search.

learn more… | top users | synonyms (1)

0
votes
0answers
13 views

Site's pages hasn't been indexed for more than 10 days, why? [duplicate]

I checked out and robots.txt doesn't block the pages that I've been reviewing. The cached versions of the pages I reviewed in Google are made 10 days ago or more. What could be the cause that a site ...
0
votes
0answers
18 views

Fetch as google: Unreachable Error Message [duplicate]

A few days ago i changed my website CMS from vbulletin to MyBB 1.8.0 and all URLs structure changed, now I've encountering a very strange problem with "Fetch as Google"! Google can fetch my website ...
0
votes
0answers
21 views

Is cloaking your site for disqus comments good for SEO? [duplicate]

I use "disqus" as the commenting platform on my website. There is quite a bit of SEO relevance for the comment content but since its generated through JAVASCRIPT. I can't get the best of it. Can I use ...
0
votes
1answer
20 views

404 code/header for search engines, on removed user content?

I just got an email, from a former user on my website He was complaining that Google still shows the contact page he created on my site, even though he deleted it a month ago This is the first time ...
0
votes
0answers
17 views

Searching for Googlebot in server logs [closed]

I'm trying to use Heorku Logentries to track Googlebot's activity on my server. (Although, I think this could broadly apply to tracking Googlebot activity on any server.) I can see that I have results ...
0
votes
0answers
8 views

Links removed from google search results [duplicate]

For my website www.trickwarehouse.com i have created one post on keyloggers. When i search in google that what are keyloggers? then my website's post position was 16 but after 1 hour, when i checked ...
0
votes
1answer
87 views

google webmaster tools, site maps and indexing, number of pages indexed reduces with no new sitemap

It seems to take two weeks ish to get updates on to the google index, which seems fair enough as I imagine googles index of the whole internet could be rather large. However, the some changes to my ...
0
votes
1answer
140 views

How to get Google to index dynamic pages generated from user IP address

I am creating a local community directory site which identifies the location of the user by IP address and dynamically renders the content related to the specific community identified by the IP ...
0
votes
0answers
43 views

Googlebot can't access my site

For some reason, Google Webmaster Tools started showing all these errors while crawling my site, saying that it couldn't reach my pages. I checked my robots.txt everything checks out, so I'm not sure ...
0
votes
0answers
57 views

How can I stop Googlebot can't access your site messages from a site that's moved to another developer

I had a client who moved their site a while back to another developer. When they moved it they took down the site and put up a coming soon page ( which is currently what's there). Googlebot warned me ...
0
votes
1answer
109 views

Several <a href=“#”>link</a> on one page - Effect on SEO and User Experience?

I've been researching the question if several <a href=“#”>link</a> links on one page have a bad impact on SEO and User Experience, for quite a while now but didn't really come to a ...
0
votes
0answers
11 views

Can google crawl data on googlemap?

I have a web service that includes mainly data on map. Can google fetch these data (asynchronously loaded )? the solution I'm opting right now is to set the data urls in a regular sitemap but there ...
0
votes
0answers
62 views

Why does Google keep hitting only one MP3 file?

I have a bunch of Mp3 files on my site, and all if them are in the sitemap to allow search engines that log mp3 files to know about them. For some reason, every day or two, Google keeps hitting the ...
0
votes
2answers
53 views

Question about external JavaScript and SEO [duplicate]

I have a question about external JavaScript and SEO. Assume I have a site called example.com with and index page of: <html> <body> <div class='main-container'> <script ...
0
votes
0answers
29 views

Sudden decrease in number of pages indexed in Google [duplicate]

One week ago, I updated the sitemap and pinged Google and other search engines to alert them to the change. However, the site now has lost like around 50 indexed pages (yes the site is my personal ...
0
votes
0answers
8 views

Disabling Single Event and 301 Redirect [duplicate]

Is it bad practice to have a 301 redirect for an event that has been disabled or deleted from a system to the list view? or should a 404 page? I dont want Google to ban me or anything.
0
votes
0answers
12 views

How do services that make subsites (ie. new subdomains) get those sites indexed by Google and other search enginex? [duplicate]

Services like tumblr, github pages, quora blogs, etc. make new subdomains when a user signs up or makes a site. So the subdomains are like: blogname.tumblr.com , pagename.github.io, ...
0
votes
1answer
209 views

In addition to Google's First Click Free, should you whitelist search engine bots past a paywall?

Our site has subscription-only pages - non-subscribed visitors see a snippet preview. As per Google's FCF requirements, your first 5 hits to a subscriber-only pages with .google. as the referrer, you ...
0
votes
1answer
120 views

Mobile site redirection and Google crawlers

I have a HTML website where users can select a product (going through categories/subcategories) and then when they choose the product they can customize it in a Flash application. I would like to ...
0
votes
1answer
364 views

How to find first cached date and time of a website?

I found some of my webpage contents has been copied in other website. I need to check the cache date and time of both pages so that i can compare and guess which page is original and which one is ...
0
votes
2answers
426 views

GWT: reporting crawling errors for non existing links

Google Webmaster Tools is reporting crawl errors for links that never existed, and if i check the "Linked from" tab for a given error link, it shows another that never existed. They all mention ...
0
votes
1answer
73 views

How do I get Google to crawl my content when it's only displayed when you fill in a form?

I have a webpage. It has a form and the "results" section is blank. When the user searches for items, and a list that pops up, he/she chooses one option from list and then the corresponding results ...
0
votes
0answers
18 views

Is this Anti-Scraping technique viable with Crawl-Delay? [duplicate]

Possible Duplicate: How do spambots work? I want to prevent web scrapers from abusing 1,000,000 on my website. I'd like to do this by returning a "503 Service Unavailable" error code for ...
-2
votes
2answers
271 views

How do I prevent duplicate indexing by Googlebot-Mobile?

I have only one version of my web-site, and it is optimised for both the desktop and the smartphone. I've noticed that Google crawls each page exactly twice: once with Googlebot/2.1, and again with ...
-3
votes
2answers
149 views

Does Google bot crawl unused tags?

If a website a called foo.com has the following css, #LinkBuilder{ background:url("www.LoremEpsum.com"); } and the css id LinkBuilder is actually not getting used anywhere in the html of foo.com, ...