Googlebot is the bot software that Google uses to crawl over 20 billion pages each day, the data obtained during a crawl is then analyzed and ranked on Google Search.

learn more… | top users | synonyms (1)

0
votes
1answer
84 views

How do I find when Googlebot will visit(crawl) my pages again?

I implemented the unavailable_after tag in my pages like the below and set to unavailable after 3 days but in Google Webmaster Tools I got 404 for that page. <META NAME="GOOGLEBOT" ...
0
votes
1answer
87 views

Is it safe to manipulate with DOM (using JavaScript) to move up in the search results?

I have some text written for SEO purposes and it is located right after the opening body tag, so it is at the top of the page. That doesn't look great so this text is moved to the bottom of the page ...
0
votes
1answer
74 views

Problem with Google crawler and cached results

I have a client that has 3 domain names. For the sake of this argument I will call them www.website1.com, www.website2.com and www.website3.com. He used to have a website package with VistaPrint and ...
0
votes
1answer
71 views

Why did the Googlebot add “sp=1” to my URL's?

Googlebot crawled my site for the first time today, and added something strange. It appended &sp=1 to my URL's. It seems like it's trying to gain authorized access? Normally I have ...
0
votes
2answers
145 views

Hide elements for Google

I have some elements which I don't want Google to see. Usually repetitive content, e.g. header and sidebar. As Googlebot doesn't handle AJAX requests, I load these resources with AJAX and insert them ...
0
votes
2answers
129 views

Anyone heard of 'tank tracking'?

Someone I know told me about some seriously cutting edge blackhat SEO that he called 'tank tracking'. He said that it is some sort of code (he believes written in Python) that 'sits' around the ...
0
votes
1answer
234 views

Google AdSense bot's algorithm and behavior [closed]

I am interesting in Google AdSense bot's algorithm and behavior with web site. I did not work with AdSense and I do not have account. So I need your help to understand: 1) Google's bot from time to ...
0
votes
1answer
40 views

SEO: does Google index search result pages?

I have a site with a search form. When someone searches, the url for the results page has PHP variables in it and looks like: ...
0
votes
1answer
39 views

Can Googlebot read CamelCase file names?

This has been a question I have been wondering for quite some time now. Can Googlebot, and other search engine crawlers, read file names (such as images) that are in CamelCase? For example, if I ...
0
votes
1answer
36 views

How to see my site's problems with Google?

I recently made a website: Boun Schedule Planner, which aims for the search query "Boun Schedule Planner" It was like 5th or 6th for a few days. But now it's not even in the first 3 pages. There are ...
0
votes
1answer
67 views

Remove Lots of index pages from google bot from same directory.

My question is about Google bot, seo and webmaster. may be this is not right place for ask, but if person not know so where he place his question he doesn't know!!! If you know my question's answer ...
0
votes
1answer
201 views

Will using page headings (h1, h2, h3 etc) as internal links encourage Google sitelinks? [duplicate]

I am trying to change my site's page headings to better emphasize the structure of the page's content hierarchy. I am hoping this will encourage Google Sitelinks and list snippets. Current headings ...
0
votes
1answer
35 views

Why does my htm pages have a number attached at the end of the link?

When I wanted to fetch a certain page with htm extension I noticed an attachment after the htm extenstion http://www.example.com/IP_814.htm#.Uk1_MtKsh8E Google could not fetch this page it gave the ...
0
votes
1answer
99 views

Need Google to recrawl the pages

I've changed the meta description tag in many of my site pages. Should I select Fetch as Google->Fetch->Add to Index->URL and all linked pages in GWT? Will Google recrawl the whole site faster than ...
0
votes
2answers
169 views

Does Submit to Index on a page with new content update Content Keywords for the site?

Using Google Webmaster Tools I'm trying to update the Content Keywords of my site. I'm confused about the relationship between Submit to Index and Content Keywords Does Fetch as Google --> Submit to ...
0
votes
2answers
2k views

How long does it take for Google to remove page from index? Or, why aren't these pages excluded?

A set of pages are marked as noindex and nofollow, both in robots.txt and with X-Robots-Tag: noindex, nofollow When checking with Google Webmaster Tools, the pages are reported as "Denied by ...
0
votes
2answers
91 views

Google not crawling my website [duplicate]

I own a website http://citrusbug.com. We did not have proper content before so to prevent search engine from crawling our site we added a robots.txt with code to prevent crawling. Now we had ...
0
votes
1answer
80 views

How can I create a sitemap for 2000 products powered by a single php page?

Usually I generate sitemaps using www.xml-sitemaps.com and the limit is 500 pages. My website has barely 30, but I have a lot of products in my database, so the page product.php becomes ...
0
votes
1answer
55 views

How does Google crawler find pages?

Will Google crawler find a page that is not linked to? I.e. pages accessible by manually modifying the url, like http://www.site.com/node/1/[secret keyword]. Note that it is only secret in that there ...
0
votes
1answer
65 views

What time does Googlebot crawl sites

Daily evening I sync the localhost copy of website to the production one. Yesterday I could not do it and I did so today at 10:00 am. Common sense says that Googlebot should be crawling the site when ...
0
votes
1answer
30 views

How do search engines treat out-tracked links

Some websites have out tracking / outgoing click tracking so that when you click on a link such as mysite.com on example.com you momentarily get taken to example.com/outgoing/mysite.com which then ...
0
votes
2answers
102 views

Googlebot ignore my new site [duplicate]

I have the following situation: I had a blog (made using Joomla) that in some month was pretty indexed by Google. For some technical problem I have delete it and I have newly created using WordPress ...
0
votes
4answers
247 views

Hide your website links from search engne

My Website Link is posted in someone else website, i asked for removal but can't get reply, google crawl his website and my website link is posted on that how to control that is that is possible? i ...
0
votes
2answers
566 views

When using Mod_rewrite does google bot see the original url or the rewritten url?

If i use the bellow code in my .htacess file would google bot (or any other search spiders) see the example.tumblr.com url or would they see the same url as the user ie. example.co.uk/blog ? ...
0
votes
1answer
393 views

How does Google feel about overflow: auto?

I am planning to add some keyword rich text to my homepage at the very top. I have written almost a mini essay and putting all this text at the very top left of my page wouldn't look too nice. I was ...
0
votes
1answer
98 views

Specifying crawlers to not crawl Links which are dependent on external API's

I have links on my site which lead to internal pages that depend on first bringing data from an external API. This only takes time the first time they are pushed. Links to pages which exists in the ...
0
votes
1answer
26 views

When Google gives up recrawling 301 that led to 404?

I've transferred a domain and made a mistake in the redirects (the URL structure is identical). Even though they went to the new domain, the error caused a 404 when crawled by Google bot. 10 days ...
0
votes
1answer
18 views

404 code/header for search engines, on removed user content?

I just got an email, from a former user on my website He was complaining that Google still shows the contact page he created on my site, even though he deleted it a month ago This is the first time ...
0
votes
0answers
20 views

Google Webmaster Tools crawl errors due to Google decoding links that were urlencoded by Codeigniter

In our pages we have internal links that are urlencoded because the URL may sometime contain special characters such as () or ! So in our source code we have a link: ...
0
votes
0answers
18 views

Confused about logfiles with googlebot

Im still in the process of making my site crawlable through google even though its all AJAX content. So I got it where if the URL contains 'escaped_fragment_ it retrieves the right information form ...
0
votes
0answers
15 views

Searching for Googlebot in server logs [closed]

I'm trying to use Heorku Logentries to track Googlebot's activity on my server. (Although, I think this could broadly apply to tracking Googlebot activity on any server.) I can see that I have results ...
0
votes
0answers
7 views

Links removed from google search results [duplicate]

For my website www.trickwarehouse.com i have created one post on keyloggers. When i search in google that what are keyloggers? then my website's post position was 16 but after 1 hour, when i checked ...
0
votes
1answer
50 views

google webmaster tools, site maps and indexing, number of pages indexed reduces with no new sitemap

It seems to take two weeks ish to get updates on to the google index, which seems fair enough as I imagine googles index of the whole internet could be rather large. However, the some changes to my ...
0
votes
1answer
82 views

Is it a problem for Google if robots.txt blocks URLs in the sitemap?

I had submitted my site's URL to Google Webmaster Tools. I am using OpenCart. I also have robots.txt file which is accessible to Googlebot. Now issue I am facing: Googlebot is blocked from accessing ...
0
votes
1answer
84 views

How to get Google to index dynamic pages generated from user IP address

I am creating a local community directory site which identifies the location of the user by IP address and dynamically renders the content related to the specific community identified by the IP ...
0
votes
0answers
42 views

Googlebot can't access my site

For some reason, Google Webmaster Tools started showing all these errors while crawling my site, saying that it couldn't reach my pages. I checked my robots.txt everything checks out, so I'm not sure ...
0
votes
0answers
44 views

How can I stop Googlebot can't access your site messages from a site that's moved to another developer

I had a client who moved their site a while back to another developer. When they moved it they took down the site and put up a coming soon page ( which is currently what's there). Googlebot warned me ...
0
votes
1answer
95 views

Several <a href=“#”>link</a> on one page - Effect on SEO and User Experience?

I've been researching the question if several <a href=“#”>link</a> links on one page have a bad impact on SEO and User Experience, for quite a while now but didn't really come to a ...
0
votes
0answers
11 views

Can google crawl data on googlemap?

I have a web service that includes mainly data on map. Can google fetch these data (asynchronously loaded )? the solution I'm opting right now is to set the data urls in a regular sitemap but there ...
0
votes
0answers
51 views

Why does Google keep hitting only one MP3 file?

I have a bunch of Mp3 files on my site, and all if them are in the sitemap to allow search engines that log mp3 files to know about them. For some reason, every day or two, Google keeps hitting the ...
0
votes
2answers
50 views

Question about external JavaScript and SEO [duplicate]

I have a question about external JavaScript and SEO. Assume I have a site called example.com with and index page of: <html> <body> <div class='main-container'> <script ...
0
votes
0answers
29 views

Sudden decrease in number of pages indexed in Google [duplicate]

One week ago, I updated the sitemap and pinged Google and other search engines to alert them to the change. However, the site now has lost like around 50 indexed pages (yes the site is my personal ...
0
votes
0answers
8 views

Disabling Single Event and 301 Redirect [duplicate]

Is it bad practice to have a 301 redirect for an event that has been disabled or deleted from a system to the list view? or should a 404 page? I dont want Google to ban me or anything.
0
votes
0answers
12 views

How do services that make subsites (ie. new subdomains) get those sites indexed by Google and other search enginex? [duplicate]

Services like tumblr, github pages, quora blogs, etc. make new subdomains when a user signs up or makes a site. So the subdomains are like: blogname.tumblr.com , pagename.github.io, ...
0
votes
1answer
166 views

In addition to Google's First Click Free, should you whitelist search engine bots past a paywall?

Our site has subscription-only pages - non-subscribed visitors see a snippet preview. As per Google's FCF requirements, your first 5 hits to a subscriber-only pages with .google. as the referrer, you ...
0
votes
0answers
10 views

What effects that new content shows on Google right away? [duplicate]

When I post a question or content on some websites (for example StackOverFlow is a great example) and then when I search on Google for same content, I can see my question/content on search results in ...
0
votes
0answers
9 views

SEO: backlinks from the same IP [duplicate]

I searched on Google, and here, and I haven't found an answer. Does Google consider inlinks from different sites, hosted on the same IP server? I have five different sites on the same server (same ...
0
votes
1answer
116 views

Mobile site redirection and Google crawlers

I have a HTML website where users can select a product (going through categories/subcategories) and then when they choose the product they can customize it in a Flash application. I would like to ...
0
votes
1answer
277 views

How to find first cached date and time of a website?

I found some of my webpage contents has been copied in other website. I need to check the cache date and time of both pages so that i can compare and guess which page is original and which one is ...
0
votes
2answers
387 views

GWT: reporting crawling errors for non existing links

Google Webmaster Tools is reporting crawl errors for links that never existed, and if i check the "Linked from" tab for a given error link, it shows another that never existed. They all mention ...