All web resources crawled by Google bots and recorded in Google databases.
8
votes
3answers
2k views
Does Google cache robots.txt?
I added a robots.txt file to one of my sites a week ago, which should have prevented googlebot from attempting to fetch certain URLs. However, this weekend I can see googlebot loading those exact ...
7
votes
1answer
232 views
home page of my site is not appear in google search, when I type site:example.com
I am totally confused, when I place site:example.com in google I see every page of my website in serp(search engine result page) except the home page. I don’t know why it’s happening but I check ...
6
votes
3answers
156 views
How to stop Google indexing both www. and no-www versions of my website
When I do a search of my site in Google it shows both:
mydomain.com
www.mydomain.com
In my .htaccess file I added code to redirect the non-www version to the www version, but both versions are ...
5
votes
3answers
215 views
Removing full site from Google index
I want to remove the contents from Google index. Google index include my websites huge number of pages indexed in Google index about 5,000,000 Pages earlier but now left pages are 3,025,000.
I have ...
5
votes
1answer
224 views
should I block wordpress archive pages from search engines?
I use WordPress and /sample-post/ URLs for my posts and /yyyy/mm/ for the archives.
Google has indexed the site fully.
Since the archives currently display full posts I've thought that I shouldn't ...
5
votes
4answers
193 views
Total Indexed 0, 99 not selected in webmaster tools
I recently changed domain names from xxx.com to xxx.ca I created all the 301's submitted sitemaps and submitted a change of address to google webmaster tools on Dec 16th. I've since seen urls change ...
5
votes
1answer
189 views
Getting link to abstract indexed in Google Scholar
We have a large digital library with thousands of papers indexed in Google Scholar. We allow Google Scholar to index our PDFs but they're blocked unless you have a subscription. So Google has ...
4
votes
6answers
2k views
Why is Google still not indexing my !# website?
I have been working on a website which uses #! (2minutecv.com), but even after 6 weeks of the site up and running and conforming to the Google hash bang guidelines stated here, you can still see that ...
4
votes
2answers
1k views
SEO - Delete old indexed pages from Google 301 vs 404?
We're launching new website with new url structure and new content. Domain is the same.
Many old pages are indexed by google. Should I use 404 or 301 and redirect to '/' for these old resources? I ...
4
votes
2answers
221 views
After URL rewriting Google still features many of the old and dirty URLs
I did a complete URL rewriting of my site some three months ago, however Google still features many of the old URLs.
They're not dead links as they correctly redirect to the new URLs, but it sort of ...
4
votes
2answers
978 views
Understanding Google Webmasters Tools Sitemaps Information
So, I'm an 'avid' user of google webmaster tools and analytics. I'm building an e-commerce site, all with original product descriptions and a base of 'useful' industry-relevant content. I generated ...
4
votes
1answer
164 views
Google Indexing URL that is a 301 redirect
My website URL structure is:
http://www.website.com/{record-type}/{record-id}/{human-readable-name}
If an invalid human readable name is provided, the page 301 redirects to the correct URL.
I've ...
4
votes
3answers
549 views
nofollow doesn't stop crawling?
In my website, most of the pages has a linkedin sharing button written in this way:
<li>
<a id="share_linkedin"
...
4
votes
1answer
92 views
Discrepancy between Google cached meta description and description in search result
I have developed a 1 page website to deal with time zone world clocks. I have noticed that Google has the latest version of the page in its cache, so it has access to the latest meta description.
...
4
votes
1answer
141 views
In Google Webmaster Tools we have 3 sitemaps attributed to 1 domain
I have a website that has been on the internet for almost 10 years created in "Microsoft FrontPage" with over 900 pages. Currently in Google Webmaster tools it shows up as 2 domains and 3 sitemaps:
...
4
votes
1answer
83 views
Site not showing in google search, and webmaster tools showing irrelevant keywords
In Google Webmaster Tools, for my relatively new website: www.caterboxgroup.co.uk, it says there are 3 keywords: domain, registered and caterboxgroup.
The two first ones do not exist in the pages ...
4
votes
2answers
163 views
cdn.domain.com indexed by Google. The content is being considered as duplicate content
I am running my website with CodeIgniter framework. I have setup cdn using cname cdn.domain.com which is being indexed by Google. And the content of the both domain.com and cdn.domain.com is having ...
3
votes
4answers
1k views
How can I force Google to re-index my site?
I changed the structure of my URLs.
The pages are already indexed by Google and have the following structure:
http://mypage.com/myfolder/page.apsx
The new structure is:
...
3
votes
3answers
190 views
Delay before getting URLs into Google's in web index?
4 days ago, I have submitted a sitemap.xml into Google's WebMaster Tool for a new website. It contains 3 entries. I have tested the site map and Google found not errors.
In about how much time can I ...
3
votes
4answers
118 views
How does Google have more results than I have pages?
Our site has about 6500 pages. These are kept up to date in our sitemap.xml.
When I go to our Google Webmaster Tools account I see that Google has indexed about 6000 of our pages. This seems quite ...
3
votes
3answers
1k views
Google webmaster Index Status. Total Indexed=0
I previously changed my domain from www.visualstudiolearn.blogspot.com to www.visualstudiolearn.com.
I had around 300 posts with the previous domain name and most of them where showing up on Google. ...
3
votes
2answers
190 views
sitemap.xml for huge online store
I'm running online store with 30,000+ products (having unique urls) which are updated every day. I want google to index my products faster. Now crawler index ~500 pages/day (reports from google ...
3
votes
1answer
85 views
How can I force a certain URL for Google to use in search results?
Each page on my site can be accessed by a shortened URL and normal "long" URLs. The shortened URL redirects to the long URL and the long URL includes an optional title that's not parsed (much like on ...
3
votes
1answer
52 views
Google Webmaster Tools Index Status 0 for one year
I've read this topic with answers but they do not address why zero for one year? but other areas in Google Webmaster Tools report 400 URL indexed.
Google Webmaster Tools Index Status
Only 2 Indexed.
...
3
votes
1answer
115 views
Does submitting 'URL and all linked pages' help with new website indexing?
I am aware that sitemaps are one way to provide lists of page URLs to Google bots.
However, Google webmaster allows one to fetch a page as Google and to submit the 'URL and all linked pages'. Does ...
3
votes
2answers
412 views
Google crawling the site but refusing to index dynamic content
I am trying to get Google to index an AJAX site (davidelifestyle.com). It's crawlable with JavaScript turned off and I have also recently implemented _escaped_content_ snapshot mechanism but all ...
3
votes
1answer
405 views
My website google index suddenly increase and also suddenly reduced
Yesterday before i sleep, i check my site index. i get about 50 index on google.
today morning when i wake up, i get 250 index on google. and my page ranking better on several keyword.
than i add 1 ...
3
votes
2answers
68 views
Google Webmaster Tools site removal
I had a major issue in the last week where a site was found to be showing huge numbers of pages that it shouldn't have been. Naturally Google indexed all of these pages!
Rather than manually remove ...
3
votes
1answer
497 views
Google Webmaster Tools Index Status is 0 but sitemap URL shows indexed
I've added my site to Google Webmaster tools www.expresspharmacy.co.uk.
The site was submitted a few weeks ago. The index status shows 0 but it shows 6 URLs have been indexed in the sitemaps section.
...
3
votes
4answers
126 views
Index pages for previous months?
Is there a way on how to find number of index pages for last 2-3 months. If yes, then how??
Please help.
Thanks.
2
votes
2answers
1k views
Why the number of indexed pages got decreased?
Recently I have created a website with hundreds of thousands of unique pages. A week before Google indexed about 250,000 pages but it has decreased to 90k urls today (site:domain.com). What should I ...
2
votes
1answer
37 views
Same page on 2 different websites. Same SEO, but only 1 gets picked up by Google
I made a page for a website (website A) I'm responsible for. I made sure the SEO is correct. This one got to position 1 in Google very fast. On the second website (website B) I copied exactly the same ...
2
votes
3answers
293 views
Google is indexing unintended content that is either unpublished or a secret part of site
Google is indexing parts of my site that I haven't linked to, it's a mobile version of website that I'm working on - www.domain.com/m/ <-- note the M.
How is that even possible? Only thing I can ...
2
votes
2answers
50 views
Google image index
we have a few images currently being indexed by google and we want to remove them from the index. We have removed the .aspx page which linked to the image (but the image still physically exists on ...
2
votes
3answers
967 views
Finding Google's indexed pages
How do I find out how many pages Google has indexed on my website? I know I can just Google site:http://foo.com, but I would like to record the data and not have to do it by hand. Is there an API for ...
2
votes
1answer
23 views
Missing from Google [duplicate]
Recently I noticed our site no longer appeared in Google search results. Our site has be in Google for the last 3 years without any issues.
So far I've check:
In the Web Master tools it says there ...
2
votes
2answers
63 views
google search index what is fresh content
I read that sites have good reputation in google search index if it is fresh content.
what does fresh content means from google's point of view?
I have many pages. I have created articles and ...
2
votes
1answer
79 views
Are the following assumptions about indexing and ranking correct?
Are the following statements true or false:
If a page is crawled by Google, it automatically gets into the index (unless explicitly blocked by robots.txt)
An indexed page always gets a ranking (high ...
2
votes
2answers
78 views
Forbid content in google results summary
I put a professional directory project online since few weeks, Google has started to index some pages but i just noticed a flaw in the design of the pages.
Each page have an adress, some content and ...
2
votes
2answers
72 views
Is there a weight for html link?
I would like to know if there is any weight associated with a html link (its backlink) when google does crawling/indexing. Will 1,2 & 3 be ever considered as a backlink by Google?
1. <a ...
2
votes
1answer
78 views
Lasting discrepancy between the site command and indexed pages in Google Webmaster
I have recently uploaded a blog on blogger. The pages of my blog are accessible for crawling and indexing and I can see that some crawling has started two weeks ago.
I have noticed that the ...
2
votes
1answer
93 views
My site is not recognised by Google [closed]
My site http://www.mcqtoday.com is indexed by google, but even if type the full name of my site in google search it does not show my site. Bing, and Yahoo do it well. There is no crawling error I ...
2
votes
1answer
101 views
Low number of site map links and none of mobile site map links indexed in the google
There 2,521 sitemap URLs submit to the Google webmaster tools.
But they indexed only 548 URLs and 1,256 mobile sitemap URLs were submitted but none of it indexed. This shown in whole last month.
URLs ...
2
votes
2answers
340 views
Why did my Google links disappear after a redesign?
I recently did a complete redesign of my site. As soon as Google picked up the changes (I could tell because the excerpt in the search results was brought up to date), I noticed that my traffic ...
2
votes
1answer
37 views
Removing Google Webmaster URL Parameters
Some time before I have created a post for removing full site from Google Index, after following many advices I have removed large number of pages from Google Index but now facing another problem as ...
2
votes
2answers
150 views
Can Google stop crawling/indexing your site because you are working a lot on it?
I think I read somewhere that Google could stop crawling/indexing a site/blog if there was a lot of work performed on it (like many pages are modified, deleted or loaded daily). It would wait until ...
2
votes
1answer
266 views
How to get google and bing to index original image, not thumbnail?
I've read this post Make google index the actual image not the thumbnail but my case is a little different.
I have over a thousand images, in many different directories, with many different names, ...
2
votes
1answer
122 views
Is making AJAX site crawlable AND degrading gracefully with JS turned off possible?
According to this spec, making AJAX site crawlable by Googlebot means that you have to use hashbang (#!) links in it which means it won't degrade gracefully when JS is turned off. This might mean that ...
2
votes
2answers
113 views
Navigation Category page not indexed by Google
Navigation menu is in the form of categories on website http://bankpo.in, none of the category pages is being indexed by Google.
I searched with exact URL for a category, still related results are ...
1
vote
3answers
222 views
Did Google Delete my index?
I have a website that I haven't had much time to take care of. I updated it 4 times since last October, the contents are all original and informative.
I can see those cache from Way back Machine and ...
