We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [google-index]

All web resources crawled by Google bots and recorded in Google databases.

Filter by
Sorted by
Tagged with
36
votes
5answers
3k views

Why isn't my website in Google search results? [duplicate]

It's been sometime and Google has yet to index my site. How can I get Google to index my website?
17
votes
2answers
15k views

Google Webmaster Tools Index Status is 0 but sitemap URL shows indexed

I've added my site to Google Webmaster Tools. The site was submitted a few weeks ago. The index status shows 0 but it shows 6 URLs have been indexed in the sitemaps section. If I search in Google I ...
17
votes
4answers
19k views

What can cause “Discovered - currently not indexed” in the new GWT

The new GWT shows sitemaps links divided into new categories. Two that confuse me: 1. Discovered- currently not indexed 2. Crawled - currently not indexed What are the possible reasons for this, and ...
16
votes
3answers
23k views

How do I find when an URL was first indexed by Google?

How do I find out when a particular URL was first indexed by Google? I'd prefer a solution that works even for competitors' URLs that are not owned by me.
15
votes
2answers
2k views

How to tell how old a page is?

I thought Google was more or less accurate at determining who posted a text first and who copied. However, when I use the "search tool: customized interval" the results are quite odd. I've found pages ...
14
votes
1answer
1k views

Why are these sites cloning my content, and how do I stop them?

So I was searching for one of my own websites on Google: http://www.botlibre.com and to my surprise found some clones of my website, like: http://83waystowasteyourtime.adidas.com and: http:// ...
13
votes
3answers
4k views

Number of indexed pages with “site:” search less than reported in Google Webmaster Tools

In Google webmaster tools it shows that I have 309 pages indexed, but when I search using "site:site.com" appear about 180 only (On the first page appears "about 608 results," something near the total ...
9
votes
1answer
4k views

Should I block Wordpress archive pages from search engines?

I use WordPress and /sample-post/ URLs for my posts and /yyyy/mm/ for the archives. Google has indexed the site fully. Since the archives currently display full posts I've thought that I shouldn't ...
8
votes
4answers
17k views

How to stop certain urls from being indexed

When I type site:example.com(using my domain obviously), I get several link errors showing up in the listing. Typically, they are of the form: /some/fixed/path/admin/unblockUser/11 I am thinking of ...
8
votes
6answers
6k views

Remove HTTPS site from Google search index because users are getting a certificate error

We have a busy website where we never used SSL. Recently its indexed by Google as https://www.example.com. The users are getting security certificate errors. In google webmaster tools we can only ...
8
votes
3answers
708 views

Dev site indexed by Google

I was developing a new version of our site on a subdomain (dev.oursite.com) and the robots.txt with the Disallow got replaced at some point, so the site got indexed by Google and other search engines. ...
7
votes
3answers
3k views

Removing full site from Google index

I want to remove the contents from Google index. Google index include my websites huge number of pages indexed in Google index about 5,000,000 pages earlier but now left pages are 3,025,000. I have ...
7
votes
1answer
428 views

home page of my site is not appear in google search, when I type site:example.com

I am totally confused, when I place site:example.com in google I see every page of my website in serp(search engine result page) except the home page. I don’t know why it’s happening but I check ...
7
votes
1answer
1k views

Index status shows significantly less pages than search results? *Not a New Site

I am trying to understand how within Google Webmaster Tools (Google Index>Index Status) I can have a figure of 2,000 total indexed pages (and falling daily) yet when I search Google using the (site:) ...
6
votes
6answers
6k views

Why is Google still not indexing my !# website?

I have been working on a website which uses #! (2minutecv.com), but even after 6 weeks of the site up and running and conforming to the Google hash bang guidelines stated here, you can still see that ...
6
votes
5answers
6k views

Huge drop off in Google “indexed” pages after switching to HTTPS, should I switch back to HTTP?

I did a full redesign of my website to make it responsive (bootstrap), added localization, and also switched the whole website to use HTTPS. My website use to default to http://www.domain.com/ and ...
6
votes
2answers
4k views

Does Google index #! (hash bang) URLs?

Just got confused with some blogs as everyone is sure that Google will not index the hash (#) URL but not sure about hash bang (#!) URL. I have seen a "deprecated" doc on Google regarding this, where ...
6
votes
2answers
6k views

Why the number of indexed pages decreased for a “site:” search

Recently I created a website with hundreds of thousands of unique pages. A week ago, Google had indexed about 250,000 pages. It has now decreased to 90k URLs (using a site:domain.com query). What ...
6
votes
3answers
31k views

Remove subdomains from Google index and stop indexing them

I am running static content through a CDN, cdn1-cdn5 I am using such subdomains for that. I am loading just images, CSS and JS files this way, but apparently Google has indexed some pages on ...
6
votes
3answers
2k views

How to stop Google indexing both www. and no-www versions of my website

When I do a search of my site in Google it shows both: mydomain.com www.mydomain.com In my .htaccess file I added code to redirect the non-www version to the www version, but both versions are ...
6
votes
1answer
337 views

In Google Webmaster Tools we have 3 sitemaps attributed to 1 domain

I have a website that has been on the internet for almost 10 years created in "Microsoft FrontPage" with over 900 pages. Currently in Google Webmaster tools it shows up as 2 domains and 3 sitemaps: ...
6
votes
1answer
680 views

Why doesn't Google index the translated versions of my page?

I have a website in Persian language and translated some of my popular posts into English and added this header in <head> section in both of the pages (not entire site): <link rel="alternate"...
6
votes
1answer
2k views

Where are the complete set of Highwire Press metatags defined?

In the Google Scholar Inclusion Guidelines for Webmasters , it is suggested that one use the tags defined by "Highwire Press". Example: <meta name="citation_title" content="Article Title"> ...
6
votes
1answer
65 views

UK/USA Exact Copy English Causing Error “Duplicate submitted url not set as canonical”

starting around February 25th, 2019 we have been having pages excluded from indexing for our UK website with the error "Duplicate, submitted URL not selected as canonical". We have not had this issue ...
6
votes
1answer
599 views

Getting link to abstract indexed in Google Scholar

We have a large digital library with thousands of papers indexed in Google Scholar. We allow Google Scholar to index our PDFs but they're blocked unless you have a subscription. So Google has full-...
5
votes
2answers
2k views

SEO - Delete old indexed pages from Google 301 vs 404?

We're launching new website with new url structure and new content. Domain is the same. Many old pages are indexed by google. Should I use 404 or 301 and redirect to '/' for these old resources? I ...
5
votes
1answer
313 views

Why does Google index pages of my blog in seconds, while pages on the rest of the website take longer to get indexed

I have a questions and answers website in Portuguese about a specific subject. My Q&A website also have a blog, on a sub-directory like www.site.com/articles. I had not written on the blog for ...
5
votes
2answers
4k views

Should I 'mark as fixed' deleted pages in Google Webmaster Tools?

I have deleted a couple of thousand pages from a website. They do not appear in my sitemap.xml and no other pages on the web are pointing to these anymore. Google Webmaster Tools (GWT)'s crawl error ...
5
votes
1answer
575 views

Robots.txt got changed to disallow crawling by accident

Our robots.txt mistakenly got changed to: User-agent: * Disallow: / This occurred about 2 weeks ago and was changed back yesterday to allow crawling. Our listed pages in the Googles have decreased ...
5
votes
3answers
461 views

Remove large number of useless page from Google index using robots.txt

A large number of auto-generated pages from the search of my site has been indexed by Google due to an error. I'm trying to clean this in order to be sure that only the most high quality content is ...
5
votes
6answers
8k views

How can I get a list of all indexed pages for my domain?

We're in the process of migrating an outdated e-commerce cart to Magento. Part of this process will entail configuring proper 301 redirects. I'm aiming to get a list of all indexed pages to throw ...
5
votes
1answer
588 views

301 and no-index tag don't work

Almost 3 months ago I've put no-index tag to about 3,000 pages on my website and 301 redirect (which is permanent redirect) for almost 15,000 pages. (The all site is about 50,000 pages) And yet as ...
5
votes
2answers
796 views

After submitting a site removal request with Google, the tool is showing severe health problems, how do I re-include my site in the index?

I had a major issue in the last week where a site was found to be showing huge numbers of pages that it shouldn't have been. Naturally Google indexed all of these pages! Rather than manually remove ...
5
votes
2answers
573 views

sitemap.xml for huge online store

I'm running online store with 30,000+ products (having unique urls) which are updated every day. I want google to index my products faster. Now crawler index ~500 pages/day (reports from google ...
5
votes
2answers
1k views

Understanding Google Webmasters Tools Sitemaps Information

So, I'm an 'avid' user of google webmaster tools and analytics. I'm building an e-commerce site, all with original product descriptions and a base of 'useful' industry-relevant content. I generated ...
5
votes
1answer
332 views

Use of no-index-meta-tag on pretty URLs?

By now I am fighting through the world of SEO and run into a problem, I think. Let's say I have a page like www.example.com/i-am-a-pretty-url, which is re-written by .htaccess from i-am-ugly-url.php ...
5
votes
1answer
106 views

SEO tips on changing blog pagination

Three years ago we launched a self-made blog area on our e-commerce website. Call it an experimental feature, if you know what I mean. We had, and still have, a very minimalistic URL schema: /blog/...
5
votes
4answers
346 views

Total Indexed 0, 99 not selected in webmaster tools

I recently changed domain names from xxx.com to xxx.ca I created all the 301's submitted sitemaps and submitted a change of address to google webmaster tools on Dec 16th. I've since seen urls change ...
4
votes
5answers
7k views

How can I force Google to re-index my site?

I changed the structure of my URLs. The pages are already indexed by Google and have the following structure: /myfolder/page.apsx The new structure is: /page.aspx Now all URLs that Google knows ...
4
votes
3answers
2k views

How to make Google index millions of user profile pages?

I have a website with a lot of user profiles (like LinkedIn or the like). I need Google to index each public user profile page. I have a few things on my mind: 1- There is no user listing on my page,...
4
votes
3answers
376 views

Delay before getting URLs into Google's in web index?

4 days ago, I have submitted a sitemap.xml into Google's WebMaster Tool for a new website. It contains 3 entries. I have tested the site map and Google found not errors. In about how much time can I ...
4
votes
1answer
6k views

What do I put in htaccess to create a 410 error page when a URL parameter is present?

I tried to create a 410 error page but realized that I actually created a 302 redirect to a 410.php page. Instead I want to use a 410 error to block out an infinite number of dynamically created pages ...
4
votes
2answers
1k views

Informing Google of URL Structure Change

I have a website and the URLS were constructed like so: /index.php/Topic /index.php/AnotherTopic These were indexed in google and search results returned that pointed to these. However, I've ...
4
votes
3answers
1k views

nofollow doesn't stop crawling?

In my website, most of the pages has a linkedin sharing button written in this way: <li> <a id="share_linkedin" href="/link/share/linkedin/Dance+Combo+%28Jazz%2C+Tap%2C+...
4
votes
2answers
321 views

After URL rewriting Google still features many of the old and dirty URLs

I did a complete URL rewriting of my site some three months ago, however Google still features many of the old URLs. They're not dead links as they correctly redirect to the new URLs, but it sort of ...
4
votes
3answers
112 views

Is it possible for Google to Index a site with login?

I have a real estate site that we require the user to login after viewing 3 properties. Is it possible for Google to index these property listings while still keeping that functionality in place? ...
4
votes
3answers
358 views

Does Google index portions of the page that are unique and ignore the duplicate content?

When a page has content on it that is also on other pages on the site but also some unique content, how does Google handle it? Does Google: Index the entire page (including the duplicate content) ...
4
votes
1answer
556 views

How do I tell which pages of my website are not indexed in Google?

Is there any way to find non-indexed pages of my website? I tried searching on-line for this answer but couldn't find the exact solution for how to find the non-indexed pages in Google. If I were ...
4
votes
3answers
853 views

Can Google Bot index transcript of YouTube hosted video?

We have a number of videos on YouTube, which we embed on our site via iframe/object stuff. Now we want to gain more SEO value by indexing video transcriptions. I have checked one of our video on ...
4
votes
1answer
63 views

Does Google follow and count a backlink that goes through a JavaScript location.href redirect page?

example.com has a link on their website which is on same domain like, <a href="https://example.com?ref=mywebsite.tld">Reference</a> example.com?ref=mywebsite.tld doesn't redirect with ...