The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

0
votes
1answer
49 views

Google Webmaster: Crawl Stat Increase, but Index status stay flat for days

Back in June, my website experienced a significant drop in index status from 73,000 to 36 and my website cannot be found in Google search. A few days ago, a friend programmer fixed the problem that ...
0
votes
0answers
14 views

Indexing in Webmaster Tools [on hold]

I've submitted a sitemap of my website in Webmaster tools. Submitted - 21 Indexed - 1 What is the reason behind only 1 page getting Indexed. You help is highly appreciated.
0
votes
1answer
24 views

Does the following robots.txt block all pages

I want to knew if the following robots.txt file block the whole pages from being indexed or not. User-agent: * Disallow: Disallow: /cgi-bin/
1
vote
2answers
47 views

How can I submit my site's URL to search engines?

I have a site but I cannot get its URL indexed in search engines like Google, Yahoo, Bing, etc... Please let me know how I can submit my site's URL to Google.
1
vote
2answers
209 views

Google is indexing pages with a “noindex” robots meta tag

I have come across a very annoying problem. I have several pages that shouldn't be indexed, as they are basically pop-up pages and "thanks for signing up" pages. I have set them up with the robots ...
1
vote
2answers
266 views

Google Webmaster Tools not showing index pages

I have submitted sitemap and also fetched pages of my sites but still its showing error like "domain with protocol https://www.domain-name is not available try with http://www.domain-name.html". ...
0
votes
0answers
19 views

How long does it take to re-index the website via noarchinve tag?

I read elsewhere on here that one can't re-index their site with google, but I like to challenge that. Currently, I have every page on my website (that contains about 1,000,000 pages) labeled with a ...
1
vote
2answers
22 views

Google Site: listing Parent Domain directory Index

Currently when we search site:domain.com on google we get a return of 3.6 million pages indexed, About 3,650,000 results (0.31 seconds). When we search site:domain.com/childdirectory we get 3.8 ...
1
vote
1answer
20 views

Changing headers for small screens - SEO implications

I'm changing some of my pages to better display in different devices (tables, smart phones etc). I want to figure out a good way of handling headings. So far my options are hide headings for small ...
0
votes
0answers
1 view

How to get the special price index to update automatically in Magento when special prices expire? [migrated]

I set special prices for some products with defined date when special price should expire. The problem is that the price index is not automatically running when those prices expire. [Sic!: Price ...
3
votes
1answer
232 views

I used rel=“canonical” and hreflang=“x-default”, but global site is missing and receiving “no return tags” error

Here is a sample of the code <link rel="canonical " href="http://www.kaspersky.com/anti-virus-trial" hreflang="en" /> <link rel="alternate" ...
1
vote
2answers
137 views

Conflicting test results when using The Mobile-Friendly Test and PageSpeed Insights

Our website uses an open source product to detect user agent and based on that, it servers mobile theme or desktop theme to users. I know the exact difference between mobile-friendly test and ...
6
votes
4answers
3k views

How to get tens of millions of pages indexed by Google bot?

We are currently developing a site that currently has 8 million unique pages that will grow to about 20 million right away, and eventually to about 50 million or more. Before you criticize... Yes, it ...
2
votes
1answer
277 views

Google indexing fewer images after switching to CDN

After switching to a CDN I noticed that my indexed image count went down. I have close to 1000 images on the site with correct tags, alt tags, and all of that. Only 50 are actually being indexed in ...
3
votes
6answers
2k views

How quickly does Bing index URLs submitted through Webmaster Tools?

In Bing's Webmaster Tools, there is a Submit URLs page that allows you to "Submit URLs that are currently not in the Bing index or that should be reindexed due to recent changes." Does anyone know ...
2
votes
1answer
31 views

X-Robots noindex a folder of PDFs

I'd like to noindex a group of PDFs within a certain folder. There are other PDFs on site that I do want indexed, so I want to avoid using <FilesMatch ".pdf$"> Header set X-Robots-Tag "noindex, ...
5
votes
2answers
415 views

Why in the search results of Google does not appear the unique name of my website?

I have a website with a unique name, already indexed and with a perfect SEO. Although there are no websites with the same unique name, when I'm searching on Google I found my homepage listed on the ...
2
votes
1answer
90 views

Google indexed my website name with a space

Google has indexed my website name with a space between 2 words. Search intellisense shows my website name with a space between both the words. Ex: word1 word2 (Stack Overflow) What I want is that ...
2
votes
1answer
53 views

How do I make it clear to Google that my domain name contains `www` like www.wwwexample.com?

I've noticed that domain names containing www (e.g., http://www.wwwexample.com) sometimes are ranked lower in search results. I have also noticed that Google assumes it to be www.example.com. For ...
3
votes
2answers
3k views

Why the number of indexed pages decreased for a “site:” search

Recently I created a website with hundreds of thousands of unique pages. A week ago, Google had indexed about 250,000 pages. It has now decreased to 90k URLs (using a site:domain.com query). What ...
2
votes
1answer
48 views

Does Google treat different ports as different sites?

I host my website on Azure and I have recently activated a feature to make it possible for me to directly access each server instance in our web farm by a port number. For example ...
5
votes
2answers
326 views

Google Webmaster Tools reports fake 404 errors

I have a website where Google Webmaster Tools reports 15,000 links as 404 errors. However, all links return a 200 when I visit them. The problem is, that eventhough I can visit these pages and return ...
3
votes
2answers
154 views

Google crawl rate is climbing but still no indexing?

This might belong on another stack site but idk. Soooo.... A year ago I started two sites that I didn't want indexed by Google or any other search engine since both sites were being developed based on ...
5
votes
5answers
400 views

How can I fix Google indexing URLs that are not part of my sitemap?

Using site:example.com in Google is returning many results with the following format: https://www.w.example.com/services/edison/16mm-to-2k Obviously this is not what I submitted and is not part of my ...
2
votes
2answers
1k views

Difference between canonical and base tag

I am a little bit confused regarding the usage of canonical tags and base tags. I have placed canonical tag (rel="canonical") on my website because of my website opening with no-www. I have reviewed ...
0
votes
0answers
23 views

How do I get Google to index my 30 million pages? [duplicate]

I am releasing a website which has 30 million pages of content. (This isn't spam material). It has a detail page for each of the 30 million places around the World. e.g ...
2
votes
3answers
89 views

How can I force Google to re-crawl a link?

Google Webmaster Tools is showing thousands of links from a North Korean travel agency, but when I go to the link, they don't exist! How can I force Google to re-index that link so it drops off my ...
1
vote
1answer
61 views

Incorrect subdomain of staging site showing up in Google SERP

I have a staging site where we do our work and show to clients. The site was created before I started and it wasn't set up with a disallow / in robots.txt or a meta no-index before it was created, so ...
0
votes
1answer
63 views

Will Google penalize me for duplicate content on GitHub from my knowledge base?

I want to have a copy of each of our documentation articles in GitHub so that other users can improve, edit and add to the document. The accepted changes will be made live in our knowledge base forum. ...
1
vote
1answer
265 views

How to force Google to index images and webpages? Or I shouldn't bother and just wait a bit more?

I have a web site with a lot of web-pages and images. I created the sitemaps (grouped into single sitemaps index file). I submitted those sitemaps to Google but the indexing process is disappointingly ...
0
votes
1answer
99 views

sitemap.xml for a website with forum

We have a website dedicated to our ActiveX and .NET components that has been working for more than 12 years. The site consists of 2 parts: the static part (product descriptions and articles) and the ...
11
votes
3answers
5k views

Google is still crawling and indexing my old, dummy, test pages which now are 404 not found

I have set up my site with sample pages and data (lorem ipsum, etc..) and Google has crawled these pages. I deleted all these pages and actually added real content but in webmaster tools, i still get ...
0
votes
0answers
17 views

Decrease in index URLs,and drop in traffic [duplicate]

A site that I work for has had a drop in traffic over the last few weeks.and also Decrease in INDEXING the no of URL's . However, having had a look in Google Webmaster tools, there has been a big ...
0
votes
0answers
11 views

How this type of search engine index result is working? [duplicate]

For example when you Google "stack overflow" or any other popular website, the result is indexing like above image. what should i do, if i want my website look like above image in search engine ...
10
votes
4answers
1k views

Prevent XML sitemaps from showing up in Google search results

How do I prevent my XML sitemap files from showing up in Google search results like this result of a site: search query: I don't understand why Google would choose to show sitemap files in search ...
0
votes
0answers
5 views

Google not indexing site [duplicate]

I have had a site up for some time and am not being indexed at all by Google. I can't work out what is blocking the site from being indexed. I have tried Google Webmaster Tools but it isn't giving ...
3
votes
1answer
49 views

Two kinds of Google index

I am curious about information that gave me Google's Webmaster Tools. Because I see two different information about Google index of same webpage in same time. First information (sitemap files) I ...
0
votes
0answers
25 views

Google still returns old Wordpress user name when I search for it [duplicate]

I created a Wordpress website with a particular user name that I no longer use (I fully deleted the Wordpress user and created a new one). Yet when I run a Google search for the initial user name, my ...
0
votes
1answer
31 views

How to tell Google only crawl direct links?

I have some links that want to Google index it so I put those links in a separate simple HTML file, updated my sitemap to Google know about this page and just link my desired pages on that now I want ...
1
vote
3answers
58 views

How can pages which aren't indexed be reported as landing pages in Google Analytics?

In Google Analytics I have thousands of landing pages reported, however on checking some of them they aren't indexed in Google, this is expected as the have robots NOINDEX tag in the source code. So ...
0
votes
2answers
37 views

How to remove a page from the Google search results [duplicate]

Google says one can use the following method to remove a page from the search results: by putting -http://www.example.com/outdated.html into the sitemap. But what if the site does not exist anymore.
1
vote
2answers
56 views

Are links within SlideShare presentations indexed by search engines?

I have created a PDF presentation including links to a site I own on the last slide. So far, such links are not reported in Google Webmaster Tools. When I search Google for the presentation, I can ...
4
votes
2answers
204 views

Prevent Googlebot from seeing or indexing common keywords such as “read full story”

I have a site that uses a lot of the same anchor text. For example, "read full story". When I do an SEO audit for my site, I find that these are my most frequent keywords, but I am not trying to ...
1
vote
1answer
48 views

Would adding noindex on index.html stop main domain from being indexed?

For various reasons, I don't want my domain.com/index.html from being indexed because I have the same file with the same content but called domain.com/home.html instead. Now I added the noindex meta ...
11
votes
2answers
2k views

Indexing for Google scholar, which tags to use?

In the "Inclusion Guidelines for Webmasters" for Google Scholar is written under Indexing Guidelines: Google Scholar supports Highwire Press tags (e.g., citation_title), Eprints tags (e.g., ...
1
vote
1answer
119 views

Will Google Scholar index the papers on my website?

I have just requested that Google Scholar collect the papers from my personal web site: http://cs.uic.edu/~asmirnov/publications.html I was wondering if I did everything right: I submitted a ...
1
vote
3answers
37 views

Older post not indexed, new post indexed right away?

I have a post I created yesterday that was indexed rather quickly by Google. However, I have two other post that I created within the past 4 days that are not indexed and I cannot find a trace of ...
9
votes
3answers
1k views

How do I find when an URL was first indexed by Google?

How do I find out when a particular URL was first indexed by Google? I'd prefer a solution that works even for competitors' URLs that are not owned by me.
4
votes
2answers
271 views

Number of indexed pages with “site:” search less than reported in Google Webmaster Tools

In Google webmaster tools it shows that I have 309 pages indexed, but when I search using "site:site.com" appear about 180 only (On the first page appears "about 608 results," something near the total ...
1
vote
1answer
215 views

Change to www from naked domain impact on seo

I have set up my website from the beginning to be used without the www, ie 'naked', with the following command at .htaccess and everything is working fine. RewriteCond %{HTTP_HOST} ...