The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

3
votes
1answer
2k views

Google Webmaster Tools Index Status 0 for one year

I've read this topic with answers but they do not address why zero for one year? but other areas in Google Webmaster Tools report 400 URL indexed. Google Webmaster Tools Index Status Only 2 Indexed. ...
3
votes
2answers
173 views

Google crawl rate is climbing but still no indexing?

This might belong on another stack site but idk. Soooo.... A year ago I started two sites that I didn't want indexed by Google or any other search engine since both sites were being developed based on ...
3
votes
1answer
136 views

Indexing dynamic loading page

Does Google index dynamic loading page? For example index.html <div id="dynamic_message"></div> index.html after few seconds <div id="dynamic_message">Hello Google, do you see ...
3
votes
2answers
2k views

Can I force Bing to reindex our site?

Our website is ranking quite well (first page) on Google for quite a lot of keywords. However, our website is not on the first 10 pages of Bing for most of these keywords. I notice our Google ...
3
votes
2answers
624 views

How to have google index a login protected url?

For example, my site: http://abcde.foobar.com is protected by a "single sign on" login page hosted at http://sso.foobar.com, so when a user visits "abcde", they get redirected to the "sso" login page ...
3
votes
1answer
522 views

Webmaster Tools show the “Total Indexed” number to be zero

I recently switched my domain from yannbane.blogspot.com to www.yannbane.com, and added my new domain to my Webmaster Tools account. After a few days, I went there and checked the data, and I was a ...
3
votes
1answer
357 views

how to set 301 redirect in wordpress .htacces file

In continuation of my previously asked question preserve-search-engine-index-while-shifting-to-new-domain. The migration is being done in the word-press and we will have same server with same IP.Since ...
3
votes
2answers
310 views

Using .htaccess for proper indexing/SEO of timthumb images

I don't know a whole lot about the intricacies of SEO so I was wondering if someone here could provide some insight to this problem. When you use the php script timthumb on a website, it means images ...
3
votes
2answers
266 views

Google De-Index many pages at once?

On one of our websites, Google has been indexing something it wasn't supposed to. We fixed the problem so it shouldn't happen anymore, but are interested in requesting that Google de-index these ...
2
votes
5answers
588 views

How to make whole site headers send code 404?

I have a website for testing. I don't want this site to be indexed by search engines. Now pages on the site return 200 OK in headers. How to make the whole site send code 404 in headers, but stay ...
2
votes
2answers
373 views

Why won't title attributes get indexed in Google?

When I search for Ride On + my site's name, I see that it's indexed. But when I search for Green Horse + my site's name, I don't see my site appearing in the results anywhere! Here's my code: ...
2
votes
2answers
97 views

Does Google provide different Index status for HTTP and HTTPS?

Will Google provide different index statuses for HTTP and HTTPS? Examples: http://www.example.com and https://www.example.com Or it will provide same results for both? If it doesn't provide the ...
2
votes
4answers
756 views

Why doesn't Google remove my noindex and 404 pages?

I've added 404 error codes and no-index meta tag to pages quite some time ago. However, when I check in Google Webmaster Tools, looking at the graph of "removed" pages from their index, I see very low ...
2
votes
2answers
73 views

New domain and submission to search engines

I have registered a new domain with a hosting company. They offer the feature that for each new domain there is an associated placeholder page. Actually it is a "Site not configured page" with some ...
2
votes
3answers
84 views

Multiple site pages not accesible via main site nav- SEO implications?

I run a site that has some of the site pages accessible through the site's main navigation. Then, there are 50+ "state" pages that are accessible to a user if they click on a specific state on a ...
2
votes
2answers
163 views

Request Removal of naked domain from Google Index

I have a site which was temporarily available at both example.com and www.example.com. All traffic to example.com is now redirected to www.example.com, however during the brief period that the site ...
2
votes
1answer
1k views

Google is not indexing URLs in my XML SiteMap?

I have used multiple sitemap.xml for my product pages and my category pages and problem is google only not index my whole site map's link. /sitemap_main.xml -- URLs submitted:114 // ...
2
votes
2answers
99 views

How to explain visitors that we don't control Google's results?

I have a message boards. Once in a while, some people contact us to remove anything related to them. We comply and delete all the posts and all traces. Some of those visitors still complain that they ...
2
votes
1answer
209 views

Is it bad to have both www and the naked domain indexed in Google? Should both be added to webmaster tools?

Currently when searching on Google, the www.example.com version will appear as opposed to example.com. I realize that isn't a big deal, however it made me wonder if I should do some of the same ...
2
votes
3answers
1k views

Will the already indexed URLs be removed if I use a robots.txt for my site?

Many URLs from my site have been added to Google's index, but a lot of them are outdated and they will never result in a 404 error and take the user to my site's homepage. I have submitted a new ...
2
votes
2answers
202 views

No description for any page on the website is available in Google despite robots.txt allowing crawling

I seem to have the weirdest issue with Search Engine Optimization, and I asked the IT folks at my university, I asked people on Joomla forums and I am trying to sort this issue out using Google ...
2
votes
1answer
353 views

Google indexing fewer images after switching to CDN

After switching to a CDN I noticed that my indexed image count went down. I have close to 1000 images on the site with correct tags, alt tags, and all of that. Only 50 are actually being indexed in ...
2
votes
4answers
1k views

Google crawl speed — how fast can it go?

I have a huge website with 5 million pages. Currently Google indexes about 10,000 pages per day. This is very slow, I still have lots of pages that I can't get indexed. Does anyone know what is the ...
2
votes
2answers
2k views

Difference between canonical and base tag

I am a little bit confused regarding the usage of canonical tags and base tags. I have placed canonical tag (rel="canonical") on my website because of my website opening with no-www. I have reviewed ...
2
votes
1answer
1k views

Google Webmaster tools showing sitemap URL's indexed but not showing up in search results

I have submitted simple text sitemap to Google Webmaster tools and after few days it was crawled, after few more most links were indexed according to GWT but it is not showing those links in google. ...
2
votes
2answers
120 views

This address should never have been indexed, how can I properly remove it?

I have a couple of subdomains on my website that I use for various purposes and I don't want/need them to be indexed by search engines. From the very beginning, since I created them, I added a ...
2
votes
3answers
72 views

Is there a legal way to serve data-dump content without incurring search engine penalties?

I have a games site and I'm writing an API that will pull relevant Q&A from my copy of the SE data dump. I will abide by all licensing rules. That said, I'm hesitant to do this because Google ...
2
votes
2answers
213 views

Will this sitemap get me de indexed from Google?

My site's URL (web address) is: http://quantlabs.net/private/sitemap.xml Description (including timeline of any changes made): Will this sitemap get me de-indexed from Google? My new site map just ...
2
votes
1answer
35 views

Website not getting indexed

We launched our website example.com about 6 weeks back. It is a single page application and the urls change dynamically based on search results. We have submitted sitemap through google webmaster but ...
2
votes
1answer
34 views

How to index the right page?

My website is crawled and indexed by Google. However, one of my problem is that the indexed pages are sometimes not the right one. For example, let's say that I have star wars video on my website, ...
2
votes
1answer
222 views

What are the htaccess mechanics of preventing search engines from indexing PDF files?

There are already a variety of posts on how to block certain files (in my case, PDFs) from a search engine like Google. The most relevant for this post was here: How to protect PDF file from indexing. ...
2
votes
2answers
59 views

Removed parent category path - New URL's not showing up in Google search results

Last month we removed parent category path from the sub category URL's. After that we changed the sitemap file with new URL's and submit it to the webmaster tools for indexing. For example ...
2
votes
2answers
114 views

robots meta not blocking indexing

We have a staging version of our website to test changes on at trailheadpaddleshack.ca/staging1. This never appeared in search before. Recently the staging site has appeared on Google and is affecting ...
2
votes
1answer
147 views

Does Google treat different ports as different sites?

I host my website on Azure and I have recently activated a feature to make it possible for me to directly access each server instance in our web farm by a port number. For example ...
2
votes
1answer
207 views

Google is re-indexing pages after redirecting URLs from HTTP to HTTPS incorrectly

I upgraded my site so that all pages have gone from using HTTP to HTTPS. I didn't consider that Google treats HTTPS pages differently than HTTP. I recreated my sitemap to so that all links now ...
2
votes
2answers
252 views

How to prevent Google from indexing a static web page?

I have a static webpage written in HTML and CSS. I do not want it to be indexed by Google. So I made a robots.txt file in the parent directory and disallowed the URL. I want to know: Is that the ...
2
votes
2answers
50 views

Would Google penalize me for removing indexed pages?

I'm about to remove a large part of a website in order to replace it by a better alternative which, unfortunately, cannot be mapped to older URIs with URL rewriting. The part of the website I want to ...
2
votes
3answers
1k views

Finding Google's indexed pages

How do I find out how many pages Google has indexed on my website? I know I can just Google site:http://foo.com, but I would like to record the data and not have to do it by hand. Is there an API for ...
2
votes
3answers
290 views

After adding *.xls to robots.txt how long will the results continue to show up in google

Is there an estimated amount of time before the document will not appear in google results? We have a public records document. One person raised a concern when they saw their "PUBLIC INFORMATION" on ...
2
votes
2answers
63 views

How to know that my site is getting index/rank by search engine

As per subject, anyone can tell me how to check that my site is getting index/rank by search engine(e.g. google, yahoo)?
2
votes
2answers
128 views

problem showing my website correctly in search engines

I have a website which i have indexed on google for example (like 15 days ago). some of my pages pass arguments like: http://www.bla.com/products.php?pro=bla&page=view suddently i saw that ...
2
votes
1answer
250 views

Should I strategically use NoFollow on internal links to make our indexing crawl more efficient?

We have a well designed internal linking system that makes certain no page is more than four pages deep, and the indexing process has gone well for us. However, in addition to the hierarchical page ...
2
votes
3answers
161 views

Site not indexed by Google [duplicate]

I typed the following on Google: (1) site: uniquevolve.com (2) site: uniquevolve.com.au Only (2) gets indexed. Is this normal? The strange thing is, my Website is actually hosted on the server with ...
2
votes
2answers
45 views

Display short domain (country code) in the address bar while still having the site served on a global .com

I have 2 domains let say redd.it and reddit.com. Now how might I let google index the reddit.com but have users browse redd.it? The purpose of this would allow the address bar to be shorter and ...
2
votes
1answer
38 views

Dynamic Serving: Verifying which version of the page Google is showing on Mobile SERPs

We have a large content/informational site which serves pages dynamically based on user device (the same URL for both desktop and mobile). Title tags for mobile pages do not match those set for ...
2
votes
1answer
436 views

Does Bing execute Javascript when crawling and indexing web pages (like Google)?

Some content on some web pages is only displayed with Javascript when a button is clicked (for example). We know that Google executes Javascript and is (very likely) to find this content, but what ...
2
votes
2answers
158 views

How to see which images Google has indexed from your website?

Ive got a website that is using lazy loading to load in images (so that the browser dose not try and load them all at once before they are required). The only issue with this is that there are some ...
2
votes
1answer
162 views

Google indexed my website name with a space

Google has indexed my website name with a space between 2 words. Search intellisense shows my website name with a space between both the words. Ex: word1 word2 (Stack Overflow) What I want is that ...
2
votes
3answers
955 views

How can I force Google to re-crawl a link?

Google Webmaster Tools is showing thousands of links from a North Korean travel agency, but when I go to the link, they don't exist! How can I force Google to re-index that link so it drops off my ...
2
votes
3answers
122 views

Having issues getting new pages indexed in Google

We are having issues getting our new pages crawled by Google and cannot figure out why. We've done lots of research and are still having trouble finding answers. Here's some information regarding our ...