The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

3
votes
3answers
55 views

Google indexes a completely DIFFERENT title for my web site. What can I do?

I have a strange problem. I have read about this problem in other questions but mine is different in a strange way. After a back up at my web hosting company, Google indexes my website with tags such ...
3
votes
1answer
78 views

Does using the noarchive tag affect the page rankings?

Has anyone heard of any ranking impact for the pages where the noarchive tag is used? They are indexable (and indexed), but just wondered if there are any case studies showing that disallowing Google ...
3
votes
3answers
59 views

Indexed webpages stopped rising, while Submited keep rising normally

Last months I have noticed a strange behaviour in Google's Webmaster Tools. Although I provide a valid Sitemap for my website, which is normally processed and without any issues from Google, while ...
3
votes
1answer
445 views

How to allow Google to index protected content?

I'm working on my site and as it require users to log in it will be hard to Google to index the sites, because to see 90% of the content you have to be online. So I've made a script which looks for ...
3
votes
1answer
92 views

Are the following assumptions about indexing and ranking correct?

Are the following statements true or false: If a page is crawled by Google, it automatically gets into the index (unless explicitly blocked by robots.txt) An indexed page always gets a ranking (high ...
3
votes
2answers
140 views

Traffic fall after a server problem

I have a website from which I analyse the traffic with Google analytics. Day after day the traffic (mainly from Google SE) incresed until I get a problem with my server. For one day the server has ...
3
votes
1answer
119 views

How can I force a certain URL for Google to use in search results?

Each page on my site can be accessed by a shortened URL and normal "long" URLs. The shortened URL redirects to the long URL and the long URL includes an optional title that's not parsed (much like on ...
3
votes
1answer
23 views

Thoughts on situating a mobile-only conversion form?

I have a Drupal 7 site. In desktop display, the site contains a sidebar contact form and in most mobile displays, this form goes down below the webpages and buffering between them and the footer (that'...
3
votes
1answer
23 views

How to remove deleted webpage returning 200 from indexers?

I have recently deleted my personal webpage - cancelled the entire hosting and gave up the domain. I want the Bing, google and others to remove the pages from their indexes. However, my hosting ...
3
votes
1answer
132 views

Stop Google from indexing parent folder URLs

Here is my problem: example.com/images folder and subfolders contain all of my images for example.com site and sub pages. Google is indexing those directories locations as URLs. For example. /...
3
votes
3answers
2k views

How can I force Google to re-crawl a link?

Google Webmaster Tools is showing thousands of links from a North Korean travel agency, but when I go to the link, they don't exist! How can I force Google to re-index that link so it drops off my ...
3
votes
2answers
175 views

How can I get Google to index content that is written into the page with JavaScript?

I have a website that focuses on charts and graphs. The graphs on the site are drawn using JavaScript, but contain keywords that I would like to have indexed. For example, here is a screenshot of ...
3
votes
7answers
112 views

Will a missing <head> tag prevent Google from indexing a WordPress site?

I was recently trying to configure a Google Webmasters Tools account for a client. I spent almost an hour wondering why I couldn't get the site to validate, when I found that the opening tag was ...
3
votes
1answer
110 views

Odd/faulty page links being served to Googlebot

Yahoo recently bought Tumblr, where I write fairly long form scientific pieces. I noticed recently that a new script had been added to the end of pages, and it seems to be interacting badly with the ...
3
votes
1answer
2k views

Google Webmaster Tools Index Status 0 for one year

I've read this topic with answers but they do not address why zero for one year? but other areas in Google Webmaster Tools report 400 URL indexed. Google Webmaster Tools Index Status Only 2 Indexed. ...
3
votes
2answers
180 views

Google crawl rate is climbing but still no indexing?

This might belong on another stack site but idk. Soooo.... A year ago I started two sites that I didn't want indexed by Google or any other search engine since both sites were being developed based on ...
3
votes
1answer
136 views

Indexing dynamic loading page

Does Google index dynamic loading page? For example index.html <div id="dynamic_message"></div> index.html after few seconds <div id="dynamic_message">Hello Google, do you see ...
3
votes
2answers
2k views

Can I force Bing to reindex our site?

Our website is ranking quite well (first page) on Google for quite a lot of keywords. However, our website is not on the first 10 pages of Bing for most of these keywords. I notice our Google ...
3
votes
2answers
753 views

How to have google index a login protected url?

For example, my site: http://abcde.foobar.com is protected by a "single sign on" login page hosted at http://sso.foobar.com, so when a user visits "abcde", they get redirected to the "sso" login page ...
3
votes
1answer
535 views

Webmaster Tools show the “Total Indexed” number to be zero

I recently switched my domain from yannbane.blogspot.com to www.yannbane.com, and added my new domain to my Webmaster Tools account. After a few days, I went there and checked the data, and I was a ...
3
votes
1answer
61 views

Indexing protected PDF files

It is my intention to use protected PDF files on my web journal, the type that does not allow the text to be copied. I would like to know if this will affect its indexing on Google Scholar, and if ...
3
votes
2answers
334 views

Using .htaccess for proper indexing/SEO of timthumb images

I don't know a whole lot about the intricacies of SEO so I was wondering if someone here could provide some insight to this problem. When you use the php script timthumb on a website, it means images ...
3
votes
2answers
271 views

Google De-Index many pages at once?

On one of our websites, Google has been indexing something it wasn't supposed to. We fixed the problem so it shouldn't happen anymore, but are interested in requesting that Google de-index these pages....
2
votes
5answers
595 views

How to make whole site headers send code 404?

I have a website for testing. I don't want this site to be indexed by search engines. Now pages on the site return 200 OK in headers. How to make the whole site send code 404 in headers, but stay ...
2
votes
2answers
3k views

Why are new pages not being indexed and old pages stay in the index?

I currently have a site that was recently restructured, causing much of its content to be reposted, creating new URL's for each page. To avoid duplicates, all of the existing pages were added to the ...
2
votes
2answers
375 views

Why won't title attributes get indexed in Google?

When I search for Ride On + my site's name, I see that it's indexed. But when I search for Green Horse + my site's name, I don't see my site appearing in the results anywhere! Here's my code: <td&...
2
votes
2answers
102 views

Does Google provide different Index status for HTTP and HTTPS?

Will Google provide different index statuses for HTTP and HTTPS? Examples: http://www.example.com and https://www.example.com Or it will provide same results for both? If it doesn't provide the ...
2
votes
2answers
74 views

New domain and submission to search engines

I have registered a new domain with a hosting company. They offer the feature that for each new domain there is an associated placeholder page. Actually it is a "Site not configured page" with some ...
2
votes
3answers
987 views

SEO: Duplicate content caused by pagination/tag/index pages [duplicate]

Possible Duplicate: What is duplicate content and how can I avoid being penalized for it on my site? I read that I should use a NoIndex tag for transitional pages like index, pagination, or ...
2
votes
3answers
84 views

Multiple site pages not accesible via main site nav- SEO implications?

I run a site that has some of the site pages accessible through the site's main navigation. Then, there are 50+ "state" pages that are accessible to a user if they click on a specific state on a ...
2
votes
2answers
187 views

Request Removal of naked domain from Google Index

I have a site which was temporarily available at both example.com and www.example.com. All traffic to example.com is now redirected to www.example.com, however during the brief period that the site ...
2
votes
1answer
1k views

Google is not indexing URLs in my XML SiteMap?

I have used multiple sitemap.xml for my product pages and my category pages and problem is google only not index my whole site map's link. /sitemap_main.xml -- URLs submitted:114 // ...
2
votes
2answers
99 views

How to explain visitors that we don't control Google's results?

I have a message boards. Once in a while, some people contact us to remove anything related to them. We comply and delete all the posts and all traces. Some of those visitors still complain that they ...
2
votes
1answer
234 views

Is it bad to have both www and the naked domain indexed in Google? Should both be added to webmaster tools?

Currently when searching on Google, the www.example.com version will appear as opposed to example.com. I realize that isn't a big deal, however it made me wonder if I should do some of the same ...
2
votes
3answers
2k views

Will the already indexed URLs be removed if I use a robots.txt for my site?

Many URLs from my site have been added to Google's index, but a lot of them are outdated and they will never result in a 404 error and take the user to my site's homepage. I have submitted a new ...
2
votes
2answers
240 views

No description for any page on the website is available in Google despite robots.txt allowing crawling

I seem to have the weirdest issue with Search Engine Optimization, and I asked the IT folks at my university, I asked people on Joomla forums and I am trying to sort this issue out using Google ...
2
votes
1answer
386 views

Google indexing fewer images after switching to CDN

After switching to a CDN I noticed that my indexed image count went down. I have close to 1000 images on the site with correct tags, alt tags, and all of that. Only 50 are actually being indexed in ...
2
votes
4answers
1k views

Google crawl speed — how fast can it go?

I have a huge website with 5 million pages. Currently Google indexes about 10,000 pages per day. This is very slow, I still have lots of pages that I can't get indexed. Does anyone know what is the ...
2
votes
2answers
2k views

Difference between canonical and base tag

I am a little bit confused regarding the usage of canonical tags and base tags. I have placed canonical tag (rel="canonical") on my website because of my website opening with no-www. I have reviewed ...
2
votes
1answer
2k views

Google Webmaster tools showing sitemap URL's indexed but not showing up in search results

I have submitted simple text sitemap to Google Webmaster tools and after few days it was crawled, after few more most links were indexed according to GWT but it is not showing those links in google. ...
2
votes
2answers
120 views

This address should never have been indexed, how can I properly remove it?

I have a couple of subdomains on my website that I use for various purposes and I don't want/need them to be indexed by search engines. From the very beginning, since I created them, I added a robots....
2
votes
3answers
72 views

Is there a legal way to serve data-dump content without incurring search engine penalties?

I have a games site and I'm writing an API that will pull relevant Q&A from my copy of the SE data dump. I will abide by all licensing rules. That said, I'm hesitant to do this because Google ...
2
votes
2answers
224 views

Will this sitemap get me de indexed from Google?

My site's URL (web address) is: http://quantlabs.net/private/sitemap.xml Description (including timeline of any changes made): Will this sitemap get me de-indexed from Google? My new site map just ...
2
votes
1answer
55 views

Website not getting indexed

We launched our website example.com about 6 weeks back. It is a single page application and the urls change dynamically based on search results. We have submitted sitemap through google webmaster but ...
2
votes
1answer
36 views

How to index the right page?

My website is crawled and indexed by Google. However, one of my problem is that the indexed pages are sometimes not the right one. For example, let's say that I have star wars video on my website, ...
2
votes
1answer
416 views

What are the htaccess mechanics of preventing search engines from indexing PDF files?

There are already a variety of posts on how to block certain files (in my case, PDFs) from a search engine like Google. The most relevant for this post was here: How to protect PDF file from indexing. ...
2
votes
2answers
777 views

Does Bing execute Javascript when crawling and indexing web pages (like Google)?

Some content on some web pages is only displayed with Javascript when a button is clicked (for example). We know that Google executes Javascript and is (very likely) to find this content, but what ...
2
votes
2answers
137 views

robots meta not blocking indexing

We have a staging version of our website to test changes on at trailheadpaddleshack.ca/staging1. This never appeared in search before. Recently the staging site has appeared on Google and is affecting ...
2
votes
1answer
193 views

Does Google treat different ports as different sites?

I host my website on Azure and I have recently activated a feature to make it possible for me to directly access each server instance in our web farm by a port number. For example http://example.com:...
2
votes
1answer
227 views

Google is re-indexing pages after redirecting URLs from HTTP to HTTPS incorrectly

I upgraded my site so that all pages have gone from using HTTP to HTTPS. I didn't consider that Google treats HTTPS pages differently than HTTP. I recreated my sitemap to so that all links now ...