The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

2
votes
2answers
279 views

How to prevent Google from indexing a static web page?

I have a static webpage written in HTML and CSS. I do not want it to be indexed by Google. So I made a robots.txt file in the parent directory and disallowed the URL. I want to know: Is that the ...
2
votes
2answers
51 views

Would Google penalize me for removing indexed pages?

I'm about to remove a large part of a website in order to replace it by a better alternative which, unfortunately, cannot be mapped to older URIs with URL rewriting. The part of the website I want to ...
2
votes
3answers
108 views

Using Ajax #! for Google but site is not being crawled any more

Our pages used to be formulated using the ? string but since we changed to AJAX loading we now use #!, for example: Old link: /post.php?idPost=5326 New link: /post.php#!idPost=5326 The snapshot ...
2
votes
3answers
2k views

Finding Google's indexed pages

How do I find out how many pages Google has indexed on my website? I know I can just Google site:http://foo.com, but I would like to record the data and not have to do it by hand. Is there an API for ...
2
votes
3answers
291 views

After adding *.xls to robots.txt how long will the results continue to show up in google

Is there an estimated amount of time before the document will not appear in google results? We have a public records document. One person raised a concern when they saw their "PUBLIC INFORMATION" on ...
2
votes
2answers
64 views

How to know that my site is getting index/rank by search engine

As per subject, anyone can tell me how to check that my site is getting index/rank by search engine(e.g. google, yahoo)?
2
votes
2answers
128 views

problem showing my website correctly in search engines

I have a website which i have indexed on google for example (like 15 days ago). some of my pages pass arguments like: http://www.bla.com/products.php?pro=bla&page=view suddently i saw that ...
2
votes
1answer
254 views

Should I strategically use NoFollow on internal links to make our indexing crawl more efficient?

We have a well designed internal linking system that makes certain no page is more than four pages deep, and the indexing process has gone well for us. However, in addition to the hierarchical page ...
2
votes
3answers
164 views

Site not indexed by Google [duplicate]

I typed the following on Google: (1) site: uniquevolve.com (2) site: uniquevolve.com.au Only (2) gets indexed. Is this normal? The strange thing is, my Website is actually hosted on the server with ...
2
votes
1answer
44 views

How to get precise indexed page number from a certain domain or a certain site?

When conducting competitor analysis, we use "site" command to get the indexed page number from a certain domain or a certain site. But it seems that I cannot get the correct(or precise) number. For ...
2
votes
1answer
54 views

Dynamic Serving: Verifying which version of the page Google is showing on Mobile SERPs

We have a large content/informational site which serves pages dynamically based on user device (the same URL for both desktop and mobile). Title tags for mobile pages do not match those set for ...
2
votes
1answer
143 views

Noindex metatag in alternate mobile version of page with canonical to desktop… What consequences?

I have a desktop site to serve content for desktop and tablet users. I also have a mobile version of the site to cater to mobile phone visitors. Desktop pages have the following kind of annotations ...
2
votes
2answers
209 views

How to see which images Google has indexed from your website?

Ive got a website that is using lazy loading to load in images (so that the browser dose not try and load them all at once before they are required). The only issue with this is that there are some ...
2
votes
1answer
205 views

Google indexed my website name with a space

Google has indexed my website name with a space between 2 words. Search intellisense shows my website name with a space between both the words. Ex: word1 word2 (Stack Overflow) What I want is that ...
2
votes
3answers
133 views

Having issues getting new pages indexed in Google

We are having issues getting our new pages crawled by Google and cannot figure out why. We've done lots of research and are still having trouble finding answers. Here's some information regarding our ...
2
votes
1answer
106 views

Google not indexing my Mediawiki's jpg files description pages

My website es.wikineos.com has been running for a few years with the MediaWiki Content Management System like the one they use at Wikipedia. Google seems to be indexing my site correctly at a quick ...
2
votes
4answers
292 views

How long for Google to index all site maps?

We recently uploaded new sitemaps, as the old ones were out of date and we've also upgraded our forum which changed the URLs of a lot of our website (we're 301 redirecting of course). We uploaded the ...
2
votes
3answers
1k views

Why is Google Webmaster Tools account showing fewer indexed pages than a site: search?

When I have check my website index pages it is showing only 252 pages are indexed but when I checked through Google Search by typing site:http://www.example.com then is showing more then 900 pages are ...
2
votes
2answers
170 views

Can you create a private website without password protection that would not be indexed?

I'd like to create a "private" website that clients can visit by typing in the provided direct URL (on a business card, for example), but is not password protected and would not be indexed by search ...
2
votes
1answer
160 views

Do sites using YouTube video API get indexed by Google?

Suppose I design a small app that heavily depends on Google YouTube API to dynamically fetch hundreds of YouTube video data. My site will be able to respond to users' requests, and generate several ...
2
votes
1answer
332 views

Will Google index images from HTML select tag

If i have code like this: <select> <option value="path/to/image1.jpg">Image 1</option> <option value="path/to/image2.jpg">Image 2</option> <option value="...
2
votes
2answers
220 views

Is it better to burn old domain names and 301 to a new one for domains that experienced a high number of errors?

As discussed in this topic, several sites were down due to a server issue for about a month. I have slowly watched some of the more popular sites gain some traffic. I did say slowly. I have also ...
2
votes
2answers
151 views

Prevent crawler that doesn't honoring robots.txt

I have some problem, when I try to write robots.txt for my site ... I find some issues by search on Google, and tell me about honor and not honoring robots.txt, how I can prevent it, can I perform it ...
2
votes
2answers
131 views

Blogger still visible after moving to WP; Google Indexing issues after moving from Blogger to WP

I recently migrated from Blogger to Wordpress and am having two major transition issues that are really hurting. Despite literally hours of searching and experimenting, I cannot resolve the following: ...
2
votes
1answer
89 views

How to optimize website for SEO when content is accessed via one search field

We are developing a website (sort of information index for companies) where almost all content is accessed via one search field (similar to Google): you type a search phrase, get results and then can ...
2
votes
2answers
494 views

Should I notify 'under construction' websites to crawlers? If yes how?

I am currently developing a website which is going to take some time to finish. I need to move some 'stuff' to production frequently, while maintaining a under construction status. My front page will ...
2
votes
2answers
198 views

Old pages still appearing in Google?

Many pages that have been deleted for a long time are still appearing in Google? When I then click on them, they obviously can't be found. Am I doing something wrong/forgetting something?
2
votes
1answer
291 views

Why do Google FreshBot crawled and indexed pages disappear from SERPs? Will they come back?

Sometimes a page on our site will show up in the Google SERPs that was previously not indexed (yet) due to a news story or blog posting on another site that points to it. From what I understand, the ...
2
votes
2answers
39 views

Can I create website translations on subdomains or folders without losing my current English rankings?

I have a running website of with some hundreds of thousands of pages already indexed, let's say example.com Website needs to be translated to some other languages with the purpose of getting more ...
2
votes
2answers
58 views

Pages are returning a 403 response code and not getting indexed in Google

I am working on a website but not all of its pages are getting indexed in Google. Everything seems fine to me from the URL structure to the canonical tag. However, when I check the pages header ...
2
votes
1answer
34 views

Google indexed work-in-progress page. how to delete it from Google index?

I developed a page under the following URL: example.org/dev Since the development is finished, I moved the page to the root at example.org/ For some reason, Google indexed the page during ...
2
votes
1answer
84 views

Making one image non-indexable to search engines in webpage

On my contact page, its a form where people can select a department to contact, then they fill out basic information (name, email and message). Additionally, a PHP script is called (via the HTML IMG ...
2
votes
1answer
120 views

X-Robots noindex a folder of PDFs

I'd like to noindex a group of PDFs within a certain folder. There are other PDFs on site that I do want indexed, so I want to avoid using <FilesMatch ".pdf$"> Header set X-Robots-Tag "noindex, ...
2
votes
1answer
63 views

How do I make it clear to Google that my domain name contains `www` like www.wwwexample.com?

I've noticed that domain names containing www (e.g., http://www.wwwexample.com) sometimes are ranked lower in search results. I have also noticed that Google assumes it to be www.example.com. For ...
2
votes
1answer
40 views

Is it unusual for Google to take more than five days to include a new site in the search index?

I recently launched a brand new website. It's a travel guide with around 260 unique pages with lots of newly written content and unique images. I submitted the site to Google 5 days ago and at the ...
2
votes
1answer
344 views

Is there an alternative to using an iframe so that my content would be visible to search engines?

I have a book-length document that is typeset with the LaTex typesetting system (It's a markup language popular for science and math typesetting.) A custom script runs a program called HyperLatex ...
2
votes
2answers
42 views

How to prevent Google from indexing non-domain URL of website?

My webhost gives you two URLs for your website: the URL on your shared server, which is something like usr283725992783.webhost.com and your domain URL, which is www.example.com Google is indexing ...
2
votes
1answer
445 views

What replaces meta keywords if Google doesn't use them anymore? [duplicate]

As a majority of webmasters already know that Google does not use Keywords anymore to help index a website properly. Which is understandable by people exploiting the system to try to gain a better ...
2
votes
1answer
65 views

Robots and Sitemaps

I have some problems regarding indexing. Google indexed so much in the list. Now I wanted to remove everything from my site. If I have disallow all in robots.txt and send my sitemap.xml. Would ...
2
votes
1answer
88 views

Google images directing to url with Escaped Fragment

I'm running an ajax website with images and using Google's guidelines for ajax webistes. My site is indexed correctly in Google's web search. But in image search the _escaped_fragment_ appears in the ...
2
votes
1answer
28 views

Should I add a site root to the sitemap file?

Is it really necessary to include a root (homedir) of the site to the sitemap? As I can understand the sitemaps main idea - it is not any necessary. Am I right?
2
votes
2answers
870 views

301 redirect from HTTP to HTTPS - how to be sure Google is fetching the correct information?

I'm hoping somebody might be able to provide a bit of advice on an issue I am having. I have one site where we implemented a 301 redirect on the homepage from HTTP to HTTPS. We have links on the ...
2
votes
1answer
60 views

Is this considered to be “Internal Near-Duplicates”?

Some people generate the same pages with a slight variation in keywords, title, country name, region name, etc... This is typically considered to be "Internal Near-Duplicates." I have seen a website ...
2
votes
2answers
77 views

Should I have link rel=next & prev on URLs which have query variables?

For example, I have link rel prev & next set up on these pages of products: site.com?page=2 site.com?page=3 (this is my preferred structure by the way and I'm trying to get all the ugly URLs ...
2
votes
1answer
177 views

JavaScript loaded external content SEO

I wonder what is the best way to have Javascript loaded content indexed by search engines. I know that search engines don't execute Javascript, but I am thinking more of an progressive enchantment. I ...
2
votes
1answer
104 views

Why is Google indexing all these other websites?

I run a web hosting company and I have noticed something strange about the way my website and the other websites that I host are indexed in Google. For some reason, other websites that I am hosting ...
2
votes
1answer
160 views

Lasting discrepancy between the site command and indexed pages in Google Webmaster

I have recently uploaded a blog on blogger. The pages of my blog are accessible for crawling and indexing and I can see that some crawling has started two weeks ago. I have noticed that the ...
2
votes
1answer
1k views

How to get google and bing to index original image, not thumbnail?

I've read this post Make google index the actual image not the thumbnail but my case is a little different. I have over a thousand images, in many different directories, with many different names, ...
2
votes
1answer
269 views

301 redirect to different page on different domain?

I want to make a 301 redirect to a different page on a different domain. The page is on the same topic, but is different content. Also, the traffic to the original page comes from the alt text on an ...
2
votes
1answer
361 views

how to set 301 redirect in wordpress .htacces file

In continuation of my previously asked question preserve-search-engine-index-while-shifting-to-new-domain. The migration is being done in the word-press and we will have same server with same IP.Since ...