The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

14
votes
1answer
1k views

Why aren't search engines indexing my content?

This is a general, community wiki catch-all question and answer pair intended to address any questions concerning the reasons a site or specific site contents do not appear in search engine ...
0
votes
1answer
143 views

sitemap.xml for a website with forum

We have a website dedicated to our ActiveX and .NET components that has been working for more than 12 years. The site consists of 2 parts: the static part (product descriptions and articles) and the ...
6
votes
4answers
3k views

How to get tens of millions of pages indexed by Google bot?

We are currently developing a site that currently has 8 million unique pages that will grow to about 20 million right away, and eventually to about 50 million or more. Before you criticize... Yes, it ...
3
votes
2answers
3k views

Why the number of indexed pages decreased for a “site:” search

Recently I created a website with hundreds of thousands of unique pages. A week ago, Google had indexed about 250,000 pages. It has now decreased to 90k URLs (using a site:domain.com query). What ...
10
votes
5answers
17k views

How to protect PDF file from indexing?

I have a link to PDF document on a public web-page. How do I prevent search engines from indexing this link and PDF document? The only idea I thought of is to use CAPTCHA. However, I wonder if there ...
4
votes
2answers
96 views

Preserve search engine rankings while shifting to new domain name

We have to shift our web-site to a new domain due to some unavoidable circumstances. The portal has been up and running there since 2009. It has good index in various search engines and we are ...
5
votes
2answers
944 views

Can you use googleon and googleoff comments to prevent Googlebot from indexing part of a page?

I've seen code like for preventing Google from indexing part of a page: <p>This is a paragraph that will be indexed by Google.</p> <!--googleoff: index--> <p>This is a ...
5
votes
2answers
533 views

How does Google find a domain with no links to it?

I recently registered a new domain, pointed it to my existing server, and set up a minimal page just saying "test" and nothing else. I just discovered tonight that the page is already indexed in ...
10
votes
4answers
794 views

Is there any way to have search engines not index a certain section of a page?

I have Blogger setup with the Blog Archive panel shown on every page so that users can easily get to old posts. The problem is that it lists the title of each page in this panel, meaning that the ...
6
votes
2answers
1k views

Do search engines index text contained in SVG elements?

Example: <svg><text>Hello World</text></svg>?
17
votes
13answers
3k views

How do I get images containing text to be indexed by search engines?

I am building a small portfolio website for a friend, and being in advertising and all, she hates the standard fonts and wants everything written in a custom font. As CSS font-embedding is not really ...
11
votes
4answers
1k views

Prevent XML sitemaps from showing up in Google search results

How do I prevent my XML sitemap files from showing up in Google search results like this result of a site: search query: I don't understand why Google would choose to show sitemap files in search ...
5
votes
2answers
482 views

Why in the search results of Google does not appear the unique name of my website?

I have a website with a unique name, already indexed and with a perfect SEO. Although there are no websites with the same unique name, when I'm searching on Google I found my homepage listed on the ...
5
votes
3answers
348 views

Do WordPress websites get indexed quicker by search engines than a regular website?

I registered a couple of domains with the names of categories of products we sell. I then installed WordPress in one of those domains and played around with it for a bit, and left it alone for about a ...
5
votes
4answers
584 views

Will JavaScript (document.write) content be indexed by search engines?

I have an external JS file embedding some content inline in a web page. Basically it just does a document.write("my content") via a script tag and loaded externally with the src attribute. Any ...
4
votes
3answers
158 views

How do I prevent Google from indexing text that is generated by JavaScript?

Google is executing the JavaScript on my password creator website and indexing the random passwords that get generated by the JavaScript. The random text that is generated could look spammy to ...
3
votes
6answers
159 views

Stopping Google index some web pages I have

I have some web pages that google has indexed. Now I added a robots.txt file to exclude them but should I also add a “noindex” tag and if so then how can I best add this?
2
votes
2answers
68 views

robots meta not blocking indexing

We have a staging version of our website to test changes on at trailheadpaddleshack.ca/staging1. This never appeared in search before. Recently the staging site has appeared on Google and is affecting ...
2
votes
1answer
221 views

Will Google index images from HTML select tag

If i have code like this: <select> <option value="path/to/image1.jpg">Image 1</option> <option value="path/to/image2.jpg">Image 2</option> <option ...
2
votes
1answer
349 views

how to set 301 redirect in wordpress .htacces file

In continuation of my previously asked question preserve-search-engine-index-while-shifting-to-new-domain. The migration is being done in the word-press and we will have same server with same IP.Since ...
2
votes
2answers
182 views

Old pages still appearing in Google?

Many pages that have been deleted for a long time are still appearing in Google? When I then click on them, they obviously can't be found. Am I doing something wrong/forgetting something?
1
vote
3answers
87 views

How can pages which aren't indexed be reported as landing pages in Google Analytics?

In Google Analytics I have thousands of landing pages reported, however on checking some of them they aren't indexed in Google, this is expected as the have robots NOINDEX tag in the source code. So ...
1
vote
3answers
37 views

Older post not indexed, new post indexed right away?

I have a post I created yesterday that was indexed rather quickly by Google. However, I have two other post that I created within the past 4 days that are not indexed and I cannot find a trace of ...
1
vote
2answers
61 views

How to know that my site is getting index/rank by search engine

As per subject, anyone can tell me how to check that my site is getting index/rank by search engine(e.g. google, yahoo)?
1
vote
2answers
368 views

Why won't title attributes get indexed in Google?

When I search for Ride On + my site's name, I see that it's indexed. But when I search for Green Horse + my site's name, I don't see my site appearing in the results anywhere! Here's my code: ...
24
votes
5answers
3k views

Page appears indexed in Google but not findable for any search terms?

(Note that I am going to use screenshots here because I suspect writing about this will change the behavior over time.) If you do a Google search for uiviewcontroller best practices either with ...
12
votes
2answers
2k views

Indexing for Google scholar, which tags to use?

In the "Inclusion Guidelines for Webmasters" for Google Scholar is written under Indexing Guidelines: Google Scholar supports Highwire Press tags (e.g., citation_title), Eprints tags (e.g., ...
7
votes
6answers
2k views

What is Google's policy about separate content on same URLs in mobile and desktop versions?

I'm currently developing a mobile version of my site where users' devices are automatically identified and then displayed either mobile or desktop view of the same URL. For usability purposes, I ...
8
votes
2answers
880 views

Does Google submit HTML forms?

I have a web page, say http://domain/purchase and in this page, I have a web form. User, on submitting this form (which has validation, both client-side and server side and won't be validated until ...
3
votes
2answers
1k views

What does Google do with indexed pages returning 403?

I guess that Google removes already indexed pages that are now returning the HTTP error 403. Unfortunately I can't find any definitive statement on that matter. Do you know the answer?
7
votes
2answers
277 views

Is using URL Rewritting the only way to make sure all pages are cached by Google?

If I keep the pattern (index.php?module=test&param=1) will pages be less likely to be indexed then if I use the pattern (test_param_1.html) ?
5
votes
3answers
305 views

Best approach to have Google index content primarily generated by Javascript

I'm developing an app where customers can drop in a Javascript tag onto their website, and it will generate content. What is the best approach to have Google index this content and associate it with ...
4
votes
3answers
251 views

Why is the number of pages on my website indexed by Googlebot decreasing?

I am monitoring the number of pages indexed by Googlebot for one of my websites . I noticed that since last week, the number of pages has dropped by about 60 or so. Now to be fair, I have not added ...
3
votes
1answer
319 views

I used rel=“canonical” and hreflang=“x-default”, but global site is missing and receiving “no return tags” error

Here is a sample of the code <link rel="canonical " href="http://www.kaspersky.com/anti-virus-trial" hreflang="en" /> <link rel="alternate" ...
2
votes
2answers
148 views

No description for any page on the website is available in Google despite robots.txt allowing crawling

I seem to have the weirdest issue with Search Engine Optimization, and I asked the IT folks at my university, I asked people on Joomla forums and I am trying to sort this issue out using Google ...
4
votes
5answers
399 views

With Robots.txt disallow all, why was my site still getting traffic?

In failing to check my robots.txt on a community site, it had: User-agent: * Disallow: / I only clued into this because of a message in my AdSense account saying that five URL's couldn't be ...
4
votes
3answers
458 views

“X-Robots-Tag: noindex” on an HTTP 301 response

I understand that a resource with X-Robots-Tag: noindex forces some search engines, including Google, not to index the resource further. I also understand that an HTTP 301 response causes search ...
4
votes
3answers
2k views

Why are URLs with my domain name at the end showing up in analytics?

I have a multi-language WordPress site that has been live since the last 3 months and today when I checked Analytics, I saw a lot of weird URLs: ...
4
votes
2answers
304 views

Is it possible to find out whether one given page has been indexed?

When one submits sitemaps in Google Webmaster, Google may not index all pages of your site/blog. Is there a way to find out whether one specific page belonging to the sitemap has been indexed or not? ...
3
votes
2answers
98 views

How can I get Google to index content that is written into the page with JavaScript?

I have a website that focuses on charts and graphs. The graphs on the site are drawn using JavaScript, but contain keywords that I would like to have indexed. For example, here is a screenshot of ...
3
votes
1answer
115 views

Should paginated sites be included in sitemap?

My website is ad listing for boats, boats' engines, boat rentals, etc (www.mynautics.com). There are ads listed on multiple pages. I have finished (not jet seen on link above) pagination: added ...
3
votes
3answers
980 views

How to let Google know that content on the page has just changed?

I'd never thought of such a problem in the whole SEO spectrum before I considered launching my own website. Imagine that I have a website which is updated once per month and Google spider knows ...
3
votes
3answers
306 views

Changed my blog's URL: what next?

I started working on a blog from last month. My blogs URL was quite big (for ex. http://my-old-long-url-blog.blogspot.com). I used it because I thought having 2-3 keywords in my URL will help me (I am ...
3
votes
1answer
113 views

How can I force a certain URL for Google to use in search results?

Each page on my site can be accessed by a shortened URL and normal "long" URLs. The shortened URL redirects to the long URL and the long URL includes an optional title that's not parsed (much like on ...
2
votes
2answers
123 views

problem showing my website correctly in search engines

I have a website which i have indexed on google for example (like 15 days ago). some of my pages pass arguments like: http://www.bla.com/products.php?pro=bla&page=view suddently i saw that ...
2
votes
3answers
152 views

Site not indexed by Google [duplicate]

I typed the following on Google: (1) site: uniquevolve.com (2) site: uniquevolve.com.au Only (2) gets indexed. Is this normal? The strange thing is, my Website is actually hosted on the server with ...
1
vote
3answers
52 views

Preserving search engine rankings when old domain name is lost

We have a client with the unfortunate situation of losing access to their current domain name "A". We've just finished finished setting their website up on domain "B". Both websites on "A" and "B" ...
1
vote
1answer
116 views

How do search engines index XML-based websites?

I'm talking about the kind that transforms XML into (X)HTML on the client side. We all know that search engines use semantics in HTML (headings, links) to rank your website. So if you don't already ...
1
vote
1answer
149 views

How to disallow indexing but allow crawling?

In the front page of my website, I have some previews to articles (with a small introduction to them) that link to the full articles. I want to disallow the front page to prevent duplicate content. ...
0
votes
1answer
135 views

Need Google to recrawl the pages

I've changed the meta description tag in many of my site pages. Should I select Fetch as Google->Fetch->Add to Index->URL and all linked pages in GWT? Will Google recrawl the whole site faster than ...