Common value for a HTML robots meta tag.

learn more… | top users | synonyms

6
votes
4answers
4k views

Hide a Subdomain from Google/Search Engine SEO Result?

I have a subomain which I do not want to be listed in any search engine result. Let say I have: http://www.example.com http://child.example.com How can I hide all URLs of child.example.com domain ...
1
vote
2answers
450 views

Googlebot fetches my pages very frequent, rel-nofollow, meta-noindex or robots.txt-disallow

Googlebot fetches pages in my site very frequently. And this slowens my website. I don't want Googlebot to crawl too frequent. I decreased crawl rate from Google webmaster tools. But I'm supposing to ...
0
votes
2answers
123 views

SEO for ecommerce site with no product description and large inventory

We are building a ecommerce with a inventory of about 6000 products, the problem is most of the products have the same description so we decided to keep description as noindex and make it available to ...
1
vote
2answers
191 views

Is it a good idea to add robots “noindex” meta tags to deep low content pages, e.g. product model data

I'm considering adding robots "noindex, follow" tags to the very numerous product data pages that are linked from the product style pages in our online store. For example, each product style has a ...
2
votes
1answer
222 views

Should I use nodindex, follow or rel canonical?

I have a site that lists offers, promotions from other websites. Since the offers expire rather quickly I don't save them into my database. I see no point in having a page from 2010 about 30% ...
0
votes
1answer
333 views

Noindex, Nofollow affect “Google Custom Search” results?

I am using Google Custom Search on my site, if I set pages to "noindex" or "nofollow", does it also affect the custom search results on my site?
1
vote
1answer
770 views

Managing 404 error pages with noindex and url rewrite

Currently I use custom 404 error pages, having the following meta on them : <meta content="noindex" name="robots"> My guess is this way Google will remove deleted pages faster from the index, ...
4
votes
1answer
236 views

Using rel=canonical and noindex in a 1-n partners environment

We sell complete sites including the domains to several partners that create content that is shown together at the main site. What we want to achieve is that the main site copy is the original but the ...
1
vote
2answers
242 views

Google is not indexing my pages [duplicate]

I just typed a post title from a few days ago into Google with "quotes" around it and nothing is showing up. Does Google hate me? I am doing nothing but white hat marketing and even took down the ...
2
votes
2answers
218 views

Google won't display site [closed]

My website (http://markasoftware.getenjoyment.net) doesn't seem to be indexed properly by Google (I haven't tried other search engines). When I type in the URL of my site it appears right at the top ...
0
votes
1answer
128 views

Hiding a particulat page from search engines not to index [duplicate]

Possible Duplicate: Blocking Search Engines to Crawl Parts of a Website? I have a page which i don't want search engines to index or crawl. I am not sure hat should i put in my robots.txt ...
3
votes
2answers
127 views

Not index page that doesn't have relevant content?

I have a large software website and on each application we let users add comments, reviews and so on. Each of these pages are called for example "Comments About Firefox", "Firefox Reviews" and so on. ...
3
votes
1answer
856 views

Is 'noindex, follow' a good idea for blog's index page?

I am new to SEO for blogs (to be more precise WordPress). I wanted to only page with a single article to be indexed. This is not because I am afraid of duplicate content, but because I am afraid a ...
1
vote
1answer
202 views

I want the links in my HTML sitemap to be crawled but I do not want the sitemap in the SERPs

I have a website that has some pages and then it has a folder that has the majority of the pages. All the pages that exist in this folder could only be accessed by using my website search engine, then ...
0
votes
1answer
281 views

If I use “noindex” on my blogs category pages should I add “nofollow” to the posts inside that category

Lets say I will use "noindex" on my blogs category pages Each post has breadcrumb navigation like: Home > Category Name > Post Name If category has no index, I should add a rel="nofollow" to the ...
1
vote
2answers
72 views

SEO: How to stop certain web-pages from “having importance” [duplicate]

Possible Duplicate: SEO - Reducing significance of irrelevant kewords. I wrote "having importance" since I do not really know the right way to say this. I have certain pages in my site ...
3
votes
3answers
681 views

Google is indexing unintended content that is either unpublished or a secret part of site

Google is indexing parts of my site that I haven't linked to, it's a mobile version of website that I'm working on - www.domain.com/m/ <-- note the M. How is that even possible? Only thing I can ...
4
votes
8answers
742 views

Should I block indexing of my mobile site?

I notice that Yahoo and Bing have started indexing the mobile version of my website, which is located at /mobile from the root. All of the mobile content is just a reduced layout version of the real ...
4
votes
2answers
561 views

Should I prevent search engines indexing tag/category pages?

On my site, I currently have no special rules for search engines. It is a blog, statically generated using a Python program. When I search for some of my articles on Google, there is usually a tag or ...
1
vote
3answers
922 views

SEO: Duplicate content caused by pagination/tag/index pages [duplicate]

Possible Duplicate: What is duplicate content and how can I avoid being penalized for it on my site? I read that I should use a NoIndex tag for transitional pages like index, pagination, or ...
3
votes
3answers
8k views

How to stop certain urls from being indexed

When I type site:example.com(using my domain obviously), I get several link errors showing up in the listing. Typically, they are of the form: /some/fixed/path/admin/unblockUser/11 I am thinking of ...