Common value for a HTML robots meta tag.

learn more… | top users | synonyms

2
votes
1answer
30 views

Missing from Google [duplicate]

Recently I noticed our site no longer appeared in Google search results. Our site has be in Google for the last 3 years without any issues. So far I've check: In the Web Master tools it says there ...
2
votes
2answers
140 views

Penalized website using noindex,follow

This is an interesting question I was wondering if anyone had any experience with. If a website is penalized for a keyword because of excessive spam links pointing to the homepage with said keyword ...
5
votes
2answers
287 views

Recovery from accidental noindex of site

I've recently noticed that an entire site I manage had been set to noindex for about 3 weeks. This has caused the entire site to be completely dropped from Google's index (searching "site:" and then ...
1
vote
1answer
145 views

Block search engines from the main domain while allowing add-on domains to rank well

I have a shared hosting account with a main domain and many add-on domains. I don't actually use the main domain, it just has a landing page. Can I tell bots not to index the main domain WITHOUT ...
2
votes
2answers
2k views

Will 301 redirection to a Google Indexed URL can remove the URL from Google index?

I need to remove some indexed URLs from Google SERP. The problem is I cannot use the 3 types of removal patterns Google suggests like robots.txt, meta name "noindex" and remove the page and make it as ...
3
votes
4answers
2k views

Google Indexing Pages with noindex meta tag

I got a message in Google Webmaster Tools about "Googlebot found an extremely high number of URLs on your site" with a long list of example URLs. For some of the pages listed, there was nothing to ...
2
votes
1answer
186 views

Set Up Subdomain For Demo Application. Index Or NoIndex?

I run a blog for programming and development tutorials. I am planning to set up a subdomain and host my exercises there for the visitors so that, they can experience the tutorials/ code examples in a ...
6
votes
4answers
4k views

Hide a Subdomain from Google/Search Engine SEO Result?

I have a subomain which I do not want to be listed in any search engine result. Let say I have: http://www.example.com http://child.example.com How can I hide all URLs of child.example.com domain ...
1
vote
2answers
462 views

Googlebot fetches my pages very frequent, rel-nofollow, meta-noindex or robots.txt-disallow

Googlebot fetches pages in my site very frequently. And this slowens my website. I don't want Googlebot to crawl too frequent. I decreased crawl rate from Google webmaster tools. But I'm supposing to ...
0
votes
2answers
125 views

SEO for ecommerce site with no product description and large inventory

We are building a ecommerce with a inventory of about 6000 products, the problem is most of the products have the same description so we decided to keep description as noindex and make it available to ...
1
vote
2answers
193 views

Is it a good idea to add robots “noindex” meta tags to deep low content pages, e.g. product model data

I'm considering adding robots "noindex, follow" tags to the very numerous product data pages that are linked from the product style pages in our online store. For example, each product style has a ...
2
votes
1answer
223 views

Should I use nodindex, follow or rel canonical?

I have a site that lists offers, promotions from other websites. Since the offers expire rather quickly I don't save them into my database. I see no point in having a page from 2010 about 30% ...
0
votes
1answer
344 views

Noindex, Nofollow affect “Google Custom Search” results?

I am using Google Custom Search on my site, if I set pages to "noindex" or "nofollow", does it also affect the custom search results on my site?
1
vote
1answer
795 views

Managing 404 error pages with noindex and url rewrite

Currently I use custom 404 error pages, having the following meta on them : <meta content="noindex" name="robots"> My guess is this way Google will remove deleted pages faster from the index, ...
4
votes
1answer
236 views

Using rel=canonical and noindex in a 1-n partners environment

We sell complete sites including the domains to several partners that create content that is shown together at the main site. What we want to achieve is that the main site copy is the original but the ...
1
vote
2answers
242 views

Google is not indexing my pages [duplicate]

I just typed a post title from a few days ago into Google with "quotes" around it and nothing is showing up. Does Google hate me? I am doing nothing but white hat marketing and even took down the ...
2
votes
2answers
220 views

Google won't display site [closed]

My website (http://markasoftware.getenjoyment.net) doesn't seem to be indexed properly by Google (I haven't tried other search engines). When I type in the URL of my site it appears right at the top ...
0
votes
1answer
129 views

Hiding a particulat page from search engines not to index [duplicate]

Possible Duplicate: Blocking Search Engines to Crawl Parts of a Website? I have a page which i don't want search engines to index or crawl. I am not sure hat should i put in my robots.txt ...
3
votes
2answers
128 views

Not index page that doesn't have relevant content?

I have a large software website and on each application we let users add comments, reviews and so on. Each of these pages are called for example "Comments About Firefox", "Firefox Reviews" and so on. ...
3
votes
1answer
888 views

Is 'noindex, follow' a good idea for blog's index page?

I am new to SEO for blogs (to be more precise WordPress). I wanted to only page with a single article to be indexed. This is not because I am afraid of duplicate content, but because I am afraid a ...
1
vote
1answer
207 views

I want the links in my HTML sitemap to be crawled but I do not want the sitemap in the SERPs

I have a website that has some pages and then it has a folder that has the majority of the pages. All the pages that exist in this folder could only be accessed by using my website search engine, then ...
0
votes
1answer
284 views

If I use “noindex” on my blogs category pages should I add “nofollow” to the posts inside that category

Lets say I will use "noindex" on my blogs category pages Each post has breadcrumb navigation like: Home > Category Name > Post Name If category has no index, I should add a rel="nofollow" to the ...
1
vote
2answers
72 views

SEO: How to stop certain web-pages from “having importance” [duplicate]

Possible Duplicate: SEO - Reducing significance of irrelevant kewords. I wrote "having importance" since I do not really know the right way to say this. I have certain pages in my site ...
3
votes
3answers
707 views

Google is indexing unintended content that is either unpublished or a secret part of site

Google is indexing parts of my site that I haven't linked to, it's a mobile version of website that I'm working on - www.domain.com/m/ <-- note the M. How is that even possible? Only thing I can ...
4
votes
8answers
751 views

Should I block indexing of my mobile site?

I notice that Yahoo and Bing have started indexing the mobile version of my website, which is located at /mobile from the root. All of the mobile content is just a reduced layout version of the real ...
4
votes
2answers
567 views

Should I prevent search engines indexing tag/category pages?

On my site, I currently have no special rules for search engines. It is a blog, statically generated using a Python program. When I search for some of my articles on Google, there is usually a tag or ...
1
vote
3answers
928 views

SEO: Duplicate content caused by pagination/tag/index pages [duplicate]

Possible Duplicate: What is duplicate content and how can I avoid being penalized for it on my site? I read that I should use a NoIndex tag for transitional pages like index, pagination, or ...
4
votes
3answers
8k views

How to stop certain urls from being indexed

When I type site:example.com(using my domain obviously), I get several link errors showing up in the listing. Typically, they are of the form: /some/fixed/path/admin/unblockUser/11 I am thinking of ...