Common value for a HTML robots meta tag.

learn more… | top users | synonyms

7
votes
4answers
6k views

Hide a Subdomain from Google/Search Engine SEO Result?

I have a subomain which I do not want to be listed in any search engine result. Let say I have: http://www.example.com http://child.example.com How can I hide all URLs of child.example.com domain ...
6
votes
4answers
2k views

Should I set NOINDEX header for my JS, CSS and image files?

Are there any harms if my site send NOINDEX headers for all my static assets? For image files, I refer to those valueless, e.g. background images, button images, etc. Update: more background ...
6
votes
1answer
1k views

Do noindex,follow pages pass pagerank / link juice?

Assuming one marks a page as 'noindex,follow', is PageRank / link juice passed to other pages nevertheless?
6
votes
1answer
142 views

How does “Noindex:” in robots.txt work?

I ran across this article in my SEO news today. It seems to imply that you can you use Noindex: directives in addition to the standard Disallow: directives in robots.txt. Disallow: /page-one.html ...
6
votes
1answer
1k views

About the <link rel=“index” /> tag

I'm trying to figure out how to use it. I understand that this tag tell Google which page is the root parent / parent of the current page. So, for example, on a page that's listing a product from a ...
5
votes
3answers
97 views

Does the Title and meta description for noindex pages influence SEO ranking in any way for the rest of the indexed pages?

I have a bunch of pages set on noindex. Does the title on these pages influence ranking or SEO factors in any way for the rest of the indexed pages? Or can I leave them using generic title?
5
votes
2answers
373 views

Recovery from accidental noindex of site

I've recently noticed that an entire site I manage had been set to noindex for about 3 weeks. This has caused the entire site to be completely dropped from Google's index (searching "site:" and then ...
4
votes
3answers
9k views

How to stop certain urls from being indexed

When I type site:example.com(using my domain obviously), I get several link errors showing up in the listing. Typically, they are of the form: /some/fixed/path/admin/unblockUser/11 I am thinking of ...
4
votes
1answer
4k views

How do I stop Soft 404 errors from piling up for “No Results” page?

Recently, I noticed that I have a growing list of Soft 404 errors in Google Webmaster Tools. They are all for dynamically generated search result pages that report "No matches found". I do understand ...
4
votes
8answers
768 views

Should I block indexing of my mobile site?

I notice that Yahoo and Bing have started indexing the mobile version of my website, which is located at /mobile from the root. All of the mobile content is just a reduced layout version of the real ...
4
votes
2answers
590 views

Should I prevent search engines indexing tag/category pages?

On my site, I currently have no special rules for search engines. It is a blog, statically generated using a Python program. When I search for some of my articles on Google, there is usually a tag or ...
4
votes
4answers
2k views

Any good reason to noindex /page/2/ in archives?

In the Wordpress SEO plugin by Yoast, there is an option that could noindex the subpages of archives. From example, it would noindex the following: http://mysite.com/page/2/ http://mysite.com/page/3/ ...
4
votes
1answer
56 views

URL in sitemap with temporary/dynamic noindex

Our scenario is we've got multiple pages set up for category-based browsing, such as example.com/products/boardgames A list of the canonical URLs for the categories is in the sitemap, with a frequency ...
4
votes
1answer
237 views

Using rel=canonical and noindex in a 1-n partners environment

We sell complete sites including the domains to several partners that create content that is shown together at the main site. What we want to achieve is that the main site copy is the original but the ...
4
votes
0answers
52 views

Use of no-index-meta-tag on pretty URLs?

By now I am fighting through the world of SEO and run into a problem, I think. Let's say I have a page like www.example.com/i-am-a-pretty-url, which is re-written by .htaccess from i-am-ugly-url.php ...
3
votes
4answers
944 views

Why doesn't Google remove my noindex and 404 pages?

I've added 404 error codes and no-index meta tag to pages quite some time ago. However, when I check in Google Webmaster Tools, looking at the graph of "removed" pages from their index, I see very low ...
3
votes
4answers
2k views

Google Indexing Pages with noindex meta tag

I got a message in Google Webmaster Tools about "Googlebot found an extremely high number of URLs on your site" with a long list of example URLs. For some of the pages listed, there was nothing to ...
3
votes
3answers
840 views

Google is indexing unintended content that is either unpublished or a secret part of site

Google is indexing parts of my site that I haven't linked to, it's a mobile version of website that I'm working on - www.domain.com/m/ <-- note the M. How is that even possible? Only thing I can ...
3
votes
2answers
316 views

NOINDEX large number of pages to fix Google thin content manual action?

I've just been hit with a site wide manual spam action on Google due to a significant percentage of 'Thin content with little or no added value'. I have a large number of posts that are affiliate ...
3
votes
2answers
176 views

Should i noindex low/quality duplicate content tag pages?

Google have indexed 300k tag pages of my site, these are automatically generated based on the words on the title of each entry so it's likely to see pages which doesn't make much sense like: www....
3
votes
1answer
224 views

Is adding noindex for new product pages a good idea?

When adding batch products to an eCommerce website, is it a good idea to initially have noindex on the product page? After manually reviewing individual products, should I remove the noindex tag? ...
3
votes
1answer
984 views

Is 'noindex, follow' a good idea for blog's index page?

I am new to SEO for blogs (to be more precise WordPress). I wanted to only page with a single article to be indexed. This is not because I am afraid of duplicate content, but because I am afraid a ...
3
votes
2answers
41 views

Should I tag bad content with noindex?

I have a site with a lot of use generated content. Users can down and upvote content of other users. Ratings can be negative. More or less SE style. Should I add avoid indexing bad content? (ugc with ...
3
votes
1answer
87 views

Should I remove Google indexed pages before requesting a review after thin content manual action

Following on from my previous question - NOINDEX large number of pages to fix Google thin content manual action? Firstly, If I noindex all pages causing the manual action, is that enough for me to ...
3
votes
2answers
132 views

Not index page that doesn't have relevant content?

I have a large software website and on each application we let users add comments, reviews and so on. Each of these pages are called for example "Comments About Firefox", "Firefox Reviews" and so on. ...
2
votes
4answers
455 views

Why would you ever use NOINDEX without NOFOLLOW

Everytime I've used the NOINDEX directive on a page, it made sense to use NOFOLLOW as well. I can't imagine a scenario where you would not want a page indexed, but would want the links inside it to be....
2
votes
2answers
559 views

Does noindex metatag have a negative effect on the canonical URLs PageRank?

A page has this URL: http://example.com/pages/some-page/ There's a pagination on this page which uses a GET parameter page which would result in URLs like: http://example.com/pages/some-page/?page=...
2
votes
3answers
987 views

SEO: Duplicate content caused by pagination/tag/index pages [duplicate]

Possible Duplicate: What is duplicate content and how can I avoid being penalized for it on my site? I read that I should use a NoIndex tag for transitional pages like index, pagination, or ...
2
votes
2answers
784 views

How much Google takes to deindex pages after disallowed from robots?

By accident I have let Google index lots of junk pages. Now I have added them to disallow in robots.txt. Will Google completely remove the pages after seeing the are disallowed from robots? Please ...
2
votes
2answers
222 views

Google won't display site [closed]

My website (http://markasoftware.getenjoyment.net) doesn't seem to be indexed properly by Google (I haven't tried other search engines). When I type in the URL of my site it appears right at the top ...
2
votes
1answer
43 views

if an HTTP page can be cached by proxy should I put “noindex” in the HTTPS version or not?

I have a Blog where each page have a static version served with dynamic url mysite.com/mypage?logged=false over HTTP, and a dynamic version served with dynamic url mysite.com/mypage?logged=true over ...
2
votes
1answer
55 views

How to do SEO for a business listing website that contains temporarily available content

I am building a business directory page where the user can filter through locations and different branches. The directory uses a freemium-model which means that the basic listings are completely free ...
2
votes
1answer
124 views

Robots.txt vs. Noindex Tags

According to matt cutts, even though we block the page using Robots.txt , it is better using noindex tag. ( Source : https://www.youtube.com/watch?v=KBdEwpRQRD0) If it is blocked by Robots.txt, how ...
2
votes
1answer
48 views

should you let search result page to be indexed

I have a pages of a catalogs, which contains a list of keywords of all products inside that catalogs, and I want to create a link from those keywords to a search page. For example, if the page ...
2
votes
2answers
68 views

Can I benefit from links to pages on my site which have a `noindex` meta tag?

I'm trying to understand if/how I can benefit from people linking to pages on my site which are with pages that have a noindex meta tag. 2 actions I'm considering to perform: Remove the robots.txt ...
2
votes
1answer
143 views

How to prevent Google showing documents directly in the SERPs?

I've many useful docs in my website and we know that Google has got smart enough already - that if the document serves visitor's purpose then it directly lists it in the SERP without listing the page ...
2
votes
1answer
31 views

Missing from Google [duplicate]

Recently I noticed our site no longer appeared in Google search results. Our site has be in Google for the last 3 years without any issues. So far I've check: In the Web Master tools it says there ...
2
votes
1answer
143 views

Noindex metatag in alternate mobile version of page with canonical to desktop… What consequences?

I have a desktop site to serve content for desktop and tablet users. I also have a mobile version of the site to cater to mobile phone visitors. Desktop pages have the following kind of annotations ...
2
votes
1answer
495 views

Problem with not found page for feed in Google Webmaster Tools

I have a Wordpress blog. In Google Webmaster Tools, I found mutiple "not found pages" like this from feed: kart-postal/k-imam-zaman/feed/. How can I add noindex to feed and why I get not found page?
2
votes
2answers
156 views

Penalized website using noindex,follow

This is an interesting question I was wondering if anyone had any experience with. If a website is penalized for a keyword because of excessive spam links pointing to the homepage with said keyword ...
2
votes
1answer
228 views

Should I use nodindex, follow or rel canonical?

I have a site that lists offers, promotions from other websites. Since the offers expire rather quickly I don't save them into my database. I see no point in having a page from 2010 about 30% ...
2
votes
1answer
34 views

Should I nofollow and/or noindex links that are not cached?

I have a Magento store with what they call a layered navigation. Basically a menu with links to things like color, price, etc. I'm currently not caching these links, and so their response time is ...
2
votes
1answer
13 views

Does title and description matter if a page is not to be indexed?

Does a meta-description and a title tag has any significance in a page that is marked to not be indexed (either via a rel=canonical pointing to another URL or noindex)? For example, I have a tutorial ...
2
votes
1answer
59 views

Should Portfolio pages about web development use noindex?

My site includes a Portfolio, and one category is Web Development. There, I have pages for some sites that I developed. The question is, should I allow those pages to be indexed by search engines? ...
2
votes
1answer
157 views

How to noindex a 404 page using .htaccess?

I have several 404 not found pages which I would like to noindex through .htaccess. how do I do it with X-Robots-Tag?
2
votes
3answers
357 views

Should category pages be noindex regarding panda?

I have seen this question, but I believe the situation has changed a lot with the recent Panda updates. I have created a set of category pages to facilitate navigation on my site. It is a proper ...
2
votes
1answer
80 views

Avoiding crawl time for noindex pages

I have pages with noindex in robots meta tag (specifically inner site search results pages). Because my site has many pages and Google hasn't crawled them all and I'm trying to help his crawler focus ...
2
votes
2answers
2k views

Will 301 redirection to a Google Indexed URL can remove the URL from Google index?

I need to remove some indexed URLs from Google SERP. The problem is I cannot use the 3 types of removal patterns Google suggests like robots.txt, meta name "noindex" and remove the page and make it as ...
2
votes
1answer
214 views

Set Up Subdomain For Demo Application. Index Or NoIndex?

I run a blog for programming and development tutorials. I am planning to set up a subdomain and host my exercises there for the visitors so that, they can experience the tutorials/ code examples in a ...
1
vote
2answers
55 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...