Common value for a HTML robots meta tag.

learn more… | top users | synonyms

6
votes
1answer
1k views

About the <link rel=“index” /> tag

I'm trying to figure out how to use it. I understand that this tag tell Google which page is the root parent / parent of the current page. So, for example, on a page that's listing a product from a ...
3
votes
2answers
174 views

Should i noindex low/quality duplicate content tag pages?

Google have indexed 300k tag pages of my site, these are automatically generated based on the words on the title of each entry so it's likely to see pages which doesn't make much sense like: www....
1
vote
1answer
10 views

Does it hurt for domain A to link to a NOINDEX page at domain B?

Two pages A and B are at two different domains: Page A links to page B. After a while, I decided to mark page B NOINDEX using meta robots "noindex, follow". Do I have to add rel=nofollow to page A ...
5
votes
3answers
97 views

Does the Title and meta description for noindex pages influence SEO ranking in any way for the rest of the indexed pages?

I have a bunch of pages set on noindex. Does the title on these pages influence ranking or SEO factors in any way for the rest of the indexed pages? Or can I leave them using generic title?
1
vote
1answer
121 views

Googlebot follows rel=“nofollow” links

I would like to hide all pages of our website from being read or indexed by Googlebot, except several thousand of pages which were selected for indexing. The site was launched in April 2015. The ...
2
votes
1answer
33 views

Should I nofollow and/or noindex links that are not cached?

I have a Magento store with what they call a layered navigation. Basically a menu with links to things like color, price, etc. I'm currently not caching these links, and so their response time is ...
2
votes
1answer
13 views

Does title and description matter if a page is not to be indexed?

Does a meta-description and a title tag has any significance in a page that is marked to not be indexed (either via a rel=canonical pointing to another URL or noindex)? For example, I have a tutorial ...
1
vote
1answer
33 views

Is the “meta-description” tag required when “meta-robots” is set to noindex?

I am using <meta name="robots" content="noindex"> for few pages that are not supposed to be displayed in any search results. I know how important is the meta-description tag for SEO. Is it ...
0
votes
1answer
22 views

Will meta setting Meta=“NOINDEX” eventually remove page from google index?

I am in the process of moving domains I still have alot of visitors coming to old domain (who are familiar with brand) so dont completely want to 301 it, but I would like pages from the old site to ...
4
votes
1answer
56 views

URL in sitemap with temporary/dynamic noindex

Our scenario is we've got multiple pages set up for category-based browsing, such as example.com/products/boardgames A list of the canonical URLs for the categories is in the sitemap, with a frequency ...
4
votes
0answers
50 views

Use of no-index-meta-tag on pretty URLs?

By now I am fighting through the world of SEO and run into a problem, I think. Let's say I have a page like www.example.com/i-am-a-pretty-url, which is re-written by .htaccess from i-am-ugly-url.php ...
1
vote
1answer
53 views

Disable indexing of specific Images or based on size

I am working on a project where I need to disable specific images from Google indexing, or disable based on their size. I do not have any idea other than adding this code in robots.txt: User-agent: ...
3
votes
1answer
87 views

Should I remove Google indexed pages before requesting a review after thin content manual action

Following on from my previous question - NOINDEX large number of pages to fix Google thin content manual action? Firstly, If I noindex all pages causing the manual action, is that enough for me to ...
1
vote
3answers
156 views

SEO for ecommerce site with no product description and large inventory

We are building a ecommerce with a inventory of about 6000 products, the problem is most of the products have the same description so we decided to keep description as noindex and make it available to ...
1
vote
1answer
13 views

can the x-robots instruction noindex be good enough to declare duplicate content?

I still have a feeling that at least one search engine in the entire world does not support rel-canonical like google does. On top of that, rel-canonical offers less flexibility especially when ...
3
votes
2answers
41 views

Should I tag bad content with noindex?

I have a site with a lot of use generated content. Users can down and upvote content of other users. Ratings can be negative. More or less SE style. Should I add avoid indexing bad content? (ugc with ...
0
votes
1answer
218 views

<meta name=“robots” content=“noindex”> in “Fetch as Google”

I don't know why but when I execute "fetch as Google" it returns me HTTP/1.1 200 OK Cache-Control: private Content-Type: text/html Content-Encoding: gzip Vary: Accept-Encoding Server: Microsoft-IIS/...
4
votes
4answers
2k views

Any good reason to noindex /page/2/ in archives?

In the Wordpress SEO plugin by Yoast, there is an option that could noindex the subpages of archives. From example, it would noindex the following: http://mysite.com/page/2/ http://mysite.com/page/3/ ...
2
votes
1answer
43 views

if an HTTP page can be cached by proxy should I put “noindex” in the HTTPS version or not?

I have a Blog where each page have a static version served with dynamic url mysite.com/mypage?logged=false over HTTP, and a dynamic version served with dynamic url mysite.com/mypage?logged=true over ...
1
vote
1answer
40 views

Preventing some parts of the pages of a site from being indexed [duplicate]

My website has links like: <a href="messages.aspx">Messages<span>3</span></a> Well google indexes these links as: Messages3 I have read some articles for preventing google ...
6
votes
1answer
1k views

Do noindex,follow pages pass pagerank / link juice?

Assuming one marks a page as 'noindex,follow', is PageRank / link juice passed to other pages nevertheless?
0
votes
0answers
82 views

SEO: Deindex member profile pages?

I have a forum where users can register and automatically a profile page is created, like here in Stackexchange. The problem with these pages is that sometimes users creates accounts at different ...
2
votes
1answer
59 views

Should Portfolio pages about web development use noindex?

My site includes a Portfolio, and one category is Web Development. There, I have pages for some sites that I developed. The question is, should I allow those pages to be indexed by search engines? ...
0
votes
0answers
15 views

Why does my staging site show up in Google even though my robots.txt file shouldn't allow it? [duplicate]

I'm having a lot of trouble with something that should be simple. I don't want my development site indexed by Google. According to Google's instructions, and just about everything else I can find says ...
1
vote
2answers
426 views

Should you noidex paginated pages or use rel=next/rel=prev

On out site we use pagination in two places: 1) Category Pages We have our articles segmented by category and each category has 100's of articles so we paginate at 10 articles per page. We use the ...
3
votes
2answers
314 views

NOINDEX large number of pages to fix Google thin content manual action?

I've just been hit with a site wide manual spam action on Google due to a significant percentage of 'Thin content with little or no added value'. I have a large number of posts that are affiliate ...
6
votes
1answer
140 views

How does “Noindex:” in robots.txt work?

I ran across this article in my SEO news today. It seems to imply that you can you use Noindex: directives in addition to the standard Disallow: directives in robots.txt. Disallow: /page-one.html ...
1
vote
0answers
28 views

noindex all posts and doindex all tags

I have a Tumblr-style picture blog running on WordPress. The blog has only one picture per post, and thousands of pics all tagged. Let's pretend its all pics of cars; each post has one pic of a car, ...
0
votes
2answers
73 views

How do search engines behave when encountering noindex?

I have a question about the behaviour of search engines when they encounter meta name="robots" content="noindex" If I use the meta tag format of robots, I know that search engines will not index the ...
4
votes
3answers
9k views

How to stop certain urls from being indexed

When I type site:example.com(using my domain obviously), I get several link errors showing up in the listing. Typically, they are of the form: /some/fixed/path/admin/unblockUser/11 I am thinking of ...
0
votes
2answers
39 views

rel=canonical for archive pages

I'm trying to figure what is the correct use of rel=canonical in case of archive pages (be it date, author, category etc). Basically, I want them indexed but nofollowed noindexed but followed, as ...
1
vote
2answers
28 views

How can we deal with thin content pages with fluctuating content?

We have identified a large number of pages on our e-commerce site which we are sure will be considered thin content. These pages are categories of products which have "0 products" in them. The issue ...
0
votes
1answer
19 views

Removing/Adding Google Listings

I have a site with user generated pages where the user can make their page "published" or "unpublished". My problem is, their pages are often indexed high on Google (usually in the top 3) and so when ...
2
votes
1answer
143 views

Noindex metatag in alternate mobile version of page with canonical to desktop… What consequences?

I have a desktop site to serve content for desktop and tablet users. I also have a mobile version of the site to cater to mobile phone visitors. Desktop pages have the following kind of annotations ...
0
votes
1answer
152 views

What are the reasons for using the meta tag “noindex, follow”?

Besides using the meta tag for hiding, say, the sitemap to prevent your site appearing spammy, are there any other situations for using noindex, follow?
4
votes
8answers
768 views

Should I block indexing of my mobile site?

I notice that Yahoo and Bing have started indexing the mobile version of my website, which is located at /mobile from the root. All of the mobile content is just a reduced layout version of the real ...
0
votes
0answers
16 views

Google Indexed demo site with same content [duplicate]

I have two server one is production abc.com other demo.abc.com problem is Google has indexed the demo server as well. What is fastest possible fix to it and to remove it from Google index? What ...
0
votes
1answer
54 views

Will the noindex Meta stop page indexing but still allow crawling

We have a property site that contains approximately 5000 properties. The search facility and subsequent Filter mechanism has resulted in Google indexing over 400 000 pages. Question: Will adding ...
0
votes
0answers
195 views

X-Robots-Tag: noindex on an HTTP 302 response to remove subdomain

This very related to this question "X-Robots-Tag: noindex" on an HTTP 301 response, however I don't see a definitive answer. We have subdomains we use for our affiliate links, the ...
1
vote
2answers
1k views

Should I use “Disallow”, “NoFollow”, or “NoIndex” for paginated listing pages?

I own a web site which has mainly two types of pages: Content pages: they are pretty much static, and link to the previous and next content page (chronologically). The structure is that of a double ...
1
vote
1answer
82 views

Would adding noindex on index.html stop main domain from being indexed?

For various reasons, I don't want my domain.com/index.html from being indexed because I have the same file with the same content but called domain.com/home.html instead. Now I added the noindex meta ...
1
vote
1answer
145 views

Block search engines from the main domain while allowing add-on domains to rank well

I have a shared hosting account with a main domain and many add-on domains. I don't actually use the main domain, it just has a landing page. Can I tell bots not to index the main domain WITHOUT ...
2
votes
1answer
55 views

How to do SEO for a business listing website that contains temporarily available content

I am building a business directory page where the user can filter through locations and different branches. The directory uses a freemium-model which means that the basic listings are completely free ...
2
votes
1answer
123 views

Robots.txt vs. Noindex Tags

According to matt cutts, even though we block the page using Robots.txt , it is better using noindex tag. ( Source : https://www.youtube.com/watch?v=KBdEwpRQRD0) If it is blocked by Robots.txt, how ...
2
votes
1answer
48 views

should you let search result page to be indexed

I have a pages of a catalogs, which contains a list of keywords of all products inside that catalogs, and I want to create a link from those keywords to a search page. For example, if the page ...
1
vote
2answers
122 views

Should I nofollow a link to a noindex page?

If I have a page on my blog that is marked noindex or blocked by robots.txt should I mark all links within my blog that point to that page as rel="nofollow" or not? Example: I publish a post on my ...
0
votes
3answers
55 views

Is Google indexing pages that has no connection with other pages? [duplicate]

I am working on a web project that has nearly 100 thousand instant users and there is a webpage that we are using for test cases. There are no links pointing to it from other pages. It shouldn't be ...
1
vote
1answer
237 views

Is it possible to regain a site's traffic after losing some to a transfer / merge?

After merging two sites to a third, using proper 301 redirects and transferring the domains in Google webmaster tools, overall traffic dropped by ~50%. One of the original sites was getting a plenty ...
1
vote
2answers
130 views

What is the empirical way to tell that Google has removed a URL from the index?

After merging two sites, one with ~40 URLs and one with ~700 URLs (due to a forum) the result was that overall traffic decreased by ~50%. I want to get the traffic back, as it was organic and a ...
3
votes
1answer
224 views

Is adding noindex for new product pages a good idea?

When adding batch products to an eCommerce website, is it a good idea to initially have noindex on the product page? After manually reviewing individual products, should I remove the noindex tag? ...