Common value for a HTML robots meta tag.

learn more… | top users | synonyms

0
votes
1answer
12 views

Removing/Adding Google Listings

I have a site with user generated pages where the user can make their page "published" or "unpublished". My problem is, their pages are often indexed high on Google (usually in the top 3) and so when ...
1
vote
1answer
55 views

Noindex metatag in alternate mobile version of page with canonical to desktop… What consequences?

I have a desktop site to serve content for desktop and tablet users. I also have a mobile version of the site to cater to mobile phone visitors. Desktop pages have the following kind of annotations ...
0
votes
0answers
55 views

Googlebot follows rel=“nofollow” links

I would like to hide all pages of our website from being read or indexed by Googlebot, except several thousand of pages which were selected for indexing. The site was launched in April 2015. The ...
0
votes
0answers
21 views

SEO: Deindex member profile pages?

I have a forum where users can register and automatically a profile page is created, like here in Stackexchange. The problem with these pages is that sometimes users creates accounts at different ...
0
votes
1answer
46 views

What are the reasons for using the meta tag “noindex, follow”?

Besides using the meta tag for hiding, say, the sitemap to prevent your site appearing spammy, are there any other situations for using noindex, follow?
4
votes
8answers
745 views

Should I block indexing of my mobile site?

I notice that Yahoo and Bing have started indexing the mobile version of my website, which is located at /mobile from the root. All of the mobile content is just a reduced layout version of the real ...
0
votes
0answers
15 views

Google Indexed demo site with same content [duplicate]

I have two server one is production abc.com other demo.abc.com problem is Google has indexed the demo server as well. What is fastest possible fix to it and to remove it from Google index? What ...
0
votes
1answer
39 views

Will the noindex Meta stop page indexing but still allow crawling

We have a property site that contains approximately 5000 properties. The search facility and subsequent Filter mechanism has resulted in Google indexing over 400 000 pages. Question: Will adding ...
0
votes
0answers
92 views

X-Robots-Tag: noindex on an HTTP 302 response to remove subdomain

This very related to this question "X-Robots-Tag: noindex" on an HTTP 301 response, however I don't see a definitive answer. We have subdomains we use for our affiliate links, the ...
5
votes
1answer
625 views

Do noindex,follow pages pass pagerank / link juice?

Assuming one marks a page as 'noindex,follow', is PageRank / link juice passed to other pages nevertheless?
2
votes
2answers
1k views

Any good reason to noindex /page/2/ in archives?

In the Wordpress SEO plugin by Yoast, there is an option that could noindex the subpages of archives. From example, it would noindex the following: http://mysite.com/page/2/ http://mysite.com/page/3/ ...
1
vote
2answers
972 views

Should I use “Disallow”, “NoFollow”, or “NoIndex” for paginated listing pages?

I own a web site which has mainly two types of pages: Content pages: they are pretty much static, and link to the previous and next content page (chronologically). The structure is that of a double ...
1
vote
1answer
57 views

Would adding noindex on index.html stop main domain from being indexed?

For various reasons, I don't want my domain.com/index.html from being indexed because I have the same file with the same content but called domain.com/home.html instead. Now I added the noindex meta ...
0
votes
0answers
7 views

Is there a way to block off a single element from web crawlers? [duplicate]

Instead of using a meta no-follow no-index is there a way to block a particular piece of a website, say a span tag from being indexed? For example to include a company name while greatly reducing the ...
1
vote
1answer
145 views

Block search engines from the main domain while allowing add-on domains to rank well

I have a shared hosting account with a main domain and many add-on domains. I don't actually use the main domain, it just has a landing page. Can I tell bots not to index the main domain WITHOUT ...
1
vote
1answer
48 views

How to do SEO for a business listing website that contains temporarily available content

I am building a business directory page where the user can filter through locations and different branches. The directory uses a freemium-model which means that the basic listings are completely free ...
2
votes
1answer
80 views

Robots.txt vs. Noindex Tags

According to matt cutts, even though we block the page using Robots.txt , it is better using noindex tag. ( Source : https://www.youtube.com/watch?v=KBdEwpRQRD0) If it is blocked by Robots.txt, how ...
1
vote
1answer
219 views

Should you noidex paginated pages or use rel=next/rel=prev

On out site we use pagination in two places: 1) Category Pages We have our articles segmented by category and each category has 100's of articles so we paginate at 10 articles per page. We use the ...
2
votes
1answer
42 views

should you let search result page to be indexed

I have a pages of a catalogs, which contains a list of keywords of all products inside that catalogs, and I want to create a link from those keywords to a search page. For example, if the page ...
1
vote
2answers
74 views

Should I nofollow a link to a noindex page?

If I have a page on my blog that is marked noindex or blocked by robots.txt should I mark all links within my blog that point to that page as rel="nofollow" or not? Example: I publish a post on my ...
0
votes
3answers
48 views

Is Google indexing pages that has no connection with other pages? [duplicate]

I am working on a web project that has nearly 100 thousand instant users and there is a webpage that we are using for test cases. There are no links pointing to it from other pages. It shouldn't be ...
1
vote
1answer
140 views

Is it possible to regain a site's traffic after losing some to a transfer / merge?

After merging two sites to a third, using proper 301 redirects and transferring the domains in Google webmaster tools, overall traffic dropped by ~50%. One of the original sites was getting a plenty ...
0
votes
2answers
77 views

What is the empirical way to tell that Google has removed a URL from the index?

After merging two sites, one with ~40 URLs and one with ~700 URLs (due to a forum) the result was that overall traffic decreased by ~50%. I want to get the traffic back, as it was organic and a ...
3
votes
1answer
127 views

Is adding noindex for new product pages a good idea?

When adding batch products to an eCommerce website, is it a good idea to initially have noindex on the product page? After manually reviewing individual products, should I remove the noindex tag? ...
0
votes
2answers
289 views

Having an iframe of which inside the page has a noindex nofollow tag would it affect the rankings of the page having the iframe? Is it cloaking?

We have a website with video content delivered from a video studio and hosted on their site since we don't want to load our server with it. The content we are embedding is payed for and we don't to ...
1
vote
2answers
74 views

What is the proper SEO handling of pages appearing in popups using IFRAMEs?

I am working on a CMS which makes use of IFRAMEs to display some forms, for illustration, say a Search form. So the user clicks the Search button and the website reacts by opening a popup window which ...
2
votes
1answer
120 views

How to noindex a 404 page using .htaccess?

I have several 404 not found pages which I would like to noindex through .htaccess. how do I do it with X-Robots-Tag?
2
votes
2answers
337 views

Does noindex metatag have a negative effect on the canonical URLs PageRank?

A page has this URL: http://example.com/pages/some-page/ There's a pagination on this page which uses a GET parameter page which would result in URLs like: ...
5
votes
4answers
1k views

Should I set NOINDEX header for my JS, CSS and image files?

Are there any harms if my site send NOINDEX headers for all my static assets? For image files, I refer to those valueless, e.g. background images, button images, etc. Update: more background ...
2
votes
2answers
64 views

Can I benefit from links to pages on my site which have a `noindex` meta tag?

I'm trying to understand if/how I can benefit from people linking to pages on my site which are with pages that have a noindex meta tag. 2 actions I'm considering to perform: Remove the robots.txt ...
0
votes
2answers
110 views

Removing existing filtered pages from Google's index: noindex / 301 / canonical to non-filtered page?

I've decided to remove some of my site's pages from the Google index to focus more of the indexed pages on higher quality pages. The pages I'm going to remove are already in the index. These removed ...
1
vote
1answer
112 views

Should I add rel nofollow to internal links which already have meta noindex?

Let's say I have a products page with listing producsts and the page has pagination. I would like the 1st page to have all the SE ranking weight so I decided to put meta noindex on the rest of the ...
1
vote
1answer
136 views

Panda 4: Reducing #indexed pages. How much is enough?

I've been hit by panda 4 (40% decrease). I didn't see any change during panda 1-3. From what I've read it and when compared to my site, the change is probably due to the fact that I have over 30M ...
3
votes
4answers
1k views

Google Indexing Pages with noindex meta tag

I got a message in Google Webmaster Tools about "Googlebot found an extremely high number of URLs on your site" with a long list of example URLs. For some of the pages listed, there was nothing to ...
1
vote
1answer
37 views

Legal pages showing up in our Google Sitelinks

Our Terms of Service page (oursite.com/terms) is persistently showing up as the first of our Google Sitelinks, despite repeated demotions over the course of many weeks and the fact that we have plenty ...
2
votes
4answers
585 views

Why doesn't Google remove my noindex and 404 pages?

I've added 404 error codes and no-index meta tag to pages quite some time ago. However, when I check in Google Webmaster Tools, looking at the graph of "removed" pages from their index, I see very low ...
1
vote
1answer
56 views

Why would I use a robots.txt file? [duplicate]

From what I understand after reading Google's Controlling Crawling and Indexing: The purpose of robots.txt file is to disallow crawling of some URLs, but those can still be indexed (and appear in ...
1
vote
0answers
16 views

Is it good ideo seo point of view- to give noindex or nofollow to labels and tags? [duplicate]

Is it a good idea seo point of view to give noindex or nofollow to labels and tags? I am creating a blog with tagging post. What is the best strategy for tag pages?
1
vote
2answers
456 views

Googlebot fetches my pages very frequent, rel-nofollow, meta-noindex or robots.txt-disallow

Googlebot fetches pages in my site very frequently. And this slowens my website. I don't want Googlebot to crawl too frequent. I decreased crawl rate from Google webmaster tools. But I'm supposing to ...
1
vote
2answers
51 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...
2
votes
2answers
636 views

How much Google takes to deindex pages after disallowed from robots?

By accident I have let Google index lots of junk pages. Now I have added them to disallow in robots.txt. Will Google completely remove the pages after seeing the are disallowed from robots? Please ...
4
votes
1answer
236 views

Using rel=canonical and noindex in a 1-n partners environment

We sell complete sites including the domains to several partners that create content that is shown together at the main site. What we want to achieve is that the main site copy is the original but the ...
1
vote
2answers
193 views

Is it a good idea to add robots “noindex” meta tags to deep low content pages, e.g. product model data

I'm considering adding robots "noindex, follow" tags to the very numerous product data pages that are linked from the product style pages in our online store. For example, each product style has a ...
1
vote
3answers
923 views

SEO: Duplicate content caused by pagination/tag/index pages [duplicate]

Possible Duplicate: What is duplicate content and how can I avoid being penalized for it on my site? I read that I should use a NoIndex tag for transitional pages like index, pagination, or ...
1
vote
1answer
68 views

duplicate content - can't use 301 or canonical tag

I recently started managing SEO for a client. I'm seeing a lot of duplicate content on their site but their custom CMS doesn't allow canonical tags, and I was told by their team that we can't use ...
4
votes
1answer
3k views

How do I stop Soft 404 errors from piling up for “No Results” page?

Recently, I noticed that I have a growing list of Soft 404 errors in Google Webmaster Tools. They are all for dynamically generated search result pages that report "No matches found". I do understand ...
2
votes
3answers
253 views

Should category pages be noindex regarding panda?

I have seen this question, but I believe the situation has changed a lot with the recent Panda updates. I have created a set of category pages to facilitate navigation on my site. It is a proper ...
2
votes
1answer
121 views

How to prevent Google showing documents directly in the SERPs?

I've many useful docs in my website and we know that Google has got smart enough already - that if the document serves visitor's purpose then it directly lists it in the SERP without listing the page ...
0
votes
1answer
48 views

Are testing website URLs considered duplicate content and do they trigger penalties?

I have a website with several thousand pages and I generate a small version of it (100 pages) which I upload to a temporary testing.mywebsite.com URL for testing purposes. Yet, it could be seen as ...
3
votes
3answers
8k views

How to stop certain urls from being indexed

When I type site:example.com(using my domain obviously), I get several link errors showing up in the listing. Typically, they are of the form: /some/fixed/path/admin/unblockUser/11 I am thinking of ...