Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [noindex]

Common value for a HTML robots meta tag.

1
vote
1answer
14 views

Do noindex tags on subdomain pages affect image indexing?

Maybe stupid question, but I have to ask: I'm hosting my images on a subdomain. My main site is example.com and images are stored on static.example.com. Subdomain is just a simple html page - when ...
0
votes
0answers
7 views

SEO Duplicate content for landing page [duplicate]

Good day, I have a question. I am building a landing page however I have noticed that my visitors want to see the other pages as well. Hence strafing away from the form page I'd like them to visit. ...
3
votes
2answers
78 views

How to use X-Robots-Tag to noindex all subdomains (save specific exceptions)?

Google's Robots meta tag and X-Robots-Tag HTTP header specifications page (Practical implementation of X-Robots-Tag with Apache section) gives an example of noindexing certain filetypes, ie: <...
3
votes
2answers
70 views

No index for an entire site

I am finishing a new project. I have been working local for the last weeks/months. Now I want to begin the first tests on the real server and sql database. I do not want the site to be public yet and ...
0
votes
3answers
129 views

Should eCommerce categories with pagination get noindex beyond the first page? [duplicate]

I have an eCommerce website and most of the categories have multiple pages. I have ran an SEO check on seobility which mentioned duplicate content and pages fighting with each other for the same ...
0
votes
0answers
20 views

My URL can't be index in Google Search Result [duplicate]

I am not sure why my URL is not indexed on the Google SERP when I check it by site:. Here what I have done so far: Submit the URL via "Fetch as Google" on Google Search Console URL is on the Sitemap ...
3
votes
1answer
42 views

Prevent bad rankings on a Q and A site for questions without an answer by using noindex until answered

I have a website on which users can ask a question and also answer it. So, when a user asks a question, it creates a new webpage on website and below that question lies its answers. I don't want ...
1
vote
2answers
158 views

Many pages with partial-duplicate content in same domain

This is a question to the SEO experts :-) I apologize for my bad way to write English :-( I am developing a web application (with a kind of custom CMS). In my app there will be a "user section", each ...
1
vote
2answers
119 views

Will Google re-crawl and index a page that was once noindexed?

I have many pages Category Pages that show items inside, but all items has expire time and after reach it, items will remove from page. Sometimes happen, some categories/pages will be empty and this ...
1
vote
1answer
28 views

Should I noindex blocks used for parts of the template created as posts in Yoast?

I am setting up Yoast SEO plugin. I am using a theme that creates HTML blocks. For example the footer is a block, which means that as a block, it's a custom post type, and applies for Yoast SEO set ...
1
vote
1answer
24 views

Wordpress Layered Nav pages - Noindex

I have been trying to figure out how to Noindex the pages created by Woocommerce widget - Latered Nav. I use YOAST and have used that to noindex other irrelevant pages but cannot find a way to do it ...
3
votes
1answer
65 views

Should I noindex pages with standalone parts of the whole parent blog post?

I have a particular setup on my blog where I make blog posts that consist of 25 items - like "25 things that are this and that...". Each of the 25 items is unique - created by me. These blog posts ...
1
vote
2answers
42 views

Discreetly remove page from Google index without modifying page HTML

Let's just say a "friend" wants to do a guest blog on your site with a link to their site, but you aren't very happy about it. You can't say no, but you don't want to be playing the "link juice" game. ...
0
votes
0answers
31 views

Request Google to remove large number of outdated pages?

I have a news site and have about 20K pages outdated content from 2006 to 2012. I am in the process of cleaning up old and thin novalue content to recover from a algorithmic penalty How do i request ...
3
votes
2answers
1k views

URLs with 'NoIndex` in robots.txt are being indexed by Google

In my robots.txt file (http://www.tutorvista.com/robots.txt), I'm using Noindex: /content/... to disallow indexing: This should mean that http://www.tutorvista.com/content/ and anything below this ...
1
vote
1answer
80 views

Remove cached domain / pages from Google

The website's domain I work for is https://www.utazzitthon.hu and there is an other company in partnership with us, they have a domain that is directing to our server and our content, but with this ...
1
vote
0answers
69 views

Screaming Frog marking duplicate on noindex pages

Screaming Frog is detecting as duplicate all login pages of my site despite I have the directive robots-noindex. Do I have a problem on my site, or is just a false positive from Screaming Frog? It ...
4
votes
2answers
453 views

How to noindex certain Wordpress pages by default with Yoast?

I have WP website with multiple campaign landing pages made with Page Builder. All campaign pages are under /campaign/ so urls are always type http://example.com/campaign/some-landing-page Now I would ...
2
votes
2answers
53 views

Moving a site from one subdomain to another subdomain, what to do with pages which aren't “mappable”?

In the process of moving a site from one subdomain to another subdomain. For a lot of the subfolders a 301 redirect to their respective pages on the new site. However what should I do with subdomains ...
1
vote
1answer
201 views

Prevent indexing of site search results

Users have the ability to search on my site. This function renders a search results page that has occasionally been indexed by google and served in SERPs. Normally this is not an issue, but when ...
1
vote
1answer
331 views

Internal Search Results: NOINDEX or robots.txt Blocking?

We have our own internal search results pages for our download section. These results are currently crawlable but with NOINDEX meta tags so they don't appear in the search index. People link to ...
2
votes
1answer
51 views

How to prevent indexing of non-academic content by Google Scholar?

I work at a research institutions that has a Wordpress website where we publish academic articles and other content such as events, awards, news updates etc. We want to use the plugin Kblog Metadata ...
2
votes
0answers
50 views

Prevent page indexing externally _without_ affecting internal google site search?

Is it possible to prevent google search from indexing a page, but still allow that page to be indexed by the custom search engine used for on-site search? Our presenting problem concerns content we ...
1
vote
1answer
67 views

Google not indexing pages after lengthly accidental noindex meta tag

For 5 months I accidentally had thousands of pages from my site marked with a noindex meta tag, due to a bug in my code. Some of these came up as "soft 404" errors in GWT, but only a small portion. ...
1
vote
1answer
145 views

Does Having Too Many NoIndexed Pages Hurt Your Google Rankings?

I have a site like reddit. So 99% pages are thin content. I have no-index all pages. The quality articles are only blog posts written by our team ( Now have around 50 blog posts with 1000-2500 words)....
1
vote
1answer
69 views

How to Deal with Low Quality Content (Without Deleting or Adding More Content)?

I have around 95% low quality articles in my web site. I don't need to delete them because those are for users. I don't want to search engine traffic also those articles. Those articles just for loyal ...
1
vote
1answer
142 views

Google Ignoring Canonical - Asking for Advice on Alternative Option

We self-host video content on our site and allow other sites to embed our videos using IFRAME. Up until a few months ago, we used to canonical the iframe page to the video listing page on our website ...
1
vote
1answer
285 views

Can canonical links and noindex be used with iframes?

We have implemented canonical links to our website in order to prevent the indexation of parameters. Some of the pages are also used as iframes. From the the little info I could find on 'iframes and ...
3
votes
1answer
164 views

Will Google automatically re-index my page when I remove the 'noindex' tag

On my request, our company has implemented a function in our website that adds <meta name="robots" content="noindex"> to blog articles and whitepaper pages that haven't been published yet. ...
1
vote
1answer
47 views

Merge duplicate subbdomains on different domains without hurting Google rankings

I have 2 different websites with identical sub domains, example - invest.abc.com and invest.xyz.com, now both of these sub domains are ranking for different terms, so for 1 term only one sub domain ...
0
votes
1answer
470 views

SEO put no-indexed pages in sitemap or not?

On my site I have products. Each product has many releases. Each release has many changelogs. A changelog is one of many categories (eg, "Bug Fix", "Performance Improvement" etc). I have created ...
2
votes
2answers
33 views

Method for removal of high number of spammy links

I haven't been able to figure out the right combination for deindexing spammy links from search results. On one hand, we have the Google URL remover which removes links temporarily (they may show up ...
0
votes
0answers
218 views

Multiple paginations on a page, indexing and canonical

In my ruby on rails app, I'm showing multiple paginated items on a single page. For a single items pagination, I know how to use pagination and rel='prev' and 'next' attributes and canonical. But in ...
1
vote
1answer
67 views

Which custom post types in Wordpress should be Noindexed for optimal SEO?

I'm using the All In One SEO pack, and read several guides on recommended/optimal settings. However every guide typically shows just Pages, Posts & Media, whereas my site currently has a ton of ...
2
votes
1answer
66 views

Blocking vs noindex to reduce crawl requests

I observed that GoogleBot is making a lot of duplicate requests for the same URLs from my website within a week. Amongst these requests a majority were for low/thin value pages(no or very low SERP,not ...
6
votes
2answers
612 views

Do search engines still crawl a noindex page

Do search engines crawl a page that has a 'noindex' meta attribute? The reason I ask is because we have near duplicate content caused by faceted navigation and the filtered pages have stated 'noindex'...
2
votes
1answer
139 views

Is Google starting to ignore link directories such as brownbook [duplicate]

After adding a website to brownbook.net and then claiming the business, It has not yet been indexed by google, and 2 months has passed. I am newish to SEO and have worked out to check the robots.txt /...
1
vote
2answers
26 views

Should blank pages get a noindex tag or get deleted?

I was using webceo and came across pages that are blank. They of course have a URL, but no content. So how do I know whether they should be noindexed (because they serve for functionality purposes) ...
5
votes
2answers
231 views

Is it 100% safe to add NOINDEX tag to any duplicate/copy content issues?

Usually I can simply copy and paste content from any blogs to the my blog, and add a no index tag to avoid any duplicate/copy content issues. I have copied above part from popular blog. I need to ...
3
votes
1answer
57 views

Should I no-index pages that are links to articles with a short blurb — more than 90% of the posts on my blog

I have created a site like Digg.com, Bizsugar.biz: managewp.org. My site niche is WordPress and Web Development. Users can submit links to my site. So, many pages are low quality because it has only ...
1
vote
1answer
218 views

Google not re-crawling subpages after “fetch as Google” with the “directly linked pages” option

After fixing a "noindex" issue on my WordPress website, where all my pages failed to be crawled by Google, I used Google Webmaster to re-index the website (without waiting). But it worked only for the ...
0
votes
1answer
74 views

Review my usage of NoIndex and rel=canonical [closed]

I am working with my developer to redesign my image macro (meme) generator website. I am concerned about semi-duplicate and paginated pages appearing in the search index and would appreciate your ...
2
votes
1answer
70 views

Pruning expired pages using noindex?

I have a busy website which contains several hundred thousand event pages. Due to their very nature, they expire once the event has passed, so there will always be more past events than upcoming. I'...
3
votes
2answers
640 views

How to correctly remove MULTIPLE parameters from the Google index using htaccess and canonical / noindex?

I found a similar question with a great answer for removing a single URL parameter. However, what if I have 20+ URL parameters that I don't want indexed? Also, in the example solution below, it is ...
1
vote
2answers
326 views

Should I use NOINDEX, FOLLOW to solve link juice dilution for UTM link parameters?

I'm reading that links with UTM tracking code are considered as separate links from Google's point of view and can be recognized as duplicated content. (1) I know NOINDEX, FOLLOW can solve the ...
0
votes
0answers
22 views

can i deeplink my product pages which are not allowed to be crawled by robots

I have a set of pages which i have blocked by the robots and i don't want them to appear in search results. But if i am targetting users on this page via email/ad campaigns i want a possibility of ...
2
votes
2answers
45 views

Might category noindex prevent indexing of other pages on Yandex?

On my website I put noindex on my category pages but not the pages under it. Even though two weeks passed, the only indexed page is my home page which is not under any category. When I look at ...
1
vote
1answer
21 views

Does it hurt for domain A to link to a NOINDEX page at domain B?

Two pages A and B are at two different domains: Page A links to page B. After a while, I decided to mark page B NOINDEX using meta robots "noindex, follow". Do I have to add rel=nofollow to page A ...
2
votes
1answer
58 views

Should I nofollow and/or noindex links that are not cached?

I have a Magento store with what they call a layered navigation. Basically a menu with links to things like color, price, etc. I'm currently not caching these links, and so their response time is ...
2
votes
1answer
27 views

Does title and description matter if a page is not to be indexed?

Does a meta-description and a title tag has any significance in a page that is marked to not be indexed (either via a rel=canonical pointing to another URL or noindex)? For example, I have a tutorial ...