Questions tagged [noindex]

Common value for a HTML robots meta tag.

Filter by
Sorted by
Tagged with
0
votes
1answer
17 views

Google indexing Wordpress in subdirectory disallowed in robots.txt

I have a headless wordpress site just using wordpress API. My site is in the root at example.com, and wordpress live subdirectory example.com/wordpress. I set up robots.txt as follows: User-agent: *...
0
votes
1answer
8 views

Adding noindex to xrobots to remove Request URL Soft 404

Bit of a technical question here that I'm working on with my dev. I have a load of Ajax request URL's appearing in Search Console as soft 404's. These requests are for buttons on the page i.e. '...
2
votes
0answers
27 views

How to 'noindex' a specific image on a specific page on my website?

I'm generally aware how the noindex HTML tag works and how to use it. However, I haven't managed to find a way to not index specific images on specific pages on my website. I'm looking for a ...
0
votes
0answers
9 views

How to stop Google from indexing my webpage? [duplicate]

I have a webpage /user/login , I want to keep it private but Google has indexed the page. I have tried lots of ways: In robos.txt, I added a new line:Disallow: /user/, added header header("Robots: ...
2
votes
1answer
28 views

Is setting deep filtered categories to noindex a good practise?

The situation now: The project is not launched, but we have lot of categories and a big filter system in the end (color, brand, dimension, size, model, material,..). Most of categories will have a ...
0
votes
0answers
41 views

SEO Ajax loaded pages - noindex X-Robots-tag

I have on my homepage (page A) html content (ajax) loaded on click of a button (load more) from multiple pages (page B). Googlebot does see content and does follow links loaded from the ajax calls on ...
0
votes
0answers
8 views

Index Bloat Killing SEO [duplicate]

I have a strange problem with my WordPress site that has no common solution. I’m currently in the middle of turning my site from a Lifestyle blog to a book-oriented blog and had to delete over 400 ...
4
votes
1answer
624 views

Ok to use meta noindex on 404 pages?

I have a custom 404.html file on my website that gets served with a 404 status code when a URL is not found, standard stuff. But if you visit the exact path /404.html on the server, the server says "...
0
votes
0answers
11 views

Do noindexed pages contribute to relevancy of page they link to?

Imagine following setup: 1 There is a category page, like canon-inc-cartridges.html. This page has content pieces, like `<a name="canon-1234-inc-cartridges"><h3>canon 1234 inc cartridges&...
1
vote
1answer
43 views

How to prevent pages from being indexed in Google Search by using robots.txt? [duplicate]

In my robots.txt I disallowed some of the "thank you" pages on my site that I don't want to indexed by Google or be in Google search results. But those pages have recently become searchable on Google. ...
1
vote
1answer
32 views

Do noindex tags on subdomain pages affect image indexing?

Maybe stupid question, but I have to ask: I'm hosting my images on a subdomain. My main site is example.com and images are stored on static.example.com. Subdomain is just a simple html page - when ...
3
votes
2answers
551 views

How to use X-Robots-Tag to noindex all subdomains (save specific exceptions)?

Google's Robots meta tag and X-Robots-Tag HTTP header specifications page (Practical implementation of X-Robots-Tag with Apache section) gives an example of noindexing certain filetypes, ie: <...
4
votes
4answers
624 views

No index for an entire site

I am finishing a new project. I have been working local for the last weeks/months. Now I want to begin the first tests on the real server and sql database. I do not want the site to be public yet and ...
0
votes
3answers
164 views

Should eCommerce categories with pagination get noindex beyond the first page? [duplicate]

I have an eCommerce website and most of the categories have multiple pages. I have ran an SEO check on seobility which mentioned duplicate content and pages fighting with each other for the same ...
0
votes
0answers
22 views

My URL can't be index in Google Search Result [duplicate]

I am not sure why my URL is not indexed on the Google SERP when I check it by site:. Here what I have done so far: Submit the URL via "Fetch as Google" on Google Search Console URL is on the Sitemap ...
3
votes
1answer
46 views

Prevent bad rankings on a Q and A site for questions without an answer by using noindex until answered

I have a website on which users can ask a question and also answer it. So, when a user asks a question, it creates a new webpage on website and below that question lies its answers. I don't want ...
1
vote
2answers
305 views

Many pages with partial-duplicate content in same domain

This is a question to the SEO experts :-) I apologize for my bad way to write English :-( I am developing a web application (with a kind of custom CMS). In my app there will be a "user section", each ...
1
vote
2answers
188 views

Will Google re-crawl and index a page that was once noindexed?

I have many pages Category Pages that show items inside, but all items has expire time and after reach it, items will remove from page. Sometimes happen, some categories/pages will be empty and this ...
1
vote
1answer
45 views

Should I noindex blocks used for parts of the template created as posts in Yoast?

I am setting up Yoast SEO plugin. I am using a theme that creates HTML blocks. For example the footer is a block, which means that as a block, it's a custom post type, and applies for Yoast SEO set ...
1
vote
1answer
29 views

Wordpress Layered Nav pages - Noindex

I have been trying to figure out how to Noindex the pages created by Woocommerce widget - Latered Nav. I use YOAST and have used that to noindex other irrelevant pages but cannot find a way to do it ...
3
votes
1answer
69 views

Should I noindex pages with standalone parts of the whole parent blog post?

I have a particular setup on my blog where I make blog posts that consist of 25 items - like "25 things that are this and that...". Each of the 25 items is unique - created by me. These blog posts ...
1
vote
2answers
43 views

Discreetly remove page from Google index without modifying page HTML

Let's just say a "friend" wants to do a guest blog on your site with a link to their site, but you aren't very happy about it. You can't say no, but you don't want to be playing the "link juice" game. ...
3
votes
2answers
2k views

URLs with 'NoIndex` in robots.txt are being indexed by Google

In my robots.txt file (http://www.tutorvista.com/robots.txt), I'm using Noindex: /content/... to disallow indexing: This should mean that http://www.tutorvista.com/content/ and anything below this ...
1
vote
1answer
100 views

Remove cached domain / pages from Google

The website's domain I work for is https://www.utazzitthon.hu and there is an other company in partnership with us, they have a domain that is directing to our server and our content, but with this ...
1
vote
0answers
82 views

Screaming Frog marking duplicate on noindex pages

Screaming Frog is detecting as duplicate all login pages of my site despite I have the directive robots-noindex. Do I have a problem on my site, or is just a false positive from Screaming Frog? It ...
4
votes
2answers
683 views

How to noindex certain Wordpress pages by default with Yoast?

I have WP website with multiple campaign landing pages made with Page Builder. All campaign pages are under /campaign/ so urls are always type http://example.com/campaign/some-landing-page Now I would ...
2
votes
2answers
58 views

Moving a site from one subdomain to another subdomain, what to do with pages which aren't “mappable”?

In the process of moving a site from one subdomain to another subdomain. For a lot of the subfolders a 301 redirect to their respective pages on the new site. However what should I do with subdomains ...
1
vote
1answer
257 views

Prevent indexing of site search results

Users have the ability to search on my site. This function renders a search results page that has occasionally been indexed by google and served in SERPs. Normally this is not an issue, but when ...
1
vote
1answer
452 views

Internal Search Results: NOINDEX or robots.txt Blocking?

We have our own internal search results pages for our download section. These results are currently crawlable but with NOINDEX meta tags so they don't appear in the search index. People link to ...
2
votes
1answer
65 views

How to prevent indexing of non-academic content by Google Scholar?

I work at a research institutions that has a Wordpress website where we publish academic articles and other content such as events, awards, news updates etc. We want to use the plugin Kblog Metadata ...
2
votes
0answers
56 views

Prevent page indexing externally _without_ affecting internal google site search?

Is it possible to prevent google search from indexing a page, but still allow that page to be indexed by the custom search engine used for on-site search? Our presenting problem concerns content we ...
2
votes
1answer
79 views

Google not indexing pages after lengthly accidental noindex meta tag

For 5 months I accidentally had thousands of pages from my site marked with a noindex meta tag, due to a bug in my code. Some of these came up as "soft 404" errors in GWT, but only a small portion. ...
1
vote
1answer
183 views

Does Having Too Many NoIndexed Pages Hurt Your Google Rankings?

I have a site like reddit. So 99% pages are thin content. I have no-index all pages. The quality articles are only blog posts written by our team ( Now have around 50 blog posts with 1000-2500 words)....
1
vote
1answer
71 views

How to Deal with Low Quality Content (Without Deleting or Adding More Content)?

I have around 95% low quality articles in my web site. I don't need to delete them because those are for users. I don't want to search engine traffic also those articles. Those articles just for loyal ...
1
vote
1answer
236 views

Google Ignoring Canonical - Asking for Advice on Alternative Option

We self-host video content on our site and allow other sites to embed our videos using IFRAME. Up until a few months ago, we used to canonical the iframe page to the video listing page on our website ...
1
vote
1answer
455 views

Can canonical links and noindex be used with iframes?

We have implemented canonical links to our website in order to prevent the indexation of parameters. Some of the pages are also used as iframes. From the the little info I could find on 'iframes and ...
2
votes
1answer
272 views

Will Google automatically re-index my page when I remove the 'noindex' tag

On my request, our company has implemented a function in our website that adds <meta name="robots" content="noindex"> to blog articles and whitepaper pages that haven't been published yet. ...
1
vote
1answer
50 views

Merge duplicate subbdomains on different domains without hurting Google rankings

I have 2 different websites with identical sub domains, example - invest.abc.com and invest.xyz.com, now both of these sub domains are ranking for different terms, so for 1 term only one sub domain ...
0
votes
1answer
521 views

SEO put no-indexed pages in sitemap or not?

On my site I have products. Each product has many releases. Each release has many changelogs. A changelog is one of many categories (eg, "Bug Fix", "Performance Improvement" etc). I have created ...
2
votes
2answers
34 views

Method for removal of high number of spammy links

I haven't been able to figure out the right combination for deindexing spammy links from search results. On one hand, we have the Google URL remover which removes links temporarily (they may show up ...
1
vote
1answer
80 views

Which custom post types in Wordpress should be Noindexed for optimal SEO?

I'm using the All In One SEO pack, and read several guides on recommended/optimal settings. However every guide typically shows just Pages, Posts & Media, whereas my site currently has a ton of ...
2
votes
1answer
74 views

Blocking vs noindex to reduce crawl requests

I observed that GoogleBot is making a lot of duplicate requests for the same URLs from my website within a week. Amongst these requests a majority were for low/thin value pages(no or very low SERP,not ...
7
votes
2answers
861 views

Do search engines still crawl a noindex page

Do search engines crawl a page that has a 'noindex' meta attribute? The reason I ask is because we have near duplicate content caused by faceted navigation and the filtered pages have stated 'noindex'...
1
vote
1answer
186 views

Is Google starting to ignore link directories such as brownbook [duplicate]

After adding a website to brownbook.net and then claiming the business, It has not yet been indexed by google, and 2 months has passed. I am newish to SEO and have worked out to check the robots.txt /...
1
vote
2answers
27 views

Should blank pages get a noindex tag or get deleted?

I was using webceo and came across pages that are blank. They of course have a URL, but no content. So how do I know whether they should be noindexed (because they serve for functionality purposes) ...
4
votes
2answers
262 views

Is it 100% safe to add NOINDEX tag to any duplicate/copy content issues?

Usually I can simply copy and paste content from any blogs to the my blog, and add a no index tag to avoid any duplicate/copy content issues. I have copied above part from popular blog. I need to ...
2
votes
1answer
61 views

Should I no-index pages that are links to articles with a short blurb — more than 90% of the posts on my blog

I have created a site like Digg.com, Bizsugar.biz: managewp.org. My site niche is WordPress and Web Development. Users can submit links to my site. So, many pages are low quality because it has only ...
1
vote
1answer
251 views

Google not re-crawling subpages after “fetch as Google” with the “directly linked pages” option

After fixing a "noindex" issue on my WordPress website, where all my pages failed to be crawled by Google, I used Google Webmaster to re-index the website (without waiting). But it worked only for the ...
0
votes
1answer
82 views

Review my usage of NoIndex and rel=canonical [closed]

I am working with my developer to redesign my image macro (meme) generator website. I am concerned about semi-duplicate and paginated pages appearing in the search index and would appreciate your ...
2
votes
1answer
88 views

Pruning expired pages using noindex?

I have a busy website which contains several hundred thousand event pages. Due to their very nature, they expire once the event has passed, so there will always be more past events than upcoming. I'...