Questions tagged [noindex]
Common value for a HTML robots meta tag.
158
questions
3
votes
1answer
86 views
PDF files still indexed when X-Robots-Tag noindex set in .htaccess
I am trying to analyse the .htaccess file of a website, specifically the following piece of code:
<FilesMatch ".pdf$">
<IfModule mod_headers.c>
Header set X-Robots-Tag "noindex, noarchive,...
1
vote
1answer
13 views
Proper way to avoid Google from indexing wordpress attachment pages
I recently noticed that the attachment pages of my friend's website appears in Google search. I applied the Yoast plugin solution to redirect those pages to post itself but I want to guarantee that ...
3
votes
0answers
32 views
Redirected to www, but Google is indexing no-www without snippets, should I use noindex instead?
I started my blog a month ago and was using non www version for my website.
Then, I recently decided to stick to www.example.com version. So I changed it and Google has indexed the www version ...
1
vote
0answers
13 views
“NOINDEX, FOLLOW” turns into NOFOLLOW eventually. Solution is Canonical?
I have recently discovered that Google treats "noindex,follow" pages as "noindex,nofollow" eventually -> https://webmasters.stackexchange.com/a/115879
I have a website with hotel listings. I provide ...
1
vote
2answers
37 views
Does Google TRULY respect noindex and nofollow?
Does google REALLY respect noindex, nofollow and blocking content to being indexed and seen via .htacess or robots.txt file?
I need to be sure of this 100%, I need to use duplicate content on some ...
0
votes
1answer
36 views
Google indexing Wordpress in subdirectory disallowed in robots.txt
I have a headless wordpress site just using wordpress API.
My site is in the root at example.com, and wordpress live subdirectory example.com/wordpress.
I set up robots.txt as follows:
User-agent: *...
1
vote
2answers
29 views
Adding noindex to xrobots to remove Request URL Soft 404
Bit of a technical question here that I'm working on with my dev.
I have a load of Ajax request URL's appearing in Search Console as soft 404's. These requests are for buttons on the page i.e. '...
2
votes
0answers
49 views
How to 'noindex' a specific image on a specific page on my website?
I'm generally aware how the noindex HTML tag works and how to use it. However, I haven't managed to find a way to not index specific images on specific pages on my website.
I'm looking for a ...
0
votes
0answers
9 views
How to stop Google from indexing my webpage? [duplicate]
I have a webpage /user/login , I want to keep it private but Google has indexed the page.
I have tried lots of ways:
In robos.txt, I added a new line:Disallow: /user/, added header header("Robots: ...
2
votes
1answer
38 views
Is setting deep filtered categories to noindex a good practise?
The situation now: The project is not launched, but we have lot of categories and a big filter system in the end (color, brand, dimension, size, model, material,..).
Most of categories will have a ...
0
votes
0answers
53 views
SEO Ajax loaded pages - noindex X-Robots-tag
I have on my homepage (page A) html content (ajax) loaded on click of a button (load more) from multiple pages (page B).
Googlebot does see content and does follow links loaded from the ajax calls on ...
0
votes
0answers
8 views
Index Bloat Killing SEO [duplicate]
I have a strange problem with my WordPress site that has no common solution.
I’m currently in the middle of turning my site from a Lifestyle blog to a book-oriented blog and had to delete over 400 ...
4
votes
1answer
1k views
Ok to use meta noindex on 404 pages?
I have a custom 404.html file on my website that gets served with a 404 status code when a URL is not found, standard stuff. But if you visit the exact path /404.html on the server, the server says "...
0
votes
0answers
11 views
Do noindexed pages contribute to relevancy of page they link to?
Imagine following setup:
1 There is a category page, like canon-inc-cartridges.html. This page has content pieces, like
`<a name="canon-1234-inc-cartridges"><h3>canon 1234 inc cartridges&...
1
vote
1answer
50 views
How to prevent pages from being indexed in Google Search by using robots.txt? [duplicate]
In my robots.txt I disallowed some of the "thank you" pages on my site that I don't want to indexed by Google or be in Google search results. But those pages have recently become searchable on Google. ...
1
vote
1answer
36 views
Do noindex tags on subdomain pages affect image indexing?
Maybe stupid question, but I have to ask:
I'm hosting my images on a subdomain. My main site is example.com and images are stored on static.example.com.
Subdomain is just a simple html page - when ...
3
votes
2answers
724 views
How to use X-Robots-Tag to noindex all subdomains (save specific exceptions)?
Google's Robots meta tag and X-Robots-Tag HTTP header specifications page (Practical implementation of X-Robots-Tag with Apache section) gives an example of noindexing certain filetypes, ie:
<...
4
votes
4answers
907 views
No index for an entire site
I am finishing a new project. I have been working local for the last weeks/months. Now I want to begin the first tests on the real server and sql database. I do not want the site to be public yet and ...
0
votes
3answers
176 views
Should eCommerce categories with pagination get noindex beyond the first page? [duplicate]
I have an eCommerce website and most of the categories have multiple pages.
I have ran an SEO check on seobility which mentioned duplicate content and pages fighting with each other for the same ...
0
votes
0answers
22 views
My URL can't be index in Google Search Result [duplicate]
I am not sure why my URL is not indexed on the Google SERP when I check it by site:. Here what I have done so far:
Submit the URL via "Fetch as Google" on Google Search Console
URL is on the Sitemap ...
3
votes
1answer
46 views
Prevent bad rankings on a Q and A site for questions without an answer by using noindex until answered
I have a website on which users can ask a question and also answer it. So, when a user asks a question, it creates a new webpage on website and below that question lies its answers.
I don't want ...
1
vote
2answers
359 views
Many pages with partial-duplicate content in same domain
This is a question to the SEO experts :-) I apologize for my bad way to write English :-(
I am developing a web application (with a kind of custom CMS). In my app there will be a "user section", each ...
1
vote
2answers
207 views
Will Google re-crawl and index a page that was once noindexed?
I have many pages Category Pages that show items inside, but all items has expire time and after reach it, items will remove from page. Sometimes happen, some categories/pages will be empty and this ...
1
vote
1answer
50 views
Should I noindex blocks used for parts of the template created as posts in Yoast?
I am setting up Yoast SEO plugin.
I am using a theme that creates HTML blocks. For example the footer is a block, which means that as a block, it's a custom post type, and applies for Yoast SEO set ...
1
vote
1answer
31 views
Wordpress Layered Nav pages - Noindex
I have been trying to figure out how to Noindex the pages created by Woocommerce widget - Latered Nav.
I use YOAST and have used that to noindex other irrelevant pages but cannot find a way to do it ...
3
votes
1answer
70 views
Should I noindex pages with standalone parts of the whole parent blog post?
I have a particular setup on my blog where I make blog posts that consist of 25 items - like "25 things that are this and that...".
Each of the 25 items is unique - created by me. These blog posts ...
1
vote
2answers
44 views
Discreetly remove page from Google index without modifying page HTML
Let's just say a "friend" wants to do a guest blog on your site with a link to their site, but you aren't very happy about it. You can't say no, but you don't want to be playing the "link juice" game. ...
3
votes
2answers
396 views
Is there differences between deleting low quality articles vs no-indexing low quality articles SEO wise?
I am auditing the SEO for a site. I found a few low quality articles which I think Google hate.... So I have two options.
Delete those article.
No-index those article
Is there any difference in ...
3
votes
2answers
2k views
URLs with 'NoIndex` in robots.txt are being indexed by Google
In my robots.txt file (http://www.tutorvista.com/robots.txt), I'm using Noindex: /content/... to disallow indexing:
This should mean that http://www.tutorvista.com/content/ and anything below this ...
1
vote
1answer
104 views
Remove cached domain / pages from Google
The website's domain I work for is https://www.utazzitthon.hu and there is an other company in partnership with us, they have a domain that is directing to our server and our content, but with this ...
1
vote
0answers
83 views
Screaming Frog marking duplicate on noindex pages
Screaming Frog is detecting as duplicate all login pages of my site despite I have the directive robots-noindex.
Do I have a problem on my site, or is just a false positive from Screaming Frog?
It ...
4
votes
2answers
774 views
How to noindex certain Wordpress pages by default with Yoast?
I have WP website with multiple campaign landing pages made with Page Builder. All campaign pages are under /campaign/ so urls are always type http://example.com/campaign/some-landing-page Now I would ...
2
votes
2answers
59 views
Moving a site from one subdomain to another subdomain, what to do with pages which aren't “mappable”?
In the process of moving a site from one subdomain to another subdomain. For a lot of the subfolders a 301 redirect to their respective pages on the new site. However what should I do with subdomains ...
1
vote
1answer
278 views
Prevent indexing of site search results
Users have the ability to search on my site. This function renders a search results page that has occasionally been indexed by google and served in SERPs. Normally this is not an issue, but when ...
1
vote
1answer
469 views
Internal Search Results: NOINDEX or robots.txt Blocking?
We have our own internal search results pages for our download section.
These results are currently crawlable but with NOINDEX meta tags so they don't appear in the search index.
People link to ...
2
votes
1answer
73 views
How to prevent indexing of non-academic content by Google Scholar?
I work at a research institutions that has a Wordpress website where we publish academic articles and other content such as events, awards, news updates etc.
We want to use the plugin Kblog Metadata ...
2
votes
0answers
58 views
Prevent page indexing externally _without_ affecting internal google site search?
Is it possible to prevent google search from indexing a page, but still allow that page to be indexed by the custom search engine used for on-site search?
Our presenting problem concerns content we ...
2
votes
1answer
83 views
Google not indexing pages after lengthly accidental noindex meta tag
For 5 months I accidentally had thousands of pages from my site marked with a noindex meta tag, due to a bug in my code. Some of these came up as "soft 404" errors in GWT, but only a small portion.
...
1
vote
1answer
195 views
Does Having Too Many NoIndexed Pages Hurt Your Google Rankings?
I have a site like reddit. So 99% pages are thin content. I have no-index all pages.
The quality articles are only blog posts written by our team ( Now have around 50 blog posts with 1000-2500 words)....
1
vote
1answer
72 views
How to Deal with Low Quality Content (Without Deleting or Adding More Content)?
I have around 95% low quality articles in my web site. I don't need to delete them because those are for users. I don't want to search engine traffic also those articles. Those articles just for loyal ...
1
vote
1answer
262 views
Google Ignoring Canonical - Asking for Advice on Alternative Option
We self-host video content on our site and allow other sites to embed our videos using IFRAME.
Up until a few months ago, we used to canonical the iframe page to the video listing page on our website ...
1
vote
1answer
523 views
Can canonical links and noindex be used with iframes?
We have implemented canonical links to our website in order to prevent the indexation of parameters.
Some of the pages are also used as iframes. From the the little info I could find on 'iframes and ...
2
votes
1answer
313 views
Will Google automatically re-index my page when I remove the 'noindex' tag
On my request, our company has implemented a function in our website that adds <meta name="robots" content="noindex"> to blog articles and whitepaper pages that haven't been published yet.
...
1
vote
1answer
50 views
Merge duplicate subbdomains on different domains without hurting Google rankings
I have 2 different websites with identical sub domains, example -
invest.abc.com and invest.xyz.com, now both of these sub domains are ranking for different terms, so for 1 term only one sub domain ...
0
votes
1answer
541 views
SEO put no-indexed pages in sitemap or not?
On my site I have products. Each product has many releases. Each release has many changelogs. A changelog is one of many categories (eg, "Bug Fix", "Performance Improvement" etc).
I have created ...
2
votes
2answers
34 views
Method for removal of high number of spammy links
I haven't been able to figure out the right combination for deindexing spammy links from search results. On one hand, we have the Google URL remover which removes links temporarily (they may show up ...
1
vote
1answer
82 views
Which custom post types in Wordpress should be Noindexed for optimal SEO?
I'm using the All In One SEO pack, and read several guides on recommended/optimal settings.
However every guide typically shows just Pages, Posts & Media, whereas my site currently has a ton of ...
2
votes
1answer
79 views
Blocking vs noindex to reduce crawl requests
I observed that GoogleBot is making a lot of duplicate requests for the same URLs from my website within a week. Amongst these requests a majority were for low/thin value pages(no or very low SERP,not ...
7
votes
2answers
924 views
Do search engines still crawl a noindex page
Do search engines crawl a page that has a 'noindex' meta attribute?
The reason I ask is because we have near duplicate content caused by faceted navigation and the filtered pages have stated 'noindex'...
1
vote
1answer
201 views
Is Google starting to ignore link directories such as brownbook [duplicate]
After adding a website to brownbook.net and then claiming the business, It has not yet been indexed by google, and 2 months has passed.
I am newish to SEO and have worked out to check the robots.txt /...
