Questions tagged [noindex]

Common value for a HTML robots meta tag.

Filter by
Sorted by
Tagged with
3 votes
1 answer
22 views

Why my keyword is showing 30 average position on search console but isn't showing in top 100 in google?

When I go to google search console, I see the average position of one of my keywords at 30th, but when I manually search for that keyword in that specific area my keyword is not on even 100th position....
user avatar
4 votes
1 answer
28 views

Deindex a site through Google Search Console without access to the site's server to make changes?

Is there an option in GSC to exclude the whole GSC property (all URLs of it) from indexing? Implementing noindex isn't feasible. I don't have access to the server to make changes. I can't add a meta ...
user avatar
  • 9,599
1 vote
1 answer
66 views

Use noindex for URL with parameters?

I have a homepage, https://example.com, where a parameter can be added to unlock a discount on our website https://example.com?code=abc. I don't want this URL to be appear in Google search results, ...
user avatar
2 votes
1 answer
31 views

Is it possible to disable indexing through JS?

Is it possible to disable Google indexing of some web page if this is placed to head tag <meta name="googlebot" content="noindex" /> using only JS? Or is it all a hoax and ...
user avatar
2 votes
1 answer
48 views

Should search engines be allowed to index wp-includes and wp-content in WordPress?

Should the wp-includes and wp-content directories in WordPress be indexed by search engines or not? Should we prevent indexing using noindex in X-Robots tag?
user avatar
  • 21
4 votes
1 answer
47 views

Should I noindex a coming soon page?

I am working on a coming soon page that will list our logo, contact form and a newsletter subscription. It is rather short and simple. In regards to SEO, should I set it noindex nofollow perhaps then?
user avatar
0 votes
0 answers
12 views

how to stop web pages from appearing in google search results [duplicate]

There are certain pages/routes of a node application I have which I do not want to be displayed in google search results - to do this I have added meta name=”robots” content=”noindex” in the head of ...
user avatar
  • 101
5 votes
1 answer
609 views

Why does it cause issues to use robots.txt and a meta robots tag at the same time?

It seems common wisdom that using X-Robots-Tag/meta robots with robots.txt to block a URL from being indexed "can cause issues", e.g.: Using both X-Robots-Tag and meta robots on a URL is ...
user avatar
  • 153
2 votes
3 answers
69 views

Impact of visitors on a 'noindex' page

I have a page which has a 'noindex' attribute. So google will not index this page at all. But this page has lots of visitors. Does this number of page views have any impact on my SEO?
user avatar
  • 21
1 vote
1 answer
21 views

Robots.txt not blocking yet GSC URL Inspection Tool says it is

Recently I realized Disallow /was set on my staging sites. I didn't realize until I got a warning in Search Console... Mistakes happen I've removed the directive and cleared all caches at least 10 ...
user avatar
  • 4,490
2 votes
1 answer
87 views

Should I noindex user profile page with little content?

I have a website. Users can subscribe to this website and create their own profiles. The pages created by users are as follows: https://example.com/ardacar https://example.com/stackoverflow ...
user avatar
  • 654
1 vote
1 answer
43 views

If noindex pages don't have H1, meta tags, or other desirable elements for SEO, will it hurt the SEO of indexed pages?

I have some pages with noindex. These pages have some SEO errors. SEO errors include: not using H1 Not using meta tags Not adding alt="" tags to images But there no such SEO problems on my ...
user avatar
  • 654
5 votes
2 answers
45 views

Should I keep content="index, follow" on pages where I have canonical to another site

I have a URL on website A that contains content from website B. On-site A at the moment we include canonical that shows site B and at the moment we do not include this URL into site A sitemaps. ...
user avatar
0 votes
1 answer
121 views

HTML sitemap with noindex, follow: Matt Cutts vs John Mueller

Ref: Do noindex,follow pages pass pagerank / link juice? I have a requirement wherein I want to create an HTML sitemap to help users navigate to deep pages. This sitemap page will be linked from ...
user avatar
  • 2,233
0 votes
1 answer
37 views

301 or noindex or both [closed]

I have lots of categories but I use different pages as landing page for each categories and in pages I just load the contents of each category that I need (I cant delete my categories) what is best ...
user avatar
1 vote
1 answer
53 views

Indexed, though blocked by robots.txt [duplicate]

I am working on an e-commerce website (similar to e-bay) where users can buy or sell products. The urls for buying a product are like: example.com/browse/cars example.com/browse/toys etc And the urls ...
user avatar
1 vote
1 answer
33 views

Unknown long phrases searched on my website reported in search console coverage

I checked my search console coverage. It seems that many long phrases are being searched on my site, and I have many noindex pages in coverage, but I have never made such a page. is my website hacked. ...
user avatar
1 vote
1 answer
34 views

Block short URL in robots.txt

We have example.com/article-page-one/ This page has a short URL in Wordpress like this : example.com/?p=1 In this page we put short URL for users. What will happen if we block short URL? The robots....
user avatar
2 votes
0 answers
32 views

Google Search Console reports error for 'noindex' tag on sitemap

My sitemap is dynamically generated by Yoast SEO WordPress plugin, and is returned with noindex. I submitted the sitemap URL to Google Search Console, but it reports an error: Submitted URL marked ‘...
user avatar
  • 21
3 votes
1 answer
238 views

Link rel="nofollow" vs robots.txt disallow for "/search" URLs?

There's a /search path on my web app that I don't want robots to crawl or index. What would be the best approach for this scenario? 1: Block them from accessing by adding a Disallow for /search on ...
user avatar
4 votes
1 answer
351 views

How do I "noindex" a text (.txt) file?

I have a directory full of .txt files that are used as part of a larger javascript application. The text files are not inteded to be directly accessed, and are used as includes on separate pages as ...
user avatar
1 vote
1 answer
55 views

Google Search Console coverage reports "Submitted URL marked 'noindex'" for a 404 page not in the sitemap without a noindex tag

Error: "Submitted URL marked 'noindex'" error in the Google Search Console coverage report Situation URL is not submitted in our sitemap Google is not indexing the URL There is no noindex ...
user avatar
1 vote
2 answers
56 views

Does crawler index duplicate page which has canonical URL?

Suppose I have two pages with the same content: example.com/a example.com/b so I put a canonical tag <link rel="canonical" href="example.com/a"/> at page example.com/b. I ...
user avatar
1 vote
1 answer
17 views

No directory listing index page

I have some audio assets directories on my website. The server allows directory listing. i.e. all audio files will be listed if the user visited example.com/assets/audio/nature/. I don't want to ...
user avatar
  • 485
0 votes
1 answer
178 views

Can a 410 gone page remain indexed?

Does somebody experienced a page with 410 status code in index? Could you imagine, that an indexed healthy page, which is set to 410 only through adding of <?php header( "HTTP/1.1 410 Gone&...
user avatar
  • 9,599
0 votes
1 answer
1k views

Why google jobs search is not showing my all jobs?

I am facing a very weird issue to show the jobs on Google job listing. I have followed the below steps and I am still not able to see all of my jobs on Google jobs. Followed correct Job Posting ...
user avatar
1 vote
1 answer
61 views

Can having too many noindex pages hurt ranking? [duplicate]

Can having too many noindex pages hurt ranking? Eg: 50,000 low quality noindex forum posts with 1,000 indexed quality posts. Can those 50,000 low quality noindex forum posts affect for 1,000 ...
user avatar
  • 11
2 votes
2 answers
156 views

How to Confirm that My Site is Not Indexed?

I want to prevent my site from being indexed and listed by Google. So I follow the instructions in https://yoast.com/prevent-site-being-indexed/ and add: Header set X-Robots-Tag "noindex, nofollow" ...
user avatar
  • 389
1 vote
1 answer
20 views

Benefit of using pretty urls on search results with content Noindex?

Google doesn't want thin content like search results pages to be indexed. So I use noindex on all those search results on my website. Then is there a benefit using pretty urls like below. https://...
user avatar
  • 410
1 vote
2 answers
41 views

Excluding URLs to avoid thin content: just "noindex"? also "dofollow"?

My website has 100,000 URLs with auto-generated content and I'm suffering from thin content (drop in ranking and alerts of duplicate content in Google Search Console). I want now to exclude those ...
user avatar
  • 423
1 vote
1 answer
27 views

I am looking for a way to set noindex tags on all the string filters parameters

I don't want to use robots.txt for this. Any PHP code or any .http access lines will work like a charm. Now I show you what types of urls I want to eradicate. https://www.example.com/search-gadgets/?...
user avatar
0 votes
0 answers
20 views

Is there something like anti-seo techniques? To NOT be found by certain keywords? [duplicate]

I wonder if there is something like anti-seo techniques, enabling me to make a website less findable for certain keywords? For example: I manage a massage website. This website is purely for massages ...
user avatar
  • 101
1 vote
1 answer
174 views

Screaming frog crawling, images, JS and CSS files as well

When I plug in my website URL in the free version of Screaming frog, it also lists the images, CSS and JS files. Is it suppose to be like that?
user avatar
2 votes
1 answer
222 views

How to prevent google index for a specific subpath?

I have my website, say www.example.com, and I want it to be indexed. Anyway I also have one section, www.example.com/section that I don't want to be indexed. I tried adding the following headers to ...
user avatar
  • 121
2 votes
2 answers
968 views

How can I prevent Google from indexing documents stored on Microsoft Azure blob storage?

I have a PDF stored in Azure blob storage. When I search the name of the document on Google search engine, the full link of my PDF appears in the result. I don't want this happen. Can I get Google ...
user avatar
1 vote
1 answer
98 views

Can noindex tags on several pages affect the overall SEO or ranking on Google?

Some SEO Gurus assured me that noindex attributes are good to devalue the unimportant pages. When I asked in the moz Q and A, they're quite sure that having noindex on the bulk of the articles on ...
user avatar
1 vote
0 answers
178 views

How to avoid indexing AJAX requested URLs without also blocking the page from which the call is made?

We use AJAX to include some dynamic, context based content into a normal HTML page. The answer of this HTML call is an HTML segment without HTML headers. The problem is that Google is indexing these ...
user avatar
1 vote
0 answers
86 views

Why is my noindex tag not working? [closed]

I've implemented a no index tag in my staging website header because I've realized it was being indexed. But when we run this page in screaming frog or this tool here to verify the noidex is present ...
user avatar
1 vote
1 answer
43 views

Using `noindex` for recently purchased domain we are migrating to

We recently purchased the .com version of our domain. So we are migrating from oursite.org to oursite.com, but this will take several weeks. The site was previously indexed, and a Google search ...
user avatar
1 vote
2 answers
54 views

Will a robots noindex meta tag completely prevent search engines from indexing a page?

I am wondering if meta tag <meta name="robots" content="noindex,follow"> will completely prevent a website page from being indexed. What if user has registered website from Google Webmaster ...
user avatar
  • 629
0 votes
1 answer
1k views

How can I stop pagination URLs from getting indexed? [duplicate]

I want to prevent pagination URLs from being crawled or indexed anywhere. When I check site:example.com, the search results looks like this. /blog/page/69/ /blog/page/55/ I have not listed this ...
user avatar
3 votes
1 answer
1k views

PDF files still indexed when X-Robots-Tag noindex set in .htaccess

I am trying to analyse the .htaccess file of a website, specifically the following piece of code: <FilesMatch ".pdf$"> <IfModule mod_headers.c> Header set X-Robots-Tag "noindex, noarchive,...
user avatar
1 vote
1 answer
23 views

Proper way to avoid Google from indexing wordpress attachment pages

I recently noticed that the attachment pages of my friend's website appears in Google search. I applied the Yoast plugin solution to redirect those pages to post itself but I want to guarantee that ...
user avatar
  • 13
3 votes
0 answers
74 views

Redirected to www, but Google is indexing no-www without snippets, should I use noindex instead?

I started my blog a month ago and was using non www version for my website. Then, I recently decided to stick to www.example.com version. So I changed it and Google has indexed the www version ...
user avatar
1 vote
0 answers
161 views

"NOINDEX, FOLLOW" turns into NOFOLLOW eventually. Solution is Canonical?

I have recently discovered that Google treats "noindex,follow" pages as "noindex,nofollow" eventually -> https://webmasters.stackexchange.com/a/115879 I have a website with hotel listings. I provide ...
user avatar
  • 11
1 vote
2 answers
409 views

Does Google TRULY respect noindex and nofollow?

Does google REALLY respect noindex, nofollow and blocking content to being indexed and seen via .htacess or robots.txt file? I need to be sure of this 100%, I need to use duplicate content on some ...
user avatar
0 votes
1 answer
312 views

Google indexing Wordpress in subdirectory disallowed in robots.txt

I have a headless wordpress site just using wordpress API. My site is in the root at example.com, and wordpress live subdirectory example.com/wordpress. I set up robots.txt as follows: User-agent: *...
user avatar
  • 135
2 votes
2 answers
107 views

Adding noindex to xrobots to remove Request URL Soft 404

Bit of a technical question here that I'm working on with my dev. I have a load of Ajax request URL's appearing in Search Console as soft 404's. These requests are for buttons on the page i.e. '...
user avatar
  • 81
2 votes
0 answers
682 views

How to 'noindex' a specific image on a specific page on my website?

I'm generally aware how the noindex HTML tag works and how to use it. However, I haven't managed to find a way to not index specific images on specific pages on my website. I'm looking for a ...
user avatar
  • 121
2 votes
1 answer
51 views

Is setting deep filtered categories to noindex a good practise?

The situation now: The project is not launched, but we have lot of categories and a big filter system in the end (color, brand, dimension, size, model, material,..). Most of categories will have a ...
user avatar
  • 199