Questions tagged [noindex]

Common value for a HTML robots meta tag.

Filter by
Sorted by
Tagged with
0 votes
1 answer
113 views

Can I fix noindex errors in Google Search Console for webp images?

Google Search Console is showing a noindex error for my images in the WEBP image format, and I don't know how to fix this problem. Does this type of noindex error cause any problems? How can I get ...
0 votes
0 answers
21 views

Should I index user-generated content (UGC) products on my website or not? Should I add them to the sitemap?

We are a marketplace and our users introduce their products on our website through seller panels. In other words, these contents are user-generated content (UGC). Considering that the introduced ...
0 votes
0 answers
47 views

How can Noindex a parked domain?

I have a main domain and it is index and follow. and another domain is parked on main domain. how can Noindex parked domain? I don't want Google to index the parked domain.
2 votes
1 answer
134 views

Marketing company set all pages to noindex,nofollow on website

In Jan 2022, a marketing company that was rebuilding my website set all pages to noindex,nofollow. The agreement also allowed them to run ads, optimize, improve SEO, etc., and I was paying a monthly ...
0 votes
0 answers
39 views

how to remove noindex nofollow code that is only showing on Googlebot Smartphone

A website running OpenCart v3 has had "noindex, no follow" added to the code somewhere so that it only shows when viewed by Googlebot Smartphone. I debugged via Dev Tools and found the meta ...
1 vote
2 answers
46 views

How to protect data on a website from indexing and inclusion to machine learning or LLMs training data?

I'm supporting a larger web database that contains many hundreds of articles with consumer grade and technical tests of hardware and electronics. Our policy has always been to provide open access to ...
1 vote
2 answers
57 views

What does it mean, 404 page with noindex and non-self-referencing canonical?

I am confronted with a strange setup I never seen before - and I don't know, how to deal with it. Details: There is a bunch of no longer existing pages. All of them have Status code 404, Their ...
2 votes
2 answers
393 views

Should I noindex user profile page with little content?

I have a website. Users can subscribe to this website and create their own profiles. The pages created by users are as follows: https://example.com/ardacar https://example.com/stackoverflow ...
0 votes
1 answer
48 views

How to overcome Google indexing issue? [duplicate]

It's almost been more than 6 months i'm facing Google indexing issue my site can not be indexed. The issues are described below: 1- "Excluded by ‘noindex’ tag" although I have searched all ...
0 votes
1 answer
24 views

Google does not index my main page [duplicate]

I was trying to index the main page of my site but it is not successful because I have a url with noindex and some redirected pages. Why is this influencing the main url ?
1 vote
1 answer
99 views

How to handle password protected page?

I have an Ecommerce website, and there will be a customer profile page which is password protected. As it is protected, I assume crawler will be getting a 302 to an unprotected route(e.g. /) when ...
0 votes
1 answer
78 views

Bing and DuckDuckGo have suddenly stopped indexing my website

Until a month or two ago Bing and DuckDuckGo were returning search engine results for my website. I've just realised that this is no longer the case. Worse, neither can even find my website when I ...
1 vote
0 answers
175 views

Google Search Console detects issue with noindex pages excluded from sitemap, why? How to resolve?

Google emails me this: Message type: [WNC-10030322] Search Console Page indexing issues detected in [DOMAIN] To the owner of [DOMAIN]: Search Console has identified that your site is affected by 1 ...
1 vote
1 answer
189 views

Can a sitemap contain URLs that have noindex meta tag?

I have a quite complex logic based on several fields to decide whether one of my URLs should set the noindex meta tag or not. Moving that logic to the sitemap generation could over-complicate my code. ...
0 votes
0 answers
20 views

Reproduce the API links appearing in Google search results

We have the following problem. The links to our API (that doesn't require any authentication) have suddenly started showing up in Google and Bing search results. As far as we know, these links have ...
2 votes
2 answers
1k views

X-Robots-Tag: noindex on an HTTP 302 response to remove subdomain

This very related to this question "X-Robots-Tag: noindex" on an HTTP 301 response, however I don't see a definitive answer. We have subdomains we use for our affiliate links, the ...
1 vote
1 answer
198 views

Does noindex for subpages affect the whole domain?

I want to share the unreviewed version of my future website with a few people on an URL like this: example.com/hidden-unreviewed-version I would apply noindex on it and all its subpages to hide them ...
1 vote
1 answer
61 views

Is blocking indexing and crawling at the same time bad?

have a lot of pages that I want to disallow crawling and indexing on, because of crawl and index budgets. I can't just disable crawling because they are linked together with internal links and I can't ...
4 votes
2 answers
220 views

Excluded by 'noindex' tag on pdf files on Wix website

I am getting Google Search Console reports indicating "Excluded by 'noindex' tag" issue on pdf files. Why is Google sending me emails when the pdf files are excluded by noindex tag? Noindex ...
1 vote
0 answers
30 views

SEO impact on ranking for pages that are linked only from 1 page that is noindex/follow and is paginated

I don't think my problem classifies as Orphan Pages, but read on and be the judge. I run a small "e-commerce" website that suffers from all the common issues like product description ...
10 votes
6 answers
7k views

Should I set NOINDEX header for my JS, CSS and image files?

Are there any harms if my site send NOINDEX headers for all my static assets? For image files, I refer to those valueless, e.g. background images, button images, etc. Update: more background ...
1 vote
0 answers
49 views

No indexing to all the URLs ending in feed

I want to add no indexing to all the URLs ending in "/feed" using an x-robots-tag. There is a code to noindex doc files <FilesMatch ".doc$"> Header set X-Robots-Tag "...
3 votes
1 answer
98 views

Canonical or noindex for almost(80-90%) duplicate content?

I have a site where I provide solutions to problems/questions. In my CMS, the 'Question' and 'Solution' are two different content types. The solutions are embedded within the Question pages. For ...
4 votes
1 answer
53 views

Deindex a site through Google Search Console without access to the site's server to make changes?

Is there an option in GSC to exclude the whole GSC property (all URLs of it) from indexing? Implementing noindex isn't feasible. I don't have access to the server to make changes. I can't add a meta ...
3 votes
1 answer
247 views

Why my keyword is showing 30 average position on search console but isn't showing in top 100 in google?

When I go to google search console, I see the average position of one of my keywords at 30th, but when I manually search for that keyword in that specific area my keyword is not on even 100th position....
2 votes
1 answer
2k views

Use noindex for URL with parameters?

I have a homepage, https://example.com, where a parameter can be added to unlock a discount on our website https://example.com?code=abc. I don't want this URL to be appear in Google search results, ...
2 votes
1 answer
988 views

Is it possible to disable indexing through JS?

Is it possible to disable Google indexing of some web page if this is placed to head tag <meta name="googlebot" content="noindex" /> using only JS? Or is it all a hoax and ...
2 votes
1 answer
616 views

Should search engines be allowed to index wp-includes and wp-content in WordPress?

Should the wp-includes and wp-content directories in WordPress be indexed by search engines or not? Should we prevent indexing using noindex in X-Robots tag?
4 votes
1 answer
165 views

Should I noindex a coming soon page?

I am working on a coming soon page that will list our logo, contact form and a newsletter subscription. It is rather short and simple. In regards to SEO, should I set it noindex nofollow perhaps then?
5 votes
1 answer
771 views

Why does it cause issues to use robots.txt and a meta robots tag at the same time?

It seems common wisdom that using X-Robots-Tag/meta robots with robots.txt to block a URL from being indexed "can cause issues", e.g.: Using both X-Robots-Tag and meta robots on a URL is ...
2 votes
3 answers
76 views

Impact of visitors on a 'noindex' page

I have a page which has a 'noindex' attribute. So google will not index this page at all. But this page has lots of visitors. Does this number of page views have any impact on my SEO?
2 votes
1 answer
130 views

Robots.txt not blocking yet GSC URL Inspection Tool says it is

Recently I realized Disallow /was set on my staging sites. I didn't realize until I got a warning in Search Console... Mistakes happen I've removed the directive and cleared all caches at least 10 ...
1 vote
1 answer
93 views

If noindex pages don't have H1, meta tags, or other desirable elements for SEO, will it hurt the SEO of indexed pages?

I have some pages with noindex. These pages have some SEO errors. SEO errors include: not using H1 Not using meta tags Not adding alt="" tags to images But there no such SEO problems on my ...
5 votes
2 answers
132 views

Should I keep content="index, follow" on pages where I have canonical to another site

I have a URL on website A that contains content from website B. On-site A at the moment we include canonical that shows site B and at the moment we do not include this URL into site A sitemaps. ...
0 votes
1 answer
389 views

301 or noindex or both [closed]

I have lots of categories but I use different pages as landing page for each categories and in pages I just load the contents of each category that I need (I cant delete my categories) what is best ...
0 votes
1 answer
199 views

HTML sitemap with noindex, follow: Matt Cutts vs John Mueller

Ref: Do noindex,follow pages pass pagerank / link juice? I have a requirement wherein I want to create an HTML sitemap to help users navigate to deep pages. This sitemap page will be linked from ...
1 vote
1 answer
73 views

Indexed, though blocked by robots.txt [duplicate]

I am working on an e-commerce website (similar to e-bay) where users can buy or sell products. The urls for buying a product are like: example.com/browse/cars example.com/browse/toys etc And the urls ...
1 vote
1 answer
40 views

Unknown long phrases searched on my website reported in search console coverage

I checked my search console coverage. It seems that many long phrases are being searched on my site, and I have many noindex pages in coverage, but I have never made such a page. is my website hacked. ...
3 votes
0 answers
49 views

Google Search Console reports error for 'noindex' tag on sitemap

My sitemap is dynamically generated by Yoast SEO WordPress plugin, and is returned with noindex. I submitted the sitemap URL to Google Search Console, but it reports an error: Submitted URL marked ‘...
1 vote
1 answer
56 views

Block short URL in robots.txt

We have example.com/article-page-one/ This page has a short URL in Wordpress like this : example.com/?p=1 In this page we put short URL for users. What will happen if we block short URL? The robots....
5 votes
1 answer
5k views

Ok to use meta noindex on 404 pages?

I have a custom 404.html file on my website that gets served with a 404 status code when a URL is not found, standard stuff. But if you visit the exact path /404.html on the server, the server says "...
4 votes
1 answer
941 views

Link rel="nofollow" vs robots.txt disallow for "/search" URLs?

There's a /search path on my web app that I don't want robots to crawl or index. What would be the best approach for this scenario? 1: Block them from accessing by adding a Disallow for /search on ...
4 votes
1 answer
523 views

How do I "noindex" a text (.txt) file?

I have a directory full of .txt files that are used as part of a larger javascript application. The text files are not inteded to be directly accessed, and are used as includes on separate pages as ...
1 vote
1 answer
2k views

Why google jobs search is not showing my all jobs?

I am facing a very weird issue to show the jobs on Google job listing. I have followed the below steps and I am still not able to see all of my jobs on Google jobs. Followed correct Job Posting ...
1 vote
1 answer
63 views

Google Search Console coverage reports "Submitted URL marked 'noindex'" for a 404 page not in the sitemap without a noindex tag

Error: "Submitted URL marked 'noindex'" error in the Google Search Console coverage report Situation URL is not submitted in our sitemap Google is not indexing the URL There is no noindex ...
1 vote
2 answers
69 views

Does crawler index duplicate page which has canonical URL?

Suppose I have two pages with the same content: example.com/a example.com/b so I put a canonical tag <link rel="canonical" href="example.com/a"/> at page example.com/b. I ...
3 votes
2 answers
2k views

How can I prevent Google from indexing documents stored on Microsoft Azure blob storage?

I have a PDF stored in Azure blob storage. When I search the name of the document on Google search engine, the full link of my PDF appears in the result. I don't want this happen. Can I get Google ...
1 vote
1 answer
22 views

No directory listing index page

I have some audio assets directories on my website. The server allows directory listing. i.e. all audio files will be listed if the user visited example.com/assets/audio/nature/. I don't want to ...
0 votes
1 answer
476 views

Can a 410 gone page remain indexed?

Does somebody experienced a page with 410 status code in index? Could you imagine, that an indexed healthy page, which is set to 410 only through adding of <?php header( "HTTP/1.1 410 Gone&...
1 vote
1 answer
242 views

Can having too many noindex pages hurt ranking? [duplicate]

Can having too many noindex pages hurt ranking? Eg: 50,000 low quality noindex forum posts with 1,000 indexed quality posts. Can those 50,000 low quality noindex forum posts affect for 1,000 ...

1
2 3 4 5