Hot answers tagged

9 votes
Accepted

Do noindex,follow pages pass pagerank / link juice?

Yes. Eric Enge: Can a NoIndex page accumulate PageRank? Matt Cutts: A NoIndex page can accumulate PageRank, because the links are still followed outwards from a NoIndex page. Eric Enge:...
user avatar
  • 2,476
9 votes
Accepted

How does "Noindex:" in robots.txt work?

Google used to unofficially support a Noindex directive in robots.txt, however in 2019, they announced that the directive will no longer work. Here is what Google's John Mueller says about Noindex: ...
user avatar
9 votes

Do search engines still crawl a noindex page

Yes, Google still crawl webpages that have noindex tag. But if you have same content on two different webpages and one URL contain noindex tag, while second does not, then you should not worry about ...
user avatar
  • 5,487
8 votes

Should I set NOINDEX header for my JS, CSS and image files?

(I work with Google's crawling & indexing teams) Let's start with the easy one: assuming you don't want these files used for indexing at all, you can just use the robots.txt file to disallow ...
user avatar
  • 7,303
8 votes
Accepted

Does the Title and meta description for noindex pages influence SEO ranking in any way for the rest of the indexed pages?

No, it does not influence in ranking, because that pages is not indexed at all, also it does not harmful for your site in some ways, but if you are placing too many noindex tags, then those pages will ...
user avatar
  • 5,487
8 votes
Accepted

Ok to use meta noindex on 404 pages?

There's no problem having a meta noindex tag on the 404 page, to prevent 200 OK responses being indexed. If this was a PHP page then you could obviously just send a 404 Not Found header as part of the ...
user avatar
  • 41k
8 votes
Accepted

How do I "noindex" a text (.txt) file?

The solution is the same as for X-Robots noindex a folder of PDFs and Prevent XML sitemaps from showing up in Google search results. You use the X-Robots-Tag HTTP header rather than a meta tag. ...
user avatar
8 votes
Accepted

Why does it cause issues to use robots.txt and a meta robots tag at the same time?

The robots.txt standard controls whether the bot can view foo.html under any circumstances. Just because the bot sees a link to it from a different site doesn't give the bot permission to sneak a peek ...
user avatar
7 votes
Accepted

Do search engines still crawl a noindex page

As Goyllo has already stated, search engine bots will crawl pages that have a noindex meta tag. If you think about it, they need to crawl the page in order to see the noindex meta tag in the first ...
user avatar
  • 41k
7 votes

URLs with 'NoIndex` in robots.txt are being indexed by Google

"noindex" directives should not be used in your robots.txt file, instead a noindex meta tag should be added to any pages that you don't want indexed in Google. A NOINDEX tag looks like the below and ...
user avatar
6 votes

URLs with 'NoIndex` in robots.txt are being indexed by Google

Note that Noindex is not part of the original robots.txt specification. Google supported it as experimental feature (see: How does “Noindex:” in robots.txt work?), but it’s not clear if that is still ...
user avatar
  • 21.4k
5 votes

Should I set NOINDEX header for my JS, CSS and image files?

First things first. Google does not index certain file types such as CSS, JavaScript, images, and so on. But, you say, Google does index images. Well yes and no. It indexes images by using the text ...
user avatar
  • 32.5k
5 votes

No index for an entire site

Nick's answer to add robots.txt might not stop Google from index, it just says stop crawling but Google might index - official link here. Adding meta noindex is too risky if you are working with a ...
user avatar
  • 526
4 votes
Accepted

Does noindex metatag have a negative effect on the canonical URLs PageRank?

You should not use both noindex and rel=canonical, because noindex won't let pages pass any PageRank to its canonical version. rel="canonical" is a hint, not a directive, so Google will decide ...
user avatar
4 votes
Accepted

Robots.txt vs. Noindex Tags

Good catch! If you're blocking a page with robots.txt then crawlers will not able able to read the noindex meta tag. In these cases you should send the x-robots-tag HTTP header either via server-side ...
user avatar
  • 85.8k
4 votes
Accepted

if an HTTP page can be cached by proxy should I put "noindex" in the HTTPS version or not?

A canonical link element is an HTML element that helps webmasters prevent duplicate content issues by specifying the "canonical" or "preferred" version of a web page. By default there can be numbers ...
user avatar
4 votes

Will meta setting Meta="NOINDEX" eventually remove page from Google index?

I am not sure if your theory is good because it is based on a very big assumption that your new website will take the credit for your old site after deindexing. Except rel="canonical", you don't have ...
user avatar
  • 1,316
4 votes
Accepted

How to correctly remove MULTIPLE parameters from the Google index using htaccess and canonical / noindex?

You only really need to set the rel="canonical" header. This should be sufficient in ensuring only the canonical URL (ie. the one with no URL params) appears in the SERPs. Setting a noindex robots ...
user avatar
  • 41k
4 votes
Accepted

Is there differences between deleting low quality articles vs no-indexing low quality articles SEO wise?

You can take either path here. What matters is how you go about it. Let's say you decide to delete those articles. That should be fine. Just make sure you 301 redirect those URL's to something better ...
user avatar
4 votes

How to prevent google index for a specific subpath?

You are sending Google two conflicting commands: you are telling them to NOINDEX some pages but then you are also preventing them from reading the NOINDEX header by blocking them from crawling these ...
user avatar
4 votes
Accepted

Deindex a site through Google Search Console without access to the site's server to make changes?

You Can Submit a Removal Request Submitting will remove URLs for 6 months, this will buy you some time until you're able to put a permanent solution in place. In your case, you might find the prefix ...
user avatar
  • 4,490
3 votes
Accepted

Is it possible to regain a site's traffic after losing some to a transfer / merge?

If you are redirecting old pages to the new pages that have the same content as the redirected pages (and ideally the same URL structure), then patience is needed. I suggest that you look at the ...
user avatar
  • 733
3 votes

Do noindex,follow pages pass pagerank / link juice?

Google recently (December 2017) said that noindex,follow pages end up not not passing link juice. Initially link juice will get passed, but eventually the links on the noindex page will be ignored....
user avatar
3 votes

Having an iframe of which inside the page has a noindex nofollow tag would it affect the rankings of the page having the iframe? Is it cloaking?

No, the NINDEX, NOFOLLOW on the embedded iframe will not effect the page it is displaying on. As they are neither on the actual page, nor within the <head> section of the pages source code. I ...
user avatar
  • 6,077
3 votes

What is the proper SEO handling of pages appearing in popups using IFRAMEs?

The noindex should be enough to stop it getting indexed. With regards to iframes and linking, I can't actually find any guidelines from Google. In fact, all they seem to officially say on the entire ...
user avatar
  • 1,925
3 votes

Why doesn't Google remove my noindex and 404 pages?

Days, Weeks and Months... It can take Google days, weeks and even months for Google to remove pages marked noindex, robots and 404's. Generally it takes Google several crawls before Google acts on ...
user avatar
  • 32.6k
3 votes
Accepted

Should I add rel nofollow to internal links which already have meta noindex?

It makes a difference. The bots do this: Go to noindex.html. Crawl it, check it, do all the usual checks, get all internal links Don't index this page, because rel="noindex" Repeat for each internal ...
user avatar
  • 6,736
3 votes
Accepted

should you let search result page to be indexed

According to Google's Webmaster Guidelines: Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don't add much value for users coming from search ...
user avatar
  • 2,299
3 votes
Accepted

How to do SEO for a business listing website that contains temporarily available content

It is very hard to get local directory sites ranked in search engines these days regardless of whether or not the content is temporary. See this parody letter purportedly from Google, but really ...
user avatar

Only top scored, non community-wiki answers of a minimum length are eligible