I have a landing page that can be called by HTTP and also by HTTPS. The canonical URL links to the HTTP version.

  1. In some comments I have read that the HTTPS version is never read by a Googlebot. Is this true?

  2. Some people say, you waste Google crawl credits because Google needs to crawl the same content again. Is this true?

  3. Do I really have a problem with duplicate content?

  • 1
    1. Not entirely 2. No. 3. No.
    – John Conde
    Nov 5, 2013 at 19:09

1 Answer 1


Googlebot will crawl HTTPS links. Source: Will Googlebot crawl HTTPS URLs that are encrypted by SSL?

Googlebot does have a limited crawl budget for every site. The number of pages on a site that Google is willing to crawl is determined by the amount of PageRank in the site and how fast your server is. Googlebot does so much crawling that very few sites have more pages than Googlebot is willing to crawl. Unless you have hundreds of thousands of pages, very little Pagerank, and a slow server; it shouldn't be an issue for you. Google says:

Our goal is to crawl as many pages from your site as we can on each visit without overwhelming your server's bandwidth.

The fact that you use a canonical meta tag means that you will not have any duplicate content problems. Your canonical meta tag will let Google safely identify the duplicate content and tell it which URL to show in the SERPs. Even without the canonical, Googlebot does a fairly good job identifying and correctly handling common causes of duplicate content such as this. Google rarely penalizes for internally duplicated content. For more information see: What is duplicate content and how can I avoid being penalized for it on my site?

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.