I noticed Search Engines were flagging my index or home page with duplicate content/title/description, etc. Basically, it was indexing:
http://www.example.com
https://www.example.com
http://www.example.com/
https://www.example.com/
I think I solved one problem with using canonicalization like this:
<link rel="canonical" href="https://www.example.com/" />
But it still shows me there is a duplicate between these two URLs:
http://www.example.com/
https://www.example.com/
Strangely, I specifically canonicaled that I wanted
https://www.example.com/
How can I stop the Search Engines from indexing all of these variations so they see them all as one domain? I could add them to the robots.txt
file but I fear it would stop indexing the site altogether.