New answers tagged tags
0
I usually just add a noindex meta tag to tag pages. But your method in robots.txt should work as well, the only downside being that you'll need to manually add each tag, unless they're in a sub-folder of their own ie /blog/tags/tag in which case you could simply add Disallow: /blog/tags/*.
1
2009 - Google, Bing, and Yahoo announce Support for Canonical Links
There is no need to use robots.txt to tackle the duplicate content problem, in February 2009, Google, Yahoo and Microsoft (for their Bing search engine) announced support for the canonical link element which aims to tackle the problem of duplicate content.
Rel="canonical" To The Rescue
So ...
Top 50 recent answers are included
