Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I use WordPress and /sample-post/ URLs for my posts and /yyyy/mm/ for the archives.

Google has indexed the site fully.

Since the archives currently display full posts I've thought that I shouldn't let Google index the archive pages because they contain the full posts and that will be duplicate content. Thus my robots.txt contains:

Disallow: /2009/
Disallow: /2010/
Disallow: /2011/
Disallow: /2012/
Disallow: /2013/
Disallow: /2014/
Disallow: /2015/

Do you think this is good practice or would it harm my rankings and/or reachability?

share|improve this question
    
Good post, just to be clear, do you mean block everything but categories? The thing that brought this problem to my attention was doing Google image search and it showed 4 of same image, from tag/archive, page, post and home! It's on home as part of a slider (featured posts). So what would be benefit of category over pages and posts only? Or do you mean mix or all 3? I also use Yoast but very new to this. –  user28535 Jun 4 '13 at 7:07
add comment

1 Answer

Indeed, you need to avoid duplicate content on your Wordpress site. Wordpress often generates duplicate content between categories, archives and tags.

In order to fix this issue you can block URLs of archives in robots.txt but the best option is to put <meta name="robots" content="noindex, follow"> on archives pages to avoid getting these URLs indexed by Google.

To do this, you can download Wordpress SEO plugin from Yoast. When plugin is installed, you have an option to put this meta wherever you want (on archives pages, on tags pages, on categories pages...). You can go then to the menu of plugin: SEO => Titles and metas.

In my opinion, best pratices for SEO are to put this meta on archives and tags pages and let Google crawl categories pages. I always have avoided duplicate content on Wordpress site like this.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.