Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

My client doesn't want the tag pages (www.example.com/tag/tagname) to be indexed by Google. How can I achieve this? Disallow in robots.txt doesn't work. Thanks!


User-agent: *
Disallow: /tag/
share|improve this question

migrated from stackoverflow.com Oct 4 '11 at 16:36

This question came from our site for professional and enthusiast programmers.

Disallow in robots.txt should work. Can you show your robots.txt? – Pekka 웃 Oct 3 '11 at 20:42
User-agent: * Disallow: /tag/ – priktop Oct 3 '11 at 20:59
that should work. How much time did you give it to work out? You know it can take several weeks until the change propagates? – Pekka 웃 Oct 3 '11 at 21:02
Nope, I didn't. Than I'll just have to wait. Thanks. – priktop Oct 3 '11 at 21:04
You can submit your updated robots.txt directly through the Google Webmasters site that should speed up Google's response time to your request. – Ben Hoffman Oct 5 '11 at 11:17
up vote 3 down vote accepted

robots.txt is the way to go, but it can take up to several weeks until reindexing.

You may be able to speed up the process - at least as far as Google is concerned - by signing up the site in question with Google Webmaster Tools.

share|improve this answer

Using meta tags to block access to your site:

To entirely prevent a page's contents from being listed in the Google web index even if other sites link to it, use a noindex meta tag. As long as Googlebot fetches the page, it will see the noindex meta tag and prevent that page from showing up in the web index.

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.