1

My client doesn't want the tag pages (www.example.com/tag/tagname) to be indexed by Google. How can I achieve this? Disallow in robots.txt doesn't work. Thanks!

Robots.txt:

User-agent: *
Disallow: /tag/
5
  • 2
    Disallow in robots.txt should work. Can you show your robots.txt?
    – Pekka
    Commented Oct 3, 2011 at 20:42
  • User-agent: * Disallow: /tag/
    – priktop
    Commented Oct 3, 2011 at 20:59
  • 1
    that should work. How much time did you give it to work out? You know it can take several weeks until the change propagates?
    – Pekka
    Commented Oct 3, 2011 at 21:02
  • Nope, I didn't. Than I'll just have to wait. Thanks.
    – priktop
    Commented Oct 3, 2011 at 21:04
  • 1
    You can submit your updated robots.txt directly through the Google Webmasters site that should speed up Google's response time to your request. Commented Oct 5, 2011 at 11:17

2 Answers 2

3

robots.txt is the way to go, but it can take up to several weeks until reindexing.

You may be able to speed up the process - at least as far as Google is concerned - by signing up the site in question with Google Webmaster Tools.

2

Using meta tags to block access to your site:

To entirely prevent a page's contents from being listed in the Google web index even if other sites link to it, use a noindex meta tag. As long as Googlebot fetches the page, it will see the noindex meta tag and prevent that page from showing up in the web index.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.