Tell me more ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.
up vote 1 down vote favorite

My client doesn't want the tag pages (www.example.com/tag/tagname) to be indexed by Google. How can I achieve this? Disallow in robots.txt doesn't work. Thanks!

Robots.txt:

User-agent: *
Disallow: /tag/
share|improve this question
2  
Disallow in robots.txt should work. Can you show your robots.txt? – Pekka 웃 Oct 3 '11 at 20:42
User-agent: * Disallow: /tag/ – priktop Oct 3 '11 at 20:59
1  
that should work. How much time did you give it to work out? You know it can take several weeks until the change propagates? – Pekka 웃 Oct 3 '11 at 21:02
Nope, I didn't. Than I'll just have to wait. Thanks. – priktop Oct 3 '11 at 21:04
1  
You can submit your updated robots.txt directly through the Google Webmasters site that should speed up Google's response time to your request. – RandomBen Oct 5 '11 at 11:17

migrated from stackoverflow.com Oct 4 '11 at 16:36

2 Answers

up vote 3 down vote accepted

robots.txt is the way to go, but it can take up to several weeks until reindexing.

You may be able to speed up the process - at least as far as Google is concerned - by signing up the site in question with Google Webmaster Tools.

share|improve this answer
up vote 2 down vote

Using meta tags to block access to your site:

To entirely prevent a page's contents from being listed in the Google web index even if other sites link to it, use a noindex meta tag. As long as Googlebot fetches the page, it will see the noindex meta tag and prevent that page from showing up in the web index.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.