Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

By accident I have let Google index lots of junk pages. Now I have added them to disallow in robots.txt.

Will Google completely remove the pages after seeing the are disallowed from robots? Please note that I have far to many pages to manually remove these pages in Google's Webmaster Tools.

share|improve this question

The surest way to get those pages out of index is to use this in the HTML head section:

<meta name="robots" content="noindex" />

Sometimes Google indexes some URLs (but not the content) despite the Disallow in robots.txt. See my answer to this question for details.

share|improve this answer

Depending on the volume of URLS that need removing it could take weeks to months, Google simply doesn't like to quickly drop pages as it gives some time in case the webmaster has made a mistake. So you either need to be patient or simply remove them using the tool.

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.