By accident I have let Google index lots of junk pages. Now I have added them to disallow in robots.txt.

Will Google completely remove the pages after seeing the are disallowed from robots? Please note that I have far to many pages to manually remove these pages in Google's Webmaster Tools.

2 Answers 2


Depending on the volume of URLS that need removing it could take weeks to months, Google simply doesn't like to quickly drop pages as it gives some time in case the webmaster has made a mistake. So you either need to be patient or simply remove them using the tool.


The surest way to get those pages out of index is to use this in the HTML head section:

<meta name="robots" content="noindex" />

Sometimes Google indexes some URLs (but not the content) despite the Disallow in robots.txt. See my answer to this question for details.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.