Google bots have recently indexed my test web site which is not intended for users. How can i exclude my JSP web site from google's search result?
migrated from stackoverflow.com Jan 24 '11 at 2:35
This question came from our site for professional and enthusiast programmers.
Add a robots.txt file on the root of your server with:
You can also add this to your start page (or any page):
This should stop all indexing for crawlers who play nice.
More information at http://www.robotstxt.org/