Here is content of my robots.txt file:
User-agent: * Disallow: /images/ Disallow: /upload/ Disallow: /admin/
As you can see, I explicitly disallowed all robots to index the folders
admin. The problem is that one of my clients sent request for removing the content from the images folder because .pdf document from the
images folder appeared in the google search results. Can anyone explain me what I'm doing wrong here, and why google indexed my folders?