Here is content of my robots.txt file:
User-agent: *
Disallow: /images/
Disallow: /upload/
Disallow: /admin/
As you can see, I explicitly disallowed all robots to index the folders images
, upload
and admin
. The problem is that one of my clients sent request for removing the content from the images folder because .pdf document from the images
folder appeared in the google search results. Can anyone explain me what I'm doing wrong here, and why google indexed my folders?