Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I sell PDF patterns and when someone types my website and file type PDF in Google, all of my patterns for sale are listed to download for free. I use WordPress and Jigoshop. I need to find a way to block the PDF files from coming up in a Google search but still make them available to download when a customer purchases them. Any ideas?

share|improve this question
How is it possible to download the files without paying for them? – DisgruntledGoat Jul 11 '13 at 14:11

You can block Google indexing certain file extensions by using the robots.txt file on your server.

SOURCE: Block or Remove Pages robots.txt

To block files of a specific file type (for example, .gif), use the following:

User-agent: Googlebot Disallow: /*.gif$

The above will block Google from indexing gif files and obviously you just adjust the code to: User-agent: Googlebot Disallow: /*.pdf$ if you want to block all search engines rather than just Google you can use: Disallow: /*.pdf$.

This can cause the issue of not indexing PDF files that you want indexing and therefor if you do not want to block based on file extension would be to use:

Disallow: /path/to/pdf/thefilename.pdf

share|improve this answer

You need to outright block your files from anyone who hasn't paid, not just the Google spider! To prevent direct download links, you can either store the files outside your site root or use an .htaccess rule to deny all access to the PDF folder(s).

Once a user has paid, a PHP script can reach inside the inaccessible PDF folder and get the PDF to download.

share|improve this answer

You could configure your server to use X-Robots-Tag=noindex HTTP header for PDF files.

If you are using apache with mod_headers, you could put this in your httpd.conf or .htaccess file:

<Files ~ "\.pdf$">
    Header append X-Robots-Tag "noindex"
share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.