Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Possible Duplicate:
Blocking Search Engines to Crawl Parts of a Website?

I have a page which i don't want search engines to index or crawl. I am not sure hat should i put in my robots.txt file to tell search engines not to crawl/index that page.

The page it itself is getting generated dynamically and do not have a predefined template for it all i know about its URL which is pre-defined and will remain unchanged.

I have this page say at


Please suggest what i should do to achieve this.I am using WordPress for my website

share|improve this question

marked as duplicate by John Conde Mar 25 '12 at 20:15

This question was marked as an exact duplicate of an existing question.

up vote 0 down vote accepted

Just tell everybody (*) not to crawl the URL:

User-agent: *
Disallow: /my-nonindexable-page/
share|improve this answer

Not the answer you're looking for? Browse other questions tagged or ask your own question.