Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

so if I disallow tempPage, does it mean tempPage_1, temp_Page_2, tempPage_x are also disallowed? I tried to google this up, but I don't know...

share|improve this question
up vote 3 down vote accepted

1) If tempPage_1, temp_Page_2, tempPage_x are subdirectories of tempPage then, yes, they are blocked.

2) If they are parallel directories then, no, they are not blocked.

3) If they are separate files then, no, they are not blocked.

Assuming #1 is not true, to block them all you would use:

disallow tempPage*
share|improve this answer
Pretty sure this is incorrect... – DisgruntledGoat Nov 20 '10 at 0:33
what is incorrect? – TPR Nov 20 '10 at 0:36
Google, Yahoo, and Microsoft honor wildcards in the disallow statement – John Conde Nov 20 '10 at 0:47

Yes those pages would be blocked, assuming they are at the same directory level. There is no * wildcard in robots.txt, except a single * for the User agent.

In other words this...

User-agent: *
Disallow: /tempPage

...would block yoursite.com/tempPage, yoursite.com/tempPage_1, yoursite.com/temp_Page_2, yoursite.com/tempPage_x.

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.