Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

so if I disallow tempPage, does it mean tempPage_1, temp_Page_2, tempPage_x are also disallowed? I tried to google this up, but I don't know...

share|improve this question
add comment

2 Answers

up vote 3 down vote accepted

1) If tempPage_1, temp_Page_2, tempPage_x are subdirectories of tempPage then, yes, they are blocked.

2) If they are parallel directories then, no, they are not blocked.

3) If they are separate files then, no, they are not blocked.

Assuming #1 is not true, to block them all you would use:

disallow tempPage*
share|improve this answer
    
Pretty sure this is incorrect... –  DisgruntledGoat Nov 20 '10 at 0:33
    
what is incorrect? –  TPR Nov 20 '10 at 0:36
1  
Google, Yahoo, and Microsoft honor wildcards in the disallow statement –  John Conde Nov 20 '10 at 0:47
add comment

Yes those pages would be blocked, assuming they are at the same directory level. There is no * wildcard in robots.txt, except a single * for the User agent.

In other words this...

User-agent: *
Disallow: /tempPage

...would block yoursite.com/tempPage, yoursite.com/tempPage_1, yoursite.com/temp_Page_2, yoursite.com/tempPage_x.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.