Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

We are running a Magento store set up and was looking to block all pages with the exception of a select few.

It seems the only way we can do this is with blocking direct paths to files that are in the root and then wildcarding various other diretories.

My question is if we have a product like website/ultragloss-black.html the canonical is actually /zurfiz/ultragloss-solid-colours/ultragloss-black.html

If we block /zurfiz/* will this block the short url version as the canonical is in the /zurfiz/ directory?

share|improve this question
up vote 2 down vote accepted

It won't block the short url version, but it does mean that you're telling search engines "the canonical is here but I don't want you to look at it", which defeats the object of having a canonical page.

share|improve this answer
ok, another quick related question... if I was to block /ultragloss-black.html would that block every instance of it or just the one in the root? – Vince Pettit Jul 12 '11 at 9:38
Just the one in the root. – paulmorriss Jul 12 '11 at 10:11

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.