I am utilizing product attributes within Magento. I am also allowing using to filter via these attributes, this then generates new URLs.
In Google webmaster tools under URL Parameters I have alot of parameters such as
- SID
- ___store
- size
- material
- brand
- limit
- productId
- is_redirect
- q
- order
- dir
These generate alot of URLs. As they are all filtered versions of the 'default' pages all information would be indexed and therefore the above pages are creating replica's. Therefore I believe i should disallow crawl?
Also the one i am not sure on is whether I should allow index on Q (search parameter).