Tagged Questions
1
vote
2answers
32 views
Robots.txt Blocking Blog Tags?
Tags are causing duplicate content on my website and I want to make sure that I block them from being indexed. Is this the right syntax to use for blocking those Tags from being crawled?
User-agent: ...
1
vote
1answer
46 views
Blocking URLs and canonical questions
We are running a Magento store set up and was looking to block all pages with the exception of a select few.
It seems the only way we can do this is with blocking direct paths to files that are in ...
