The business I work for recently migrated our e-commerce site from Celerant to Magento. Despite using a robots.txt file and a 301 redirect extension, webmaster tools is reporting that our "not found" errors are increasing by the day- actually 200,000+, all from our old site.
I've tried 301 redirects which don't seem to be working and then blocking the URLs with the robots.txt with Disallows including wildcards but the errors continue to increase. Any advice would be greatly appreciated. Here is an example of one of our 404 URLs.
This is how we tried to block it in our robots.txt. Is this correct?
Originally we used:
Disallow: /category.cfm
A few days ago we decided to try:
Disallow: /*category