I had to do a massive URL change stuff (Categories and Products) on my e-commerce site while keeping 301 redirect of old URLs to new ones. I did change category URLs (appr: 800 URLs) to new and improved ones and went live with them; but for an automated (scripted) 301 redirect; I had to get done with new improved Products URLs as well. And to avoid any 404 issues with old category URLs; I didn't want Google to crawl my site until I was done and gone live with Products' new URLs; I put a robots.txt block on my entire site! thinking that I'll have enough time converting all products to new URLs and keeping Google away of the site.
It was intended to be temporary block. When I put robots.txt back to Allow all URLs; things started appearing all wrong! All the site's ranking has gone down!
I am confused; what to do now!
- The robots.txt is now allowing all URLs;
- 301 redirect for old URLs is in place and working.
- Entire site has NEW URLs.
- I have submitted new sitemaps
And I want to gain the ranking all back to normal. I have submitted new sitemaps and Google's not friendly with them. 99.9% of URLs in sitemap are still saying "URLs blocked by robots.txt".
What did I do wrong? And how's it gonna solve the best way?