1

Recently, I moved all pages from subdomain.domain.com/<lang>/ to <lang>.subdomain.domain.com and submitted new sitemap.xml in Google Search console inteface.

From the server logs, I see that GoogleBot keeps trying to index old pages located at subdomain.domain.com/<lang>/ and throws errors in Coverage report. How can I stop Google to index those pages?

Will adding

Disallow: /en/
Disallow: /it/
Disallow: /fr/
etc...

into robots.txt help?

0

I am amazed I didn't think about 301 redirects. If I configured it back in April, my site's crawl speed would be so much faster since search engines would not have to deal with all those 404 responses.

| improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.