We have an app we are migrating. The old website had deeply nested
robots.txt files at some point and then the old developers started handling those request with redirects to the root page. So:
a request to
http:://example.com/foo/bar/robots.txt is now a
I assume that because the old devs are doing a 302 instead of a 301, it continues to index that old path. Will a
http://example.com/robots.txt tell google to abandon the old requests? What other things can I do to encourage these old paths to disappear from search engine indexing?