My code base is shared between several environments (live, staging, dev) & sub-domains (
dev.example, etc.) and only two should be allowed to be crawled (ie.
example). Normally I'd modify
/robots.txt and add
Disallow: /, but due to shared code base I cannot modify
/robots.txt without affecting all (sub)domains.
Any ideas how to go about it?