In our robots.txt we have something like
User-agent: * Disallow: /v6.0 Disallow: /v5.8 Disallow: /v5.7 Disallow: /v5.5 Disallow: /v5.1 Disallow: /v5.0
Which properly prevents search engines from crawling any of our URLs prefixed by
/v5.8 etc... However, there are certain pages within those disallowed URLs that we do want indexed, such as
Is doing such a thing possible? If so, what would be the appropriate syntax?