I have the following subdomains:
api.example.com is supposed to be invisible to Google. Its
robots.txt had a
Disallow / directive. But I don't want any server processing at all to go on at
The main site
www.example.com/robots.txt points to
api.example.com/sitemap.xml (sitemap requires processing).
The problem is that Google's Search Console is complaining that the
sitemap.xml is blocked by the
robots.txt file... I presume it's reading the robots on
api.domain.com. So I tried pointing www's robots to
www.domain.com/sitemap.xml and putting a redirect there. No luck.
So it seems I'm forced to put an
Allow /sitemap.xml on api's
robots.txt. Will Google get confused by this? Will it try to index the sitemap's urls (the sitemap is 100% absolute urls pointing to
www.example.com) and somehow dilute authority between the two domains?
api.example.com is not registered on Search Console as a property.