I have the following robots.txt file:
User-agent: * Sitemap: https://m.mysite.com.au/sitemap.xml
and when I use the Webmaster Tools to validate it I get it showing that the user agent line is incorrect.
However when I validate it, it comes back as "Allowed".
In both cases it is the same file. So my questions are:
- What is wrong with the User-Agent line?
- I am being asked to remove the User-Agent line. While I understand that * means all agents I don't understand why it has to be removed.
- Any ideas why Google is giving inconsistent results?