I receive the following error message: Severe health issues are found in your property. Is robots.txt blocking important pages? Some important page is blocked by robots.txt.
The "some important page" links to the homepage. The error only appears for example.com and not www.example.com. Everything with DNS is resolving and there are no issues. The redirect from www works as well. Google Fetch and Render works as well.
I have removed my robots.txt file, but the issue remains. The robots.txt I was previously using:
User-agent: * Disallow: Sitemap: http://example.com/sitemap.xml
I cannot share the domain which I appreciate makes things more difficult to debug. But any reason why I receive an error message when there is no robots.txt file to block Google from crawling?
The crawl errors: "Google couldn't access your site because of a DNS error," Lookup error: "Your DNS server did not recognize your hostname." and Total DNS errors: "Couldn’t communicate with the DNS server." persist. I have used the Fetch as Google tool and it fetches and renders the site with no issues. I have used the robots.txt Tester and there are no issues there either. I have also checked to see if Google has cached the site, which it has. I have been in contact with my DNS provider and they have assured me that there are no issues on there side. I can tell from the Site Errors graph that it was updated yesterday and it shows Errors/Attempts - 0/1. I've never had this happen before on a completely new property. Any suggestions?