My robots.txt is the typical that allows all bots everywhere
User-agent: *
Disallow: /
When I test it with Google tool everything is OK.
But in Google Search Console I get an error that my site can't be accessed.
Can somebody help?
My robots.txt is the typical that allows all bots everywhere
User-agent: *
Disallow: /
When I test it with Google tool everything is OK.
But in Google Search Console I get an error that my site can't be accessed.
Can somebody help?
When I test it with Google tool everything is ok.
The tool is simply telling you that the file is syntactically valid. Whether it blocks (or allows) traffic is another matter.
But in Google Search Console I get an error that my site can't be accessed.
User-agent: * Disallow: /
As already mentioned in comments, this blocks everything and allows nothing! To allow everything (the default action) you should remove the /
(slash) on the Disallow:
line:
User-agent: *
Disallow:
Or simply remove all the directives (or even the file itself).
User-agent: * Disallow: /
does not "allow all bots everywhere". It blocks all bots from accessing your home page. – Maximillian Laumeister Dec 5 '18 at 0:06