Skip to main content
Clarifications, and added tags. Also removed URL since they can become unavailable and often seen as self-promotional or spam.
Source Link
dan
  • 15.2k
  • 11
  • 45
  • 52

Googlebot is unable to Crawlaccess my websitesite's robots.txt

iI am having this issue:

"Google couldn't crawl your site because we were unable to access your site's robots.txt file."

My site: TechGeekZone.com/robots.txt

I have already tried all the suggestions provided in the related problems but nothing seems to be working. I am using a plugin that has my site in maintenance mode. Could that be the issue?

I have made a robots.txtrobots.txt file and pushed it in the root directory but the problem remains.

P.S: Some people suggested it was due to do withthe Yoast plugin, so iI have deactivated it, also. Also, I am using Google XML sitemaps and iI have unchecked the option where it says to make sure the Physical Robots.txt isn't therephysical robots.txt is in the Rootroot directory. But the problem still remains.

Any kind of help is highly appreciated. Thank you!

Googlebot is unable to Crawl my website

i am having this issue:

"Google couldn't crawl your site because we were unable to access your site's robots.txt file."

My site: TechGeekZone.com/robots.txt

I have already tried all the suggestions provided in the related problems but nothing seems to be working. I am using a plugin that has my site in maintenance mode. Could that be the issue?

I have made a robots.txt file and pushed it in the root directory but problem remains.

P.S: Some people suggested it was to do with Yoast plugin, so i have deactivated it, also, I am using Google XML sitemaps and i have unchecked the option where it says to make sure the Physical Robots.txt isn't there is the Root. But the problem still remains.

Any kind of help is highly appreciated. Thank you!

Googlebot is unable to access my site's robots.txt

I am having this issue:

"Google couldn't crawl your site because we were unable to access your site's robots.txt file."

I have already tried all the suggestions provided in the related problems but nothing seems to be working. I am using a plugin that has my site in maintenance mode. Could that be the issue?

I have made a robots.txt file and pushed it in the root directory but the problem remains.

P.S: Some people suggested it was due to the Yoast plugin, so I have deactivated it. Also, I am using Google XML sitemaps and I have unchecked the option where it says to make sure the physical robots.txt is in the root directory. But the problem still remains.

Post Migrated Here from wordpress.stackexchange.com (revisions)
Source Link
Sana Qureshi
Sana Qureshi

Googlebot is unable to Crawl my website

i am having this issue:

"Google couldn't crawl your site because we were unable to access your site's robots.txt file."

My site: TechGeekZone.com/robots.txt

I have already tried all the suggestions provided in the related problems but nothing seems to be working. I am using a plugin that has my site in maintenance mode. Could that be the issue?

I have made a robots.txt file and pushed it in the root directory but problem remains.

P.S: Some people suggested it was to do with Yoast plugin, so i have deactivated it, also, I am using Google XML sitemaps and i have unchecked the option where it says to make sure the Physical Robots.txt isn't there is the Root. But the problem still remains.

Any kind of help is highly appreciated. Thank you!