I am trying to index a page which was set to "discourage search engines to index" until 2021-10-31. Now it's 2021-11-06 and Google does not even try to access the page.
If I use the search console, it get errors it cannot be fetched. Same with the mobile testing tool:
My page meta is content:
<meta name='robots' content='max-image-preview:large' />
User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://example.com/wp-sitemap.xml
There was a forward from page.et/robots.txt to page.et/en/robots.txt which I also disabled. In my Chrome it's still cached, but using an incognito tab I can see the robots.txt
When trying to request the page in Google I see zero evidence of Google trying to access my page, not even the robots.txt - in my web server logs.
Is Google really blocking all requests to my page and storing this persistently for more then 4 days ? Or is there maybe really a technical reasons it does not access my page?
Are there any additional tools to debug this?
Update: In the search console, it displays this:
How do I read these reasons?
Edit 2021-11-07 Same result .. I don't think it's just a caching problem by Google :-( I mostly wonder how I can debug this properly. The output by Google search console does not seem helpful :-(
Edit: I am getting some strange errors in Google Pagespeed which I tried to see if Google can access the page at all. Following up eventual server configuration errors here: https://serverfault.com/questions/1082838/pagespeed-cannot-always-access-page-failed-document-request-ssl-certification