webmaster tools for my site displays that
robots.txt unreachable and for all links in sitemap it says network unreachable. sitemap.xml unreachable.
These appear in crawl stats page.
I discussed with the support team of my hosting and they said...
I have verified apache logs, i cannot see any issues on your website/webserver/
There may the routing issue from the googles server to our server.
When a google bots hits goes high the IP will be automatically blacklisted by our firewall to avoid server loads & downtimes.
As we donot have access to their services, We cannot able to give details of their details/logs etc.
The sitemaps link shows an exclamation mark which means the file was not reachable.
What could be the problem and how to solve it?