Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I am getting DNS error from last few 5 days in my Google Webmaster Tools. That's the reason I would like to confirm my robots.txt file.

Is the below robots.txt file is correct or not?

User-agent: *
Allow: /

Sitemap: http://example.com/sitemap.xml

Please help me to solve this doubt.

share|improve this question

2 Answers 2

up vote 1 down vote accepted

If you're getting a DNS error, it's not related to your robots.txt - it's related to your DNS settings. You can check for DNS errors with online tools like: DNS Health

If you need additional help with that, I'd suggest making a screenshot of your DNS table settings from your DNS service provider and asking another question with that screenshot pasted in it (i.e., example).

By the way, the accepted answer regarding your other robots.txt question is correct. I would stick with that for what you were asking about previously - robots.txt directives are not the cause of any DNS errors.

share|improve this answer
    
dan, here is the error dnscheck.pingdom.com/… What action i should pick up to solve this problem –  Sundara Jun 24 '13 at 21:14
1  
You've got issues with your nameservers. I'd close out this question and add a screenshot like I suggested to another question. I'll try to help there later. –  dan Jun 24 '13 at 21:21
    
now i received a new type of error from google adsense Issues: Site does not comply with Google policies . Now what you recommend me for this? webmasters.stackexchange.com/questions/50021/… –  Sundara Jun 25 '13 at 14:45

To allow all:

User-agent: *
Disallow: 

To disallow all:

User-agent: *
Disallow: /

It's a bit confusing, and unintuitive I know. As a simple way of generating them I tend to use the generator tool.

share|improve this answer
    
Still confused, some people are teaching in this way webmasters.stackexchange.com/questions/49897/… and you are teaching in some other way. Which one is correct? –  Sundara Jun 24 '13 at 20:57
2  
The issue is being confused because in the other questions, you're asking about Googlebots exclusively, which the Allow directive is suggested to be used by them (see my original answer on this). If you're not specifying Googlebots like in this question, then the "Disallow" directive is more widely used. Again, this is dependent on whether you're only allowing Googlebots or not. –  dan Jun 24 '13 at 22:49

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.