In my website's root folder i already have a robots.txt file with some rules for the domain name www.example.com.

My website is multilingual so i have setup with drupal de.example.com, fr.example.com & es.example.com

I want to exclude the subdomain es.example.com from google's search results.

Because there is only one root, will the following rules work in the only one robots.txt?

User-agent: *  
Disallow: es.example.com/  

I have updated the robots.txt and submitted to Google's webmasters tools (robots.txt Tester).
It didn't gave me any errors or warnings, so i will wait for the results!

  • You should also find Preventing search engines to crawl on specific folders helpful. – Simon Hayter Feb 11 '15 at 15:42
  • Why do you want to exclude it? – dasickle Feb 11 '15 at 15:44
  • @dasickle, because it is not as it should be & to fix the content it will take more that 8 months! – kanenas Feb 11 '15 at 15:45
  • @kanenas.net so you no longer going to have es.example.com at all? – dasickle Feb 11 '15 at 15:47
  • @bybe, i am not sure why you marked the question as a duplicate. Also i can't find the answer to my question in the thread you suggested. – kanenas Feb 11 '15 at 15:48

Browse other questions tagged or ask your own question.