I am currently using the Robots.txt file (the standard one of joomla, to say). Now I have found that there are also specific [HTML meta tags that specify desired robot behavior][1].

Is there a reason to use one over the other?


  [1]: http://www.robotstxt.org/meta.html