I had to make an update to an update to a robots.txt to disallow access to sub directory. There was already a disallow statement but i added another one, is the updated robots.txt file below correct ?
The previous robots.txt :
User-Agent: * Disallow: Sitemap: http://example.com/sitemap.xml
The updated robots.txt (note the addition of the 3rd line) :
User-Agent: * Disallow: Disallow: /terms/* Sitemap: http://example.com/sitemap.xml