I'm working on a joomla website, and robots.txt is messing with me... i have it in domain.com/website/robots.txt and I just wanna prevent users from browsing directories.
By default it had Disallow: /images/ and the rule works, can't access the folder. I tried to add Disallow: /images/thumbnails and that one didn't work. I commented out Disallow: /images/ just to test. The folder IS STILL inaccessible. There is no other instance of robots.txt on my domain.
Why are my changes on robots.txt being ignored ? Is there some other file that could override it ?