Tagged Questions
3
votes
3answers
215 views
Is my robots.txt working as it should?
I want crawlers to have access to http://www.example.com but not http://www.example.com/
My robots.txt is as follows:
User-agent: *
Allow: /$
Disallow: /
My site is in Google search results, but I ...
