I finished my website and launched it, I think I had a problem with my robots.txt
- so I changed it to look like this:
03/08/2012
# Allows all bots
Sitemap: http://www.mysite.co.za/sitemap.xml
User-agent: *
Disallow: /dashboard/
When I google my domain.co.za
- I get this back:
Home
A description for this result is not available because of this site's robots.txt – learn more.
You've visited this page 3 times. Last visit: 2012/08/15
Now since I fixed this and added a 301 redirect to redirect mysite.co.za
to www.mysite.co.za
I would love it if google bot would come do a visit.
Is there anything I can do to get this fixed?