1

I was waiting for already 1 week and alexa still not recognize my site. I already put a robot.txt in my site. Locating in www.mydomain.com/robots.txt

User-agent: *
Disallow: /

Please suggest why this happening, Thanks.

Improve this question
2
  • A week isn't very long to wait for a search engine to notice your site. Especially if it's new, and especially if there aren't many links to it yet. – aroth Sep 5 '11 at 2:28
  • 3
    Are you being indexed by anything? Your Robots.txt file says "All agents, ignore everything from / on down." – Fiasco Labs Sep 5 '11 at 5:44
3

You disallow everything.

my robots.txt looks like:

User-agent: *
Allow: /

and i'm getting crawled just fine (although i don't know what alexa is).

Improve this answer
2

Don't follow the advice above: allow:/ is NOT the way to go. If you want all crawlers to access your site you want to use:

User-agent: *
Disallow:
Improve this answer