Why alexa doesn't crawl my site?

Question

I was waiting for already 1 week and alexa still not recognize my site. I already put a robot.txt in my site. Locating in www.mydomain.com/robots.txt

User-agent: *
Disallow: /

Please suggest why this happening, Thanks.

A week isn't very long to wait for a search engine to notice your site. Especially if it's new, and especially if there aren't many links to it yet.
Are you being indexed by anything? Your Robots.txt file says "All agents, ignore everything from / on down."

j0k · Answer 1 · 2012-10-23 22:15:55Z

up vote 2 down vote

Don't follow the advice above: allow:/ is NOT the way to go. If you want all crawlers to access your site you want to use:

User-agent: *
Disallow:

edited Oct 23 '12 at 22:15

j0k
1,285617

answered Oct 23 '12 at 6:08

SLBushway
211

xyious · Answer 2 · 2011-09-05 05:21:12Z

up vote 3 down vote

You disallow everything.

my robots.txt looks like:

User-agent: *
Allow: /

and i'm getting crawled just fine (although i don't know what alexa is).

answered Sep 5 '11 at 5:21

xyious
60327

migrated from stackoverflow.com Sep 5 '11 at 4:02