Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I was waiting for already 1 week and alexa still not recognize my site. I already put a robot.txt in my site. Locating in www.mydomain.com/robots.txt

User-agent: *
Disallow: /

Please suggest why this happening, Thanks.

share|improve this question

migrated from stackoverflow.com Sep 5 '11 at 4:02

This question came from our site for professional and enthusiast programmers.

A week isn't very long to wait for a search engine to notice your site. Especially if it's new, and especially if there aren't many links to it yet. – aroth Sep 5 '11 at 2:28
thanks for answer, I was just curious on alexa. – Manok Sep 5 '11 at 2:42
Are you being indexed by anything? Your Robots.txt file says "All agents, ignore everything from / on down." – Fiasco Labs Sep 5 '11 at 5:44

You disallow everything.

my robots.txt looks like:

User-agent: *
Allow: /

and i'm getting crawled just fine (although i don't know what alexa is).

share|improve this answer

Don't follow the advice above: allow:/ is NOT the way to go. If you want all crawlers to access your site you want to use:

User-agent: *
share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.