Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I was waiting for already 1 week and alexa still not recognize my site. I already put a robot.txt in my site. Locating in www.mydomain.com/robots.txt

User-agent: *
Disallow: /

Please suggest why this happening, Thanks.

share|improve this question
    
A week isn't very long to wait for a search engine to notice your site. Especially if it's new, and especially if there aren't many links to it yet. –  aroth Sep 5 '11 at 2:28
    
thanks for answer, I was just curious on alexa. –  Manok Sep 5 '11 at 2:42
2  
Are you being indexed by anything? Your Robots.txt file says "All agents, ignore everything from / on down." –  Fiasco Labs Sep 5 '11 at 5:44
add comment

migrated from stackoverflow.com Sep 5 '11 at 4:02

This question came from our site for professional and enthusiast programmers.

2 Answers

Don't follow the advice above: allow:/ is NOT the way to go. If you want all crawlers to access your site you want to use:

User-agent: *
Disallow:
share|improve this answer
add comment

You disallow everything.

my robots.txt looks like:

User-agent: *
Allow: /

and i'm getting crawled just fine (although i don't know what alexa is).

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.