Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

My traffic is not from search engine and I want to prevent bots or others from displaying or accessing it.

What would be a good .htaccess code to do so?

I've heard

User-agent: ia_archiver

Disallow: /

Don't really remove Alexa ranking because Alexa got the content from it's toolbar. Okay. What is then?

share|improve this question
Please explain your reasons for blocking search engines. Just because they aren't sending you much traffic does not mean you should block them. Surely anything they send your way is good? – DisgruntledGoat Jul 8 '13 at 10:44
To prevent my competitors to from knowing my sites are and what countries it's promoted. – Jim Thio Jul 8 '13 at 10:57
That seems very misguided to me: if you are hiding from competitors you are also hiding from customers. But this isn't really the place to discuss that. – DisgruntledGoat Jul 8 '13 at 14:43

Use a robots.txt file to prevent spiders from crawling and indexing your content.

From Alexa's "for webmasters" page:

User-agent: ia_archiver
Disallow: /

From Googe's robots.txt help page:

User-Agent: Googlebot
Disallow: /

If you want to block all robots and prevent all spiders from crawling and indexing your content:

User-Agent: *
Disallow: /

Alexa does not need to crawl or index your content to display an "Alexa Ranking" for your website. It bases its rankings on the number of people that visit your website. It gets this data from its toolbar or by purchasing data from ISPs. As such, blocking the crawler will not prevent Alexa from displaying the ranking. There does not appear to be a way to have your site opt-out of the Alexa rankings.

share|improve this answer

To prevent all robots from indexing a page on your site, place the following meta tag into the section of your page:

For more info read : https://support.google.com/webmasters/answer/93710?hl=en

I don't think its possible to prevent alexa from indexing a page. Since its indexing a page from it's toolbar, i don't know is it possible to prevent that..

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.