Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I am currently developing a website which is going to take some time to finish. I need to move some 'stuff' to production frequently, while maintaining a under construction status. My front page will clearly mention that my website is under construction.

I know crawlers will access my URL before I am ready to go live. Should I tell them my site is under construction (no need to index)? If yes how?

P.S.: Eventually, I am ok to let them see my under construction front page.

share|improve this question
3  
There is no need to do that, more info on this question: webmasters.stackexchange.com/questions/24419/… –  paulmorriss Apr 23 '12 at 15:36
add comment

2 Answers 2

up vote 3 down vote accepted

If you don't want the search engines indexing your content before you're ready, block them with robots.txt and meta tag.

share|improve this answer
    
I guess I can discard pages with robot.txt, but what do you mean with meta tag? Can you give an example of what you have in mind? –  JVerstry Apr 23 '12 at 16:09
    
It should look like this and go in the head area of each page you want hidden. <meta name="robots" content="noindex, nofollow"> this keeps your URLs from being indexed if there are links pointing to them from elsewhere. Additionally you could leave off the robots.txt and use "noindex, follow" this allows Google to crawl the pages and get information about/from them without adding them to the index. It overlaps somewhat with the robots.txt but is treated a little different. –  Joshak Apr 23 '12 at 16:47
add comment

Don't worry! Published and be damned! Avoid any mention of 'under construction'. Hey, every site is a work in progress. Maybe you could give us a link so that we could see the problem (or lack of problem).

My guess is that search engines (and readers) will love your site if it keeps on publishing new pages.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.