I'm currently trying to improve my search engine results. I got a index page that lists all articles with a little teaser and then the article pages themselves.

Now when I e.g. google "websiteXXX rails development", it shows me the index page and highlights the one article that has these words in the teaser. But I would rather have the search engine show the article itself and direct link to it.

What is better to do now? - Disallow the serach engine to index the index page (hence, only article pages) - Give the index page a priority of 0.5 and article pages 1.0 - Something else?


  • Never serve different content to bots. If they find out, you loose.
    – Martijn
    Jan 20, 2015 at 15:36

2 Answers 2


When a end-user shows up on your index page; they will quickly scan for the content they originally searched for. When they cannot find the content they will leave. Your index page probably has a high bounce rate.

I would not suggest excluding your index page or changing its importance. Instead consider programing the site to consume the referring page search string and have your index automatically search your site for the revenant (searched) content. If one cannot get this to work then change the importance.


You are going about this the wrong way. You want the bots to crawl your index page (s). This helps them find the rests of the links on your site.

For best results, you need to segment your post feed landing pages by subject and fill them up with articles that are closely related. This is good for both SEO and User Experience.

Lastly, search engine should be able to index your articles and landing pages both. If the only index the landing pages then you might have a bigger problem. Poor quality content and some technical SEO issues.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.