What approach should I take to make the website Google-friendly, http://anuary.com/.

The problem is that when a specific content is being requested (eg. http://anuary.com/1/home/anuary) user is taken to the page using scrollbar, though the surrounding content is still being loaded. How to tell Google that for this URL http://anuary.com/36/portfolio/three-musketeers only the #36 entry should be crawled.

Is there a tag or other way to select the surrounding content as irrelevant for the URL?


2 Answers 2


It's not possible to tell GoogleBot to not/crawl portions of your documents. The bot takes it all in and they decide what they think is important. Only AdSense allows for section targeting.

As far as I can tell, GoogleBot isn't doing anything wrong. The problem is that your URLs aren't real in the first place. You have a giant document and you're using a fake sub-directory structure that you use to figure out how far down to scroll via something that seems to pretend to be Ajax. If you were actually using it, then you could follow the crawling guidelines


Google provides googleon/googleof tags that are just right for the job ( https://developers.google.com/search-appliance/documentation/46/admin_crawl/Preparing ). An explanation on how to use them is available at http://perishablepress.com/tell-google-to-not-index-certain-parts-of-your-page/.

Though, essentially it all comes to:

<!--googleoff: all-->
This content will not be indexed.
<!--googleon: all>

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.