While testing out how web pages on my site appear to search engine spiders using http://www.browseo.net/ I noticed that advert images appear in the view. However, when I test a site like guardian.co.uk using this same service their main adverts don't show. It seems they are treating advert images and their normal website images differently.

What is the best (penguin friendly) way to achieve this outcome?

1 Answer 1


One, this depends on how the advertisements are generated. Most crawlers understand little or no Javascript, so if you just have the ads Javascript generated, you are done. This is the base for ads from most ad delivery networks, including Google AdSense.

The other is simply to do user-agent detection and deliver ads to user-agents you want. In this case, Google says you must include Vary: User-Agent in your response headers to let then know that you are changing your response according to user-agents.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.