Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

As you all can see from the picture below, my site's content is duplicated by FeedReader and indexed at Google. When I clicked at the FeedReader link, it uses some sort of iFrame to draw content from my site live. This forms some sort of content duplication to me, and I believe it does harm to my site.

enter image description here

enter image description here

(Stackoverflow doesn't allow me to post image due to new account, pls click at the link above to see the picture, million thanks to you.)

What can I do to prevent Feedreader to fetch my content to their site? I know robots.txt can perform such function, but I don't know how to do it. Any help would be much appreciated.

I have also highlighted this issue to FeedReader 2 days ago, but yet to get any reply from them.

share|improve this question

migrated from stackoverflow.com Oct 7 '12 at 22:38

This question came from our site for professional and enthusiast programmers.

I was having the same problem. So, I added the below code to my .htaccess to prevent bo.lt and feedreader.com from accessing my site.

RewriteBase /
RewriteEngine on
RewriteCond %{HTTP_USER_AGENT} bo.lt/ua [OR]
RewriteCond %{HTTP_USER_AGENT} feedreader.com
RewriteRule . - [F,L]

When they try to access your site, it simply returns 403 forbidden. You can also block it's IP by adding this to .htaccess.

deny from
deny from
deny from
deny from
share|improve this answer
I have been trying this, it doesn't seem to be working, I even inserted ip in Add an IP to deny in cpanel but not working, my sites content are duplicated and penalized by google. – user19542 Oct 29 '12 at 17:57

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.