The scraper-sites tag has no wiki summary.
2
votes
1answer
32 views
Which tools can help limit maximum page view per ip to limit scrapers and bots?
I would like to prevent scrapers grabbing all my content except Google, Bing and other search engines. I Am thinking of going with Fail2ban and limiting hits from an ip maybe at around 1000 per day. ...
1
vote
2answers
126 views
Who is Automattic and why are they visiting my non-Wordpress site so often?
Of the various people and organizations that have engaged in scraping activity, Automattic is one of the strangest. They have numerous independent IP ranges, as if they know they will be blocked so ...
1
vote
2answers
82 views
Why is Verisign spidering my website?
In my logs, I keep noticing that 69.58.178.57, which is Verisign, is spidering through every page on my website, excluding pages of forms. Does anybody know why they are doing this?
3
votes
2answers
175 views
How this site is ranked so high in SERP's with no content?
In last few months whenever i search for computer wallpapers (using various keywords), somewhere between 1st and 5th position is always site http://hdw.eweb4.com
Everything on that site is scraped ...
0
votes
0answers
17 views
Is this Anti-Scraping technique viable with Crawl-Delay? [duplicate]
Possible Duplicate:
How do spambots work?
I want to prevent web scrapers from abusing 1,000,000 on my website. I'd like to do this by returning a "503 Service Unavailable" error code for ...
4
votes
4answers
401 views
How to protect SHTML pages from crawlers/spiders/scrapers?
I have A LOT of SHTML pages I want to protect from crawlers, spiders & scrapers.
I understand the limitations of SSIs. An implementation of the following can be suggested in conjunction with any ...
0
votes
0answers
390 views
Contents farms, scrapers sites, aggregators real world examples? [closed]
Contents farm, scrappers, aggregators real world examples?
Could you plz 1st clarify me:
1. Is efreedom.com a scraper site, and not a content farm?
I think it's scraper because it copies and pastes ...
1
vote
2answers
696 views
Embedding/scraping the Rotten Tomatoes “Tomatometer” score on another site
I run a local community site, and one of our services is a movies page with showtimes for local theaters, as well as links to the official site, IMDB page, Rotten Tomatoes page, etc. for each movie. ...
