|visits||member for||3 years, 6 months|
|seen||May 13 '13 at 20:09|
How to protect SHTML pages from crawlers/spiders/scrapers?
The answer may be to write your own HttpModule and have it handle this by tracking IP Addresses and the number of requests and then just denying the request if it exceeds your limits. This is pretty simple to do.