Tagged Questions

1
vote
0answers
79 views

Methods for keeping no-good scrapers off the site? [duplicate]

Possible Duplicate: Tactics for dealing with misbehaving robots I want to keep no-good scrapers (aka. bad bots) that steal content and consume bandwidth off my site. At the same time, I do ...
4
votes
3answers
205 views

Bad Bot blocking Revisited

I've read a lot about bad bot blocking, php scripts, .htaccess techniques, etc... Is this a valid method? Since .htacces can rewrite and send a bad bot a 403 deny or forward to something like spam ...