All Questions
1 question
0
votes
1
answer
173
views
Spiders crawling broken links
Tl:Dr
Unknown bot crawling the same broken (HTTP 400) URL over and over again. Different User Agent and different country of origin.
The Problem
It seems at least once a week we're getting a big burst ...