Skip to main content

All Questions

Filter by
Sorted by
Tagged with
0 votes
1 answer
393 views

Understanding the maximum hit-rate supported by a web-server

I would like to crawl a publicly available site (and one that's legal to crawl) for a personal project. From a brief trial of the crawler, I gathered that my program hits the server with a new ...
SNag's user avatar
  • 101