1,260 reputation
824
bio website
location
age
visits member for 3 years, 9 months
seen Jul 11 at 22:58

profile for blunders on Stack Exchange, a network of free, community-driven Q&A sites


Jun
20
comment MS Bing web crawler out of control causing our site to go down
"The best test is to see if you can survive Google, Bing, Yahoo and Baidu all hitting your system at once. If it remains in service during the onslaught, then you're ready for a live customer load." << Customers generate money, if Google, Bing, Yahoo and Baidu are sending ZERO traffic, they should be blocked in my opinion. Using crawlers abusing a site as a way to load test a website in my opinion makes zero sense.
Jun
18
awarded  Nice Question
Jun
13
comment What bots are really worth letting onto a site?
@DisgruntledGoat: No problem, thanks for the edits!
Jun
13
revised What bots are really worth letting onto a site?
added 3 characters in body
Jun
13
revised What bots are really worth letting onto a site?
added 26 characters in body
Jun
13
revised What bots are really worth letting onto a site?
deleted 2 characters in body
Jun
13
comment What bots are really worth letting onto a site?
@Zistoloen: Yes, I'm aware it is a hard question; in fact, reason I asked is because a non-major search engine I know of that has indexed billions of pages was complaining about how they were unable to access large amounts of the web because sites were attempting to block non-major search engines.
Jun
13
accepted What bots are really worth letting onto a site?
Jun
13
asked What bots are really worth letting onto a site?
Apr
28
revised What are sources of free/cheap stock photos?
edited title
Apr
3
awarded  Nice Question
Feb
25
awarded  Popular Question
Feb
25
awarded  Popular Question
Oct
10
awarded  Yearling
Jul
3
awarded  Notable Question
Jan
21
awarded  Notable Question
Dec
28
awarded  Popular Question
Dec
4
awarded  Popular Question
Oct
10
awarded  Yearling
Sep
5
accepted What is the name for landing pages that are one long page?