483 reputation
414
bio website fussfreehome.com
location Worldwide
age
visits member for 2 years, 8 months
seen Nov 5 at 11:25

Nov
5
comment How should the maximum concurrent connections from a single IP address be calculated?
Thanks for the edit. I am sorry, but it seems you have misunderstood my question. It has nothing to do with rate limiting HTTP request on the application server. My question is on maximum concurrent TCP connections on a single IP on the firewall itself. This has more to do with the effect of HTTP/1.1 pipelining and how a browser uses multiplexing to get a single request. And figuring out a reasonable maximum value for a single IP based on current browser behaviour.
Nov
5
comment How should the maximum concurrent connections from a single IP address be calculated?
@w3d, not sure about that. I don't mind getting this migrated if there is no answer here.
Nov
5
comment How should the maximum concurrent connections from a single IP address be calculated?
No, my question is not how to set the limit, but what limit to set.
Nov
4
asked How should the maximum concurrent connections from a single IP address be calculated?
Nov
1
comment Should we modify our Joomla robots.txt after Google's announcement on crawling of CSS and JavaScript?
Why not just do away with robots.txt since nobody (not even search engines now that Google is making demands on what you should not disallow) is going to follow it anyway?
Nov
1
comment Robots.txt - CSS allow or disallow
I felt compelled to express my strong disagreement with the cargo cult attitude that whatever Google says, we must do. Google also says your site will rank higher if you allow them to crawl images, use HTTPS, etc. By complying with everything Google says, you are just handing them more power to make bigger demands. At the end of the day, are your building your website for humans or robots?
Oct
31
awarded  Popular Question
Oct
22
accepted How to handle non-existent subdirectories?
Oct
1
awarded  Notable Question
Sep
25
comment Will /sbin/nologin Protect Apache from Bash Exploit CVE-2014-6271
I don't have a test or citation. The purpose of nologin in /etc/passwd file is to prevent non-root user from signing into the system using the credential of apache, for example. Since apache is already in the system, it does not need to sign in to run a CGI bash script. What it needs is just the execute permission to run.
Sep
25
comment Will /sbin/nologin Protect Apache from Bash Exploit CVE-2014-6271
This question is actually more suited for InfoSec.SE site. Disabling mod_cgi may cause your server to stop working. And also, nologin does not solve this problem.
Sep
25
accepted BingBot hitting multiple subdomains all at the same time, causing panic
Sep
25
comment BingBot hitting multiple subdomains all at the same time, causing panic
Hi Vincent, thank you for your attention. Just to clarify some details. The webmaster crawl pattern has always been at the default crawl rate with default uniform pattern. I was having 403 errors from BingBot before I decided to add in the crawl delay directive, hoping to mitigate the problem. But the situation did not improve. I will file a report and see how it goes from there. Having said that, it would be good if BingBot can be optimized to crawl one subdomain at a time to avoid overloading websites with multiple subdomains since there is no good way to control this with robots.txt
Sep
24
awarded  Notable Question
Sep
24
comment BingBot hitting multiple subdomains all at the same time, causing panic
@closetnoc, I am quite sure those IPs are from Microsoft as I have been running whois and host on them. Example a whois on 207.46.13.100 says "NetName: MICROSOFT-GLOBAL-NET". A PTR lookup says "msnbot-207-46-13-100.search.msn.com". Also, the webmaster tool reported these 403 errors.
Sep
24
asked BingBot hitting multiple subdomains all at the same time, causing panic
Aug
28
comment What can cause the size of HTTP response to vary for the same response body?
If you look at the example above, the response size for 400 error is typically 392 bytes. Why would the web server output custom headers like Foo: xeous...? I thought the http response format is quite standard.
Aug
28
comment What can cause the size of HTTP response to vary for the same response body?
I do not have a custom error page for 400 error, so I expect the response size would be of a constant size 392 bytes. In case of 0 size, yes, I agree with you that premature closure of connection could be the cause. But how do I account for the 4kB output in case 4 and 5?
Aug
26
awarded  Teacher
Aug
26
awarded  Yearling