Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

When I'm transferring big files between two servers with ncftpget I'm experiencing very high load on the receiving server. What can cause this?

share|improve this question
    
Lack of RAM can cause this when sending/receiving files. Do a wget on a large file and monitor the ram to see if its the same. – Simon Hayter Apr 23 '13 at 11:09
    
How is it best to monitor the RAM? simple 'top'? check if using kswapd? – Noam Apr 23 '13 at 12:23
    
top, htop any of all them really. – Simon Hayter Apr 23 '13 at 16:45

The most common issue here is a lack of RAM on your server. Having used a range of FTP servers in the past most FTP servers store the file in memory during the transfer and once the whole file has been received or sent the file is flushed from memory to a file on the receiving server, and just flushed from memory on the sending server. NCFTP has a general rule of thumb for the maximum number of connections to allow on the server based on the amount of memory of (M-32) * 2 but this is based on the server not doing anything else other than FTP. This will never be the case as the operating system uses RAM, any other server daemons that are running use RAM as well (Apache, mail server, etc). If you are seeing this problem happen it it is a fairly good sign that you need to increase the amount of RAM on your server.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.