0

Does proximity of one server to another affect the overall transfer speed on a large number of small files?

Say I have a server with a million small files in Germany, would it be considerably faster to transfer them (using rsync) to another server in Germany vs, say, Finland? Or it only affects latency?

  • Server means computer it can be fast or slow in same country as well. So latency plus the server system(like hardware read/write speed, wan/lan) can affect transfer speed, since it is all about file transfer with verification. Though I'm noob in linux, so can't say more, wait for someone who have more details knowledge about that. – Goyllo May 15 at 17:08
  • rsync is latency-sensitive and runs over TCP, so yes, unlike some other file transfer solutions, rsync transfer speed can be more affected by server distance depending on your connection speed. In practice though, the latency might not be enough for it to matter. – Maximillian Laumeister May 15 at 20:14
  • Servers within a data centre in the EU to another EU country are generally capable of transfers in excess of 100gbit+ and the latency between data centres are generally in the sub 10 ms mark, so the limitations will be purely down to the servers that you are using. If transferring hundreds of thousands of small files then the most important factor is your I/O performance, making SSD hosting advisable and cloud hosting as a preferred option. – Simon Hayter May 15 at 20:51
  • @MaximillianLaumeister thanks, did not know that. But is it a limitation of rsync that can be worked around with another software? – Fluffy May 16 at 8:29
  • @SimonHayter, thanks, both servers will be on ssd, I guess it would still make sense to go for the lower physical distance since I'm all about that speed, and it seems like rsync doesn't like latency – Fluffy May 16 at 8:30

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.