Low efficient while file tranfer
|Assignee:||Carl Caum||% Done:|
|Affected Puppet version:||2.7.12||Branch:|
transfer a file which size is 5GB spend 17min while it cost 5min when I use scp command
#1 Updated by Daniel Pittman about 1 year ago
- Status changed from Unreviewed to Investigating
- Assignee set to Carl Caum
Carl, seems like this might me in your area to investigate.
There shouldn’t be any huge reduction in performance due to Ruby, but obviously this is a bit slow, so something is strange. All the encryption is done in C, using OpenSSL, which should knock that out of the picture – so unless our Ruby agent or master is doing something painful in streaming the content, it should be just about as efficient as the pure C scp.
It could, perhaps, be that we don’t use zlib compression on our connection, while scp can – if the 5GB was highly compressible, that might explain the difference. I get ~ 13 to 16 MB per second with the quoted rate for scp, which would push the limits of 100Mbit Ethernet, but would be reasonable on gigabit.