Bug #14057

Low efficient while file tranfer

Added by 俊锋 张 about 1 year ago. Updated about 1 year ago.

Status:InvestigatingStart date:04/18/2012
Priority:NormalDue date:
Assignee:Carl Caum% Done:

0%

Category:-
Target version:-
Affected Puppet version:2.7.12 Branch:
Keywords:

Description

transfer a file which size is 5GB spend 17min while it cost 5min when I use scp command

History

#1 Updated by Daniel Pittman about 1 year ago

  • Status changed from Unreviewed to Investigating
  • Assignee set to Carl Caum

Carl, seems like this might me in your area to investigate.

There shouldn’t be any huge reduction in performance due to Ruby, but obviously this is a bit slow, so something is strange. All the encryption is done in C, using OpenSSL, which should knock that out of the picture – so unless our Ruby agent or master is doing something painful in streaming the content, it should be just about as efficient as the pure C scp.

It could, perhaps, be that we don’t use zlib compression on our connection, while scp can – if the 5GB was highly compressible, that might explain the difference. I get ~ 13 to 16 MB per second with the quoted rate for scp, which would push the limits of 100Mbit Ethernet, but would be reasonable on gigabit.

Also available in: Atom PDF