DrEvil

anyone found any params for this command that help speed things up a lot?

I''ve sync'ing various directories between two servers, about 500Gb of data.
In addition some of the files are up 12Gb in size, which caused me an issue, cos you need to allow enough extra space to cope with a temp file the size of your largest file in that file system...

Fortunately, this is only pre go-live, so won't need to worry about it after that

Alex

class_A

try the -z flag which compresses the data before transmission IIRC (could b mistaken )

local copy or over a WAN? turned on SSH compression if it's remote?

DrEvil

A_class

Cheers, using -avz currently across LAN (using the back-up network, which is quiet during the day).

Currently running 4x rsync sessions at a time to maximise use of the network and cpus (from what I've seen running anymore than that doesnt help in this case), whilst not killing performance for the users.

Using rsh as well, not ssh.

Thanks again, Alex

DrEvil

Well, got the 500Gb synchronised despite the overnight back-ups...

TBH I'm going back to using rdist - rsync kept crapping out on me over night, it doesn't like large files.