Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon. It offers a large number of options that control every aspect of its behavior and permit very flexible specification of the set of files to be copied. It is famous for its delta-transfer algorithm, which reduces the amount of data sent over the network by sending only the differences between the source files and the existing files in the destination. Rsync is widely used for backups and mirroring and as an improved copy command for everyday use.

Rsync website

1568 questions
57
votes
2 answers

Can rsync display current average speed?

When I'm transferring large quantities of data using rsync, it would be helpful if I could have the average speed up until now at a glance, rather than a bunch of different speeds for each file.
Fela Maslen
  • 1,183
  • 2
  • 11
  • 19
57
votes
8 answers

Rsync : copying over timestamps only

Currently I have two directories A/ and B/ which are identical in every respect, with the exception of the timestamps. Therefore if I run the command : rsync --dry-run -crvv A/ B/ then all files are marked "uptodate", whereas the command : rsync…
artella
  • 959
  • 2
  • 9
  • 6
53
votes
1 answer

rsync - Exclude files that are over a certain size?

I am doing a backup of my desktop to a remote machine. I'm basically doing rsync -a ~ example.com:backup/ However there are loads of large files, e.g. wikipedia dumps etc. Most of the files I care a lot about a small, such as firefox cookie files,…
Amandasaurus
  • 30,211
  • 62
  • 184
  • 246
52
votes
4 answers

Why is my rsync so slow?

My Laptop and my workstation are both connected to a Gigabit Switch. Both are running Linux. But when I copy files with rsync, it performs badly. I get about 22 MB/s. Shouldn't I theoretically get about 125 MB/s? What is the limiting factor…
iblue
  • 784
  • 1
  • 5
  • 12
51
votes
3 answers

Can I make rsync output only the summary?

I use rsync to backup a directory which is very big, containing many sub-directories and files, so I don't want to see the "incremental file list". I just want to know the summary in the end. If I use the argument -q, nothing is output at all. Can I…
horsley
  • 513
  • 1
  • 4
  • 4
48
votes
4 answers

run rsync as root but keep user ownership

I would like to backup user files from one server to another with rsync. but I noticed that the user folders change to root. how can I keep the user permissions with rsync (running by root)?
edotan
  • 1,786
  • 12
  • 37
  • 57
47
votes
7 answers

How can one efficiently use S3 to back up files incrementally?

I understand how rsync works on a high-level, but there are 2 sides. With S3 there is no daemon to speak of — well there is, but it's basically just HTTP. There look to be a few approaches. s3rsync (but this just bolts on rsync to s3). …
Jaimie Sirovich
  • 571
  • 1
  • 4
  • 5
46
votes
3 answers

Rsync to AWS S3 bucket

For a server I am hosting a website on I want to backup the data and settings to an S3 bucket. I found out that you can't directly use rsync to backup to an S3 bucket. Is there another way to achieve the following rsync command to backup the data to…
Bart Bergmans
  • 583
  • 1
  • 5
  • 9
46
votes
7 answers

Why rsync is faster than NFS?

Few days ago I noticed something rather odd (at least for me). I ran rsync copying the same data and deleting it afterwards to NFS mount, called /nfs_mount/TEST. This /nfs_mount/TEST is hosted/exported from nfs_server-eth1. The MTU on both network…
grs
  • 2,235
  • 6
  • 28
  • 36
45
votes
3 answers

Why is it not possible to use two remotes for rsync?

Note to serverfault users: This closed question is answered here by four comments by hynekcer. It is then well accepted in other comments as a regularly answerable question. It's now being voted for re-opening. When both source and destination are…
loopbackbee
  • 1,305
  • 1
  • 10
  • 20
44
votes
5 answers

Rsync command issues, owner and group permissions doesn´t change

I´m trying to set owner and group via rsync and it doesn't seem to be working. This is the command: sudo rsync -rlptDvz --owner=cmsseren --group=cmsseren /home/serena/public_html/ -e ssh root@ip:/home/cmsseren/public_html2/ The files sync correctly…
Arnoldo Bazaldua
  • 539
  • 1
  • 4
  • 5
43
votes
6 answers

Rsync daemon: is it really useful?

Are there any practical benefits in using rsyncd compared to rsync over ssh? Does it really increase speed, stability, anything?
kolypto
  • 10,738
  • 12
  • 51
  • 66
42
votes
7 answers

Using RSYNC with Amazon S3

I am interested in using Amazon S3 to backup our ~ 100gb server images (created via Acronis backup tools) Obviously, this uploading to S3 every night would be expensive, in terms of bandwidth and cost. I'm considering using rsync with S3 and came…
alex
  • 1,710
  • 15
  • 43
  • 63
42
votes
1 answer

What exactly will --delete-excluded do for rsync?

I use rsync with great pleasure for backing up my servers, although I do have a question about the --delete-excluded parameter. /usr/bin/rsync -a --delete --numeric-ids --relative --delete-excluded --rsh=/usr/bin/ssh root@server01:/etc…
ujjain
  • 3,963
  • 15
  • 50
  • 88
39
votes
6 answers

Handling renamed files or directories in rsync

I am working on an rsync script for directory replication. I have it syncing only new and modified files or directories but I don't like the fact that it's copying renamed files or directories as a new file or directory, keeping the files not in…
jmituzas
  • 503
  • 1
  • 5
  • 12
1
2
3
…
99 100