Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [synchronization]

480 questions
57
votes
8 answers

Rsync : copying over timestamps only

Currently I have two directories A/ and B/ which are identical in every respect, with the exception of the timestamps. Therefore if I run the command : rsync --dry-run -crvv A/ B/ then all files are marked "uptodate", whereas the command : rsync…
artella
  • 959
  • 2
  • 9
  • 6
53
votes
9 answers

How to interrupt software raid resync?

I want to interrupt a running resync operation on a debian squeeze software raid. (This is the regular scheduled compare resync. The raid array is still clean in such a case. Do not confuse this with a rebuild after a disk failed and was…
Adam5
  • 531
  • 1
  • 4
  • 4
32
votes
3 answers

How does dropbox version/upload large files?

I have a free dropbox account (2GB), and I was wondering how the versioning of large files works. I have a full backup of all my webfiles that sites @ just over 1GB. After the initial upload of 1GB, everytime it syncs will dropbox figure out the…
barfoon
  • 750
  • 3
  • 14
  • 29
31
votes
2 answers

Copy directory tree without empty directories?

I have the following tree # upper letters = directory # lower letters = files A |-- B |-- C |-- D |-- e <= file |-- F |-- G I need to copy this tree to another destination, recursively ignoring all the empty directories. So the…
Dane O'Connor
  • 1,199
  • 2
  • 14
  • 20
31
votes
5 answers

How to upload a directory recursively to an FTP server by just using ftp or lftp?

I am writing a Linux shell script to copy a local directory to a remote server (removing any existing files). Local server: ftp and lftp commands are available, no ncftp or any graphical tools. Remote server: only accessible via FTP. No rsync nor…
Nicolas Raoul
  • 1,314
  • 7
  • 22
  • 43
29
votes
7 answers

Is it possible to sync two linux directories in real time ?

I would like to sync a directory of an internal hard drive to an external hard drive. When I write or modify a file on my internal hard drive, automatically the same file would be copied to the external hard drive... and bye bye backup ;) This would…
stighy
  • 911
  • 8
  • 21
  • 31
27
votes
7 answers

Options to efficiently synchronize 1 million files with remote servers?

At a company I work for we have such a thing called "playlists" which are small files ~100-300 bytes each. There's about a million of them. About 100,000 of them get changed every hour. These playlists need to be uploaded to 10 other remote servers…
Zilvinas
  • 383
  • 1
  • 4
  • 8
27
votes
2 answers

rsync : transferring files in one direction only

Is it possible to use rsync to copy files in one direction only? For example, suppose we have: left/a.txt right/a.txt where the files are initially identical. If one then modifies right/a.txt, then: rsync -avv left/ right/ will copy right/a.txt…
artella
  • 959
  • 2
  • 9
  • 6
26
votes
2 answers

What's the advantage of synchronizing UID/GID across Linux machines?

Before I plunge into the depths of how to synchronize UID's/GID's across my different Linux machines, I would like to know what is actually the benefit? I know that this keeps file synchronization relatively easy (as ownership is "naturally"…
alex
  • 417
  • 1
  • 7
  • 10
24
votes
4 answers

Pushing Large Files to 500+ Computers

I work with a team to manage 500-600 rented Windows 7 computers for an annual conference. We have a large amount of data that needs to be synced to these computers, up to 1 TiB. The computers are divided into rooms and connected through unmanaged…
WMIF
  • 340
  • 2
  • 6
23
votes
6 answers

Bidirectional real-time sync of large file tree between two distant linux servers

By large file tree I mean about 200k files, and growing all the time. A relatively small number of files are being changed in any given hour though. By bidirectional I mean that changes may occur on either server and need to be pushed to the other,…
dlo
  • 451
  • 1
  • 4
  • 14
20
votes
5 answers

Is execution of sync(8) still required before shutting down linux?

I still see people recommend use of sync; sync; sync; sleep 30; halt incantations when talking about shutting down or rebooting Linux. I've been running Linux since its inception and although this was the recommended procedure in the BSD 4.2/4.3 and…
Amos Shapira
  • 839
  • 2
  • 11
  • 23
18
votes
6 answers

Faster rsync of huge directory which was not changed

We use rsync to backup servers. Unfortunately the network to some servers is slow. It takes up to five minutes for rsync to detect, that nothing has changed in huge directories. These huge directory trees contain a lot of small files (about 80k…
guettli
  • 3,113
  • 14
  • 59
  • 110
18
votes
2 answers

How can I *include* folders through Dropbox's selective sync feature in Linux, from the command line?

After another user asked this question: Dropbox on linux server - how to include/exclude folders? My icon is still not working after performing some of the steps listed in other questions and…
Pysis
  • 283
  • 1
  • 2
  • 8
18
votes
10 answers

Password Manager that allows syncing accross platforms

I use OS X, Linux, Solaris and windows for work and from home. There are good tools that allow me to manage the many logins/passwords required platform independently. But mostly they expect me to carry a thumb-drive around or require direct access…
lexu
  • 922
  • 11
  • 19
1
2 3
…
31 32