Verifying Time Machine backups

Question

I'm preparing my system for a Snow Leopard upgrade, and I prepare for the worst case scenario: full reinstall and restore.

I would like to verify that my Time Machine backups are valid, and will restore correctly. My Time Machine backups go to a Linux server running Netatalk, and the backups complete successfully.

How do I do a test restore to an alternative location, or otherwise verify my data without overwriting any existing files? Do I need to save anything in particular externally to make sure I can access the backups if I have to reinstall from scratch?

Answer 1

Time Machine does not have any built-in mechanism to verify a set of backups as being valid. That's one issue with Time Machine, being consumer orientated instead of enterprise...

Performing a Disk Repair in Disk Utility doesn't validate the Time Machine backup data, but will verify the structure and integrity of the backup disk. (Of course, Disk Warrior verifies / repairs in a complementary manner).

The only way that I see that you could verify the data in the backup is to do a full restore.

Please note, you can open the Console logs, and filter against BACKUPD to see what happens during a backup, and see if any error conditions occurred.

Edit:

Time Machine does include an option, if you hold down the option key and click on the Time Machine menu bar add-on, to "Verify backups".

This does not verify the contents of the backup. In other words, that backed up file abcd.txt is the same as abcd.txt, instead this verifies that the Disk image the time machine data is not damaged.

Take a look at http://support.apple.com/kb/HT4076

Answer 2

In the end, a Time Machine backup is a collection of folders for each backup date. Each of those folders holds all^† files that existed on that date. So, you can compare the names and contents of all those files with those on your Mac.

Of course, many files will change by simply using your Mac. So the results take some common sense to interpret. The best option is to close all running applications, run Time Machine, and then compare right away.

After you have connected your backup disk, use the following in Terminal to find the differences. For the cd command below you might want to use Tab command line completion rather than just pasting the first line:

cd /Volumes/Backup*/Backups.backupdb/*/Latest/*/
echo "Current folder on backup disk: $(pwd -P)"
sudo diff -qr . / 2>&1 | tee $HOME/timemachine-diff.log

This will compare the current folder (being the latest backup) with the root of your Mac. It shows the results on the screen, but also captures these in the file timemachine-diff.log in your home folder.

The above will run a VERY long time (hours, maybe even days), so for testing you can first limit to a specific folder. Like for your desktop:

cd /Volumes/Backup*/Backups.backupdb/*/Latest/*/$HOME/Desktop
echo "Current folder on backup disk: $(pwd -P)"
sudo diff -qr . $HOME/Desktop 2>&1 | tee $HOME/timemachine-diff.log

If there's no output, then there are no differences. For testing just rename a file on your desktop, which should give you both "Only in ." for the original name (which is only on your backup) and "Only in /Users/username/Desktop" for the new name (which is not in the backup).

Notes:

• When backing up over a network you'll probably use a sparse bundle. Just double-click that sparse bundle file to mount it before running the above commands. When done, right-click and Eject it.

• Some files are excluded by design, some software may simply exclude itself, and FileVault folders are only written to a backup when you log out first. See Does Apple’s Time Machine app really copy everthing?

• To see what has been written to the (latest) backup, see TimeTracker (GUI) or timedog (command line). Note that, even when running as an admin user, sometimes these programs need to be run as root to see all files. See How do I retrieve files from Time Machine backups from another computer? for help.

• Log messages are not only written to Console (in Applications, Utilities; filter on backupd, or use Time Machine Buddy), but different log messages are also kept in a hidden .Backup.log file on the backup disk itself, within the folder with the backup date. See also What is Time Machine doing? at Server Fault.

• Since 10.6.3 I noticed a "Verifying Backup..." stage in Time Machine, followed by "Preparing 51,959 Items...", prior to "Backing Up". Console mentions "Running backup verification", "QUICKCHECK ONLY; FILESYSTEM CLEAN" and "Backup verification passed!"

  I have no idea what verification does. Maybe it's comparing the backup to the current disk contents: when I only have about 3.5 GB free disk space on my Mac, I noticed "CopyHFSMeta hit low disk space threshold", so apparently it's copying a lot of data back to my Mac? This is then followed by "Backup verification skipped during CopyHFSMeta", "Insufficient space on boot volume to complete backup verification" and a false "Backup verification skipped by user!" while I did not skip this myself. These messages are only found in the log; no indication to the user whatsoever, and the backup completes without any warning.

• Apple offers a support article named About "Time Machine completed a verification of your backups. To improve reliability, Time Machine must create a new backup for you." In that article, the steps to manually verify the backup disk only check the physical condition of the disk image, and do not compare its contents to the disk of your Mac. So I guess that error is not about the backup contents either. Odd quote from that article:

  Note: Do not repair the disk image with Disk Utility.

^{† Time Machine uses hard links, which makes each backup look like it holds all files. See a fine technical explanation at Ars Technica.}

Answer 3

As per Mac OS X 10.6.4, you can initiate a verification of your backup by option-clicking the Time Machine icon in the menu bar.

I'm not sure what exactly is verified, but when I did it, Time Machine recommended that I start a new backup to improve reliability.

Further reading: Apple knowledgebase article.

Answer 4

The Time Machine command-line utility has an option to do this: "tmutil compare". Check "man tmutil" for all the various switches available.

https://www.google.com/search?q=tmutil%20compare

Answer 5

You may try one application from Mac's utilities (Application->Utilities): Migration Assistant. With this tool, you may use one option to transfer information from your backup Time Machine to local computer.

Another way is to use this tool to install Mac from Time-machine to another virtual Mac on HD. I have not tried this yet. Not sure if it is possible to make a virtual box with OSX.

Answer 6

Check out BackupLoupe – it gives you some great ways to navigate across your Time Machine backups.

Answer 7

Doing a Time Machine backup to a network-based share is known to be more risky and fraught with problems. So, if you really, really, do not want to run the risk of hitting trouble with your upgrade and then having further trouble getting back to where you were then I would strongly recommend temporarily using a local disk and a tool like ShirtPocket's SuperDuper! or Carbon Copy Cloner

For just brute-force verifying your data, however, I think the best you can do is to manually mount the sparsebundle on your network drive, and use something as simple as 'diff -cr' to compare the bulk of the files from the 'Latest' version against your system drive (which is obviously going to throw up some that have changed since TimeMachine last ran.)