What lasts longer: Data stored on non-volatile flash RAM, optical media, or magnetic disk?

Question

What lasts longer: Data stored on non-volatile flash RAM (USB stick or SD cards?), optical media (CD, DVD, or Blu-Ray?), or magnetic disk (floppies, hard drives?) My gut tells me optical media, but I'm not sure.

Furthermore, which of those digital media would be most suitable for long-term data storage where environmental issues are unknown, such as low/high temperature or humidity?

For example, what digital media could be stored in a basement, attic, or time capsule, and be expected to survive a reasonably long time? e.g. a lifetime, and then some.

Update: Looks like optical media and magnetic tape each have one vote below. Does anybody else have an opinion or know of a study comparing the two?

Answer 1

See Recommended Backup Media for Circa 2009? on Server Fault.

As for optical media:

DAX Archiving provides some whitepapers, which I have not read. But there's one written by Verbatim, claiming More than 100 years projected lifetime for DVD-R General.

Recently Adrian Wong of Tech ARP by accident found out that "CD-Rs that were just 7-9 years old were failing at a significant rate". So: cross your fingers.

Answer 2

Most CDRs sold are of the low-quality variety. Race to the bottom and all that. The 100+ year predictions have turned out to be garbage in most use cases.

The only really long-term solution is custodianship of your data. Every 5-10 years you need to copy your data to a new device, verify the integrity, and make sure you still have the tools to read whatever format it is in. If the tools look like they might not be around or convenient in another 5 years, convert your data into a format which looks like it has good future potential, and keep both copies. Rinse and repeat.

This strategy requires an easy-to-read media, so tapes are probably out. DVDs are convenient these days, but aren't particularly high density. Hard drives are high density and convenient to read, but have moving parts that can go bad over time. Your most reliable bet is going to be spreading verified copies of your data over multiple mediums, rotating these as specified above.

Don't forget to verify the integrity of your data on both read and write. Bitrot does happen, and it's far more common at modern data densities than you imagine.

Answer 3

Optical media is good because it's cheap, but I would use magnetic tape.

CDs and DVDs suppose to be readable for 25-50 years but it's very far from the truth. Even if there's no structural damage some badly written DVDs can loose their content in 2 years.

Flash memories do not discharge for many years. However, it's a relatively new technology, so they might not be tested well enough in this respect.

In contrast, magnetic tapes can be read back after 20-30 years and are designed for backup. Very high temperature (e.g. fire) will erase them, but given normal conditions they will remain intact.

Answer 4

This is obviously late, but might be of interest as new discoveries/technologies are made.

All mentioned medium have their specific physical disadvantages. Filesystem, file formats, etc. are common problems to all of these. A couple new ideas:

1. Cloud (internet, data center, etc.) storage. You can encrypt the whole lot, or in parts, and write the passkey/password/etc. onto something reliable, like stone tablets.

2. Similar to cloud storage is something called "live/rolling storage". Basically, you store the data on a live system which you replace with newer, more modern hardware, every so many years and move the data to the new system.

3. Microfiche (data is encoded on it). Or some new medium based on nickel (can't remember much about this medium). Microfiche preserves well. Data density might be a problem, but everything has a disadvantage. This isn't as outdated as it might appear as of the time of this writing, just somewhat reserved for larger endeavors.

Answer 5

The bottleneck of data storage for future reading is mentioned ( from device to read the data upto the file format of data itself). Assuming you have always upgraded your data archive to latest mass media; Why would anyone spent time to retrieve your old sock with data?

I'm starting to get more and more convinced of creating an index of the most important files including specification of software used to save the file. This index can be printed. A copy of index can also be placed on several cloud systems. Since companies have an average same life span as CD's (home brewn and official audio cd ;-) I would not trust my archive on cloud computing as final archive.

Answer 6

Backup - tapes only. CDS are good for installing OS, flash is 100% unsecure.

Answer 7

I'd go with the Optical Media. It should survive the varying temps and humidity the best for long-term storage. As long as it isn't scratched or broken during that time...

Answer 8

Optical is going to be your best bet. It is the most resilient against long term conditions (such as the ones you speak of).

Magnetic will eventually lose it's data. RAM can be wiped by accident, as well as suffers from humidity and temperature.

With optical the only thing you have to worry about is structural damage, really.

Answer 9

This is when I wish that MiniDisc had caught on, it should out-last any current archival media.

Basically how it works is to write any data, you first have to heat up the media with a laser, and give it a magnetic field. Which means you can't really even use a degausser to erase the data.

It also doesn't have to read the data through a polycarbonate substrate, like CDs, or DVDs or BluRay disks. Which means that you can leave it in the sun without worrying about it becoming unreadable, due to discoloring.

It's a shame that Sony keeps trying to force it's will onto the consumer. The only time they managed to come out on top, is with BluRay, which they only accomplished through making deals with movie makers.

Answer 10

A flash disk.

I vote 'flash drive' because I know nothing of it, but it appears to have its own USB bus in hardware. Finding hardware in 100 years that will read old data is the problem neglected here.

Magnetic media, when on tape, we were told to 'refresh' (copy over itself, remagnetizing the surface) every three years. Since, I've found floppy disks to be readable decades later. These disks were stored in a well-insulated environment, so the plastic (mylar) stratum didn't expand or contract. Each has its use.

It's the environment that affects optical media. You may notice that CDs & DVDs are actually translucent. Remember, it's light that causes the dye to react. (DVD-RW disks are written by melting xtals and chilling them to a glass: this glass will recrystallize within months.) Further, the stratum is not perfectly elastic, expanding & contracting back with the heat of the day: it is slightly plastic, never returning exactly to the same shape. Avoid temperature variations. I use Taiyo-Yuden lacquer-coated or Verbatim (with LightScribe) for archiving. I may now switch to a flash drive.

This because I'm unclear of the usefulness of a 300 year old DVD, when DVD players have a life from 6 months to 3 years. I can read only mini-floppy disks now because I saved a good drive in a safe place. If you're going to archive with DVDs, save a $40 DVD player. Or, use a flash drive, which comes with its own player.

All the above is irrelevant if you cannot read the data and move it in the future to a new medium and possibly new format. Use a lossless, ISO standard format: newer ones will replace compressed, 16-bit TIFF for photos. Keep track of new, popular software formats and hardware media; and transfer your family photos as these become available. As with magnetic media, you need choose your file system on a flash drive: the source code for Linux ones are published. The flash drive is unique in having a player with no moving parts.

Consider that a programmer can use source code published in paper libraries or on internet archives to re-write old file systems and read file formats. But it would take a very clever engineer to build a device for reading the medium; unless its just electronics to convert USB in the distant future to 'Microsoft Protocol' protocol, & software to convert ext3 to 'Microsoft Format' format.

Although the Wikipedia gives newer EEPROMs a 10-year life, this quote is interesting:

'Channel Five's Gadget Show cooked a flash drive with propane, froze it with dry ice, submerged it in various acidic liquids, ran over it with a jeep and fired it against a wall with a mortar. A company specializing in recovering lost data from computer drives managed to recover all the data on the drive.[22] All data on the other removable storage devices tested, using optical or magnetic technologies, were destroyed.'

http://en.wikipedia.org/wiki/USB_flash_drive#File_system

Because a simple USB dongle can now hold as much as 55 DVDs, and the USB bus will likely outlast DVD players or tape drives, a flash disk is the clear choice in archiving data. (Get another with a write switch for holding a bootable repair & malware extraction kit; get another that stores encrypted incremental backups & take it home each night.)

Bruce Bathurst PhD

PS. To support my research in petrology, I took jobs in all aspects of computing. For each client, I chose the best tools for that particular business. Thus, I don't feel biased in my conclusion. In fact, I've never even used a flash drive! :-)

Answer 11

There are a number of issues - first is the stability of the media itself. Floppy disks here in Hawaii rot due to high humidity/mold/mildew issues. I've seen so much media destroyed that I'd say if you can't guarantee low humidity, mag media is out.

The second thing is the media format - who can read 5-1/4" floppy disks? 8" floppy disks? Even the Zip 100 disk drives are getting few on the ground much less the older tape formats.

The third thing - what encoding are you using for the data? If not a standard and hopefully open standard format, then you may not be able to even get it understood. Even Microsoft Office has problems reading Microsoft Works on occasion, much less something like more obscure formats.