How much time until an unused hard drive loses its data?

53

36

Do you guys know how much time needs to pass until the data stored on a hard drive starts to degrade?

To keep the data intact for long periods of time, I heard you need to periodically rewrite it on the hard drive, like every 5 years or so. Is it true?

Alex

Posted 2011-05-16T21:25:52.893

Reputation: 951

1

A similar question was asked some time ago on Serverfault: http://serverfault.com/questions/51851/does-an-unplugged-hard-drive-used-for-data-archival-deteriorate

– Linker3000 – 2011-05-16T22:00:44.050

1I remember reading a quote citing 35-40 years, I'll try to find it and post it for you. – Breakthrough – 2011-07-20T10:36:37.610

Answers

63

Overview

The longevity of the data stored on any drive depends on the conditions where it is stored and for how long. For hard drives, there are three main factors: magnetic field breakdown, environmental conditions, and mechanical failure.


Magnetic Field Breakdown

Most sources state that permanent magnets lose their magnetic field strength at a rate of 1% per year. Assuming this is valid, after ~69 years, we can assume that half of the sectors in a hard drive would be corrupted (since they all lost half of their strength by this time). Obviously, this is quite a long time, but this risk is easily mitigated - simply re-write the data to the drive. How frequently you need to do this depends on the following two issues (I also go over this in my conclusion).

To periodically refresh the data on the drive, simply transfer it to another location, and re-writing it back to the drive. That way, the magnetic domains in the physical disk surface will be renewed with their original strength (because you just re-wrote the files back to the disk). If you're concerned about filesystem corruption, you can also format the disk before transferring the data back.

You can also help to avoid this issue by archiving your data with recovery data and error correction when you put the data onto the drive. Many archive formats support the inclusion of data recovery algorithms, so even if you have a few corrupted sectors, you can still re-build the lost data.


Environmental Conditions

Some government organizations "sanitize" hard drives by exposing them to a very powerful magnetic field, effectively (and literally) removing the data from the hard drive by "resetting" all of the sectors. Do note that storing a hard drive in, or near the presence of magnetic fields (alternating or static) will severely impact the data stored on the drive.

Geomagnetic storms have been so powerful in some areas that they have actually corrupted hard disks in the past. If you worry about this issue, consider storing your drives in a basement or somewhere heavily insulated from the environment.


Mechanical Failure

Some people mention that they believe that the actual physical motor in the hard drive will fail long before the data on the disk platters degrades significantly. While this is an issue for a hard disk that has been sitting for a long time, if the disk is used once in a while (at least every 3-5 years), this should mitigate this problem.

That being said, I have personally heard of people booting up 10+ year old computers with no problems, the disks working perfectly. I don't believe this issue is much of a concern compared to the previous one, since you should refresh the data periodically regardless. That being said, do be aware that mechanical problems are the primary failure of hard drives (and recovering data off of platters is not a trivial task, especially in the future when it may be difficult to find legacy drives).


Conclusion

Compared to conventional long-term storage mediums (tapes, optical discs), the appeal of hard drives is quite apparent - they are small, easy to move around, have very good transfer rates, switch between computers with ease, and the data lasts for a fairly long time. But, like the two other storage mediums I mentioned, hard drives do not come without their own caveats. So long as you periodically "refresh" the data on the hard drive (and, in turn, ensure the mechanical aspects of the drive itself are still functioning), you should have no problems.

Depending on the priority of the data you've stored, you may want to refresh the hard disk more often. If it is essential data, I would recommend no less then 2 years at maximum. If you can withstand some chance of minor data loss (e.g. a few corrupted sectors here and there), go with 5 years. It doesn't take long to copy the data off the drive, and copy it back.

One thing not considered is the servo tracks and markings. These are written one time at the factory and never again (on modern disks). No amount of re-writes by the user or so-called low-level formatting freshens these. Once they fade, they fade!

It's different with the first stepper motor disks of the 80's. They don't have servo tracks and a low-level format writes ALL of the bits - fresh.

Breakthrough

Posted 2011-05-16T21:25:52.893

Reputation: 32 927

2@kaykay I find your source not credible enough. I've never seen disks losing data after 1 year of shelf life. Also, I doubt that "file system managers" are concerned with refreshing sectors on the disk. – Dmitry Grigoryev – 2015-06-11T19:49:02.970

1Regarding Magnetic Field Breakdown... all modern hard drives will scan the disc for defects and auto-rewrite the data if the data was 'difficult' to read (but still recoverable). Simply leaving the drive powered up is sufficient, there is absolutely no reason to copy data around to mitigate anything of the sort. Servo information is written at a MUCH lower frequency than your data, which makes it significantly more robust. Servo mechanisms can also handle fairly serious damage to the servo areas, and have built-in redundancy. – user11934 – 2015-10-29T21:24:29.577

1Regarding the Environmental Conditions... the interior of a hard disc contains what is quite likely the most powerful magnet you have in your home. Don't lose any sleep over a refrigerator magnet on your computer case. The magnetic forces at the read/write heads are vastly more powerful. (You run into serious interference issues if the magnet is stronger than you are... essentially) – user11934 – 2015-10-29T21:29:43.623

Many archive formats support the inclusion of data recovery algorithms, so even if you have a few corrupted sectors, you can still re-build the lost data. - can you give a bit more detail? which archiver or what options to use that? i.e. Macrium, Acronis, Easus backupers include that? – T.Todua – 2019-09-02T14:10:26.827

5When all sectors' magenetic strengths are 50% of their current strengths that means half the sectors are corrupted? – Bavi_H – 2011-07-21T03:25:46.507

1If a magnet's strength after 1 year is 99% of its current strength, then it will take 69 years for it to be 50% of its current strength. Right? (.99^69 = about .5) – Bavi_H – 2011-07-21T03:26:10.390

@Bavi_H yes, you are correct - sorry, I forgot about exponential decay. Answer updated, thank you for catching that. – Breakthrough – 2011-07-22T19:36:57.500

8All modern hard drives rely on "servo" information on one of the platters to position the read/write heads. This is likely subject to the same magnetic decay, but there's no way to rewrite those servo tracks. – LawrenceC – 2011-07-22T19:51:45.030

3

if the drive is connected to the computer and any degradation is found on servo information then in the modern hard drives the servo information will be corrected and rewritten automatically http://www.larryjordan.biz/hard-disk-warning/

– kaykay – 2014-03-23T16:41:45.880

15

The data on the HD will last much more than two years, so there is a very good chance you can recover it.

The only problem might be that new hardware could be incompatible with old hardware, but two years isn't long at all.

pavium

Posted 2011-05-16T21:25:52.893

Reputation: 5 956

I'm about to used it as external HD... ::) – winona – 2011-07-20T09:54:00.680

Should be fine. – pavium – 2011-07-20T09:55:56.220

Last question, the hd has been partition twice. Is there any chance I can recover all the data stored there? – winona – 2011-07-20T09:58:24.047

Difficult to say. If the data you need to recover was on the disk before the partition, it's gone now. Maybe (with more details) this would be a good subject for another Question. Asking more than one question at a time is frowned upon. – pavium – 2011-07-20T10:06:06.887

"If the data you need to recover was on the disk before the partition, it's gone now." Incorrect. Utilities such as TestDisk can recover the partition structure, and if even that is impossible, something like PhotoRec can at least recover the files if a repeated erase hasn't been performed. – Hello71 – 2011-07-20T14:25:09.687

thank you for the comment, I'll post another comment here if I had recover or not the data on my HD. ;) – winona – 2011-07-21T03:17:04.253

14

The conventional wisdom is that you should revisit your data every five years to make sure that you can still read it. The general consensus is that the magnetic platters in the drive will start to degrade in 5 years of storage. The bigger issue is that storage technology changes. That means a format that works today will be unreadable 5-10 years from now.

The best option you really have is to have multiple copies on multiple formats and to check on the data at least once or twice a decade. That's really the only way to make sure that the data is both intact and on a format that can still be read.

If you can afford it, you could always pay someone else to manage it. Services like Carbonite can store lots of data for long periods of time. They also can provide disaster recovery services in case your loose your computer and local backups.

Hope this helps

Doltknuckle

Posted 2011-05-16T21:25:52.893

Reputation: 5 813

2Note: Drive don't loose "charge" because they don't store things with charge. The mechanism is setting the local magnitization of the disk surface medium. That can be randomized by heat, shock, changing magnetic fields, cosmic rays (tiny chance), and enough time. – dmckee --- ex-moderator kitten – 2011-05-17T08:18:01.933

1

can you elaborate on this theory of "charge" in a hdd? I know for a fact such a thing does not exist so you should probably revisit the concept of magnetic storage: https://secure.wikimedia.org/wikipedia/en/wiki/Magnetic_storage

– Supercereal – 2011-05-17T15:04:44.577

1Data is stored on a hard drive by using an electric charge to magnetize a small region on the drive platter. The resulting electromagnetic field represents the binary data. The high density of opposing magnetic fields interact in a way that slowly lowers the strength of this field. The fact that all magnets eventually degrade is why all magnetic media has a shelf life. – Doltknuckle – 2011-05-17T15:49:43.020

1The use of the word "charge" was an attempt to explain a complex concept in a single word. Electricity and magnetism have a strong relation and a hard drive uses an electric charge to set the magnetic domains on the platter. Most people understand that batteries loose their charge over time just like magnetic field loose strength over time. "Charge" is an already understood term and is conceptually close to the behavior of a magnetic field. I admit that it might have not been the best choice of words so I rephrased that sentence to better match the reality of how magnets work. – Doltknuckle – 2011-05-17T16:01:06.137

aw you should have @me. Good thing I decided to check back... downvote removed and a +1 for you :D – Supercereal – 2011-05-17T21:28:56.977

Also, delving a ways into geekdom here, electricity and magnetism are literally two manifestations of the same phenomenon, not two different phenomena. If there is an electrical charge, magnetism is present, and vice-versa. Surrounding an electrical conducting wire, the magnetic field and the electric field are 90 degrees from on another, but they are both there. One does not exist without the other, because they are the same thing. Reality is pretty weird. – Craig – 2013-10-27T23:51:08.270

10

I bought a very old Zenith 386 system with an RLL full-height hard drive, circa 1987 at a local thrift store for $5. Had 640KB of RAM and a 386 CPU.

Before you had IDE hard drives, you had MFM and RLL drives; these did not have the controller electronics on board but had ribbon cables that went to an ISA controller card. Very old drive.

Plugged it up, got it to boot (after figuring out the "BIOS drive type" - it was something like 70MB) just fine. Had MS-DOS 5.0 installed. Scandisk revealed 1 bad sector on the drive. Might have been caused due to movement, this is from the era where drives didn't lie about their bad sectors (and had a "defect table" sticker on it).

So I imagine if they are in climate controlled conditions and not subject to shock or vibration that they would last quite a long time.

LawrenceC

Posted 2011-05-16T21:25:52.893

Reputation: 63 487

1Probably more like 640KB :) – nemo – 2013-07-31T12:00:43.413

7

Hard drives fail and are not good long term storage devices. but you do not need to rewrite anything on them...

if you want to keep data over long periods of time, get a magnetic tape drive (they are used by large companies for their data)

Hard drives, flash storage and CDs will generally last around 10 years max, magnetic tapes can last for 50 years and possibly longer.

source: https://www.pcmech.com/article/how-long-does-backup-media-last/

meskarune

Posted 2011-05-16T21:25:52.893

Reputation: 336

Tape storage will last by far much longer than anything else available for digitial data. I have never had a tape fail. https://www.pcmech.com/article/how-long-does-backup-media-last/

– meskarune – 2016-11-07T17:36:13.650

There's a big difference between the life expectancy of the media and the data retention period when not in use. Your source confuses the two. Data retention for a unpowered flash media can be quite low. Eg.. https://www.extremetech.com/computing/205382-ssds-can-lose-data-in-as-little-as-7-days-without-power

– Molomby – 2018-07-19T13:14:53.543

2Do you mean a backup tape drive? – uSlackr – 2011-05-16T21:40:51.603

I'm sure Dolores means a C64 Datasette. – LawrenceC – 2013-01-10T00:42:48.990

1Magnetic tape is not a long storage device. Magnetic tape has the same issues hard drives do: moving parts and magnetic decay. Tape is a good backup medium, but those tapes are constantly being overwritten or refreshed over time. – Keltari – 2013-07-31T13:22:40.000

3

It depends entirely on the ambient electromagnetic noise, the density of the media, and the quality of the read/write head. More noise, more dense data, and lower quality read/write mechanisms will result in so-called "bit rot" setting in faster. It's also going to vary depending on the quality of the internal motor and bearings. Part of the problem of spinning up an old disk is the fact that they're mechanical, and mechanical things don't age well without maintenance.

On mag tape, I've always heard the limiting factor is the method they use to bind the magnetic particles to the tape backing. The shelf life in perfect conditions (no light, nitrogen environment, temperature controlled) for that is supposed to be about 25 years (which is a problem for hospitals, who are supposed to maintain data backups for the life of the patient). Tape continues to be used because it is cheap and very high density, not because it has a superior shelf life.

Recordable optical media lifetime is about 100 years in theory (note that the discs haven't been around that long to actually test!) assuming absolutely no light after burning. Once you introduce an environment with light to recordable media, however, the lifespan drops drastically. 10 years at the most is what I've been told. True pressed discs last indefinitely as long as the media is internal to the disc medium, but those are extremely difficult to produce and are not economical for one-off disc production.

This is what I remember from talking with a salesperson from Iron Mountain several years ago. We did not talk about magnetic disks, but I know they are not more reliable. Hard drives combine three elements: one magnetic, one mechanical, and one electrical. Any and all of these are prone to failure, and this is why hard drives are one of the most common devices to fail in an operational system. You'll also note that the most modern filesystems such as btrfs and ZFS do online "disk scrubbing" where the system will actively read and rewrite disk sectors to maintain the magnetic integrity of the disk.

I would say 10-15 years of life if the density is not ludicrously high and you sit the disk on a shelf and don't touch it.

Bacon Bits

Posted 2011-05-16T21:25:52.893

Reputation: 6 125

2

This will differ based on the type of HDD.

5 years sounds like a reasonable average, though.

For archival purposes, magnetic storage just isn't the best option. You need physical storage, such as optical disks. These have their own types of kryptonite, but are generally more suitable for archival storage than magnetic hard disks.

music2myear

Posted 2011-05-16T21:25:52.893

Reputation: 34 957

Writing to industrial-grade CDs (which last for decades) is practically unavailable to individuals. Commercially available CD-Rs and CD-RWs fail much earlier than hard disks. – Dmitry Grigoryev – 2015-06-11T19:56:55.810

1@DmitryGrigoryev, yes, high humidity & dust killed some of my optical discs. Now I'm considering transfer all data to RAID array, and hopefully when replacing hdd or resyncing will make magnetic fading issue disappeared. – LiuYan 刘研 – 2016-04-01T12:20:02.360

1

I think anyone who sells you “reinvigorating” software to periodically rewrite your modern hard drive is selling you snake oil. Much of the fear about decay stems from a misunderstanding of how modern hard drives store information. They no longer use the principles of classical magnetism similar to cassette tapes of the 80’s, rather, they rely on a quantum phenomenon known as Giant Magnetoresistance to achive much higher storage density and reliability that would otherwise be possible with classical magnetisation. A back-of-the-envelope calculation (https://bytes.com/topic/software-development/answers/851490-magnetic-decay-modern-hard-drives using parameters of 2007 technology) shows the decay time might be something around 22 years, so you are more likely to run into mechanical or other failure before any decay gets you.

ScarletPumpernickel

Posted 2011-05-16T21:25:52.893

Reputation: 111

1

Your question is simple but implies complicated answer.

Simply put, however, long term reliability and integrity of hard disk storage is unknown. Even if the magnetic area is still good and has your data intact, corrosion on the read/write heads can cause read or write errors.

That said, I'm fairly certain this shouldn't be a problem in your case, since the hard disk in question has only been stored and left untouched for two years.

Larssend

Posted 2011-05-16T21:25:52.893

Reputation: 2 941