0
I was running a multi-threaded program that makes huge amount of I/O operations, Basically reading/writing Millions of files. I had some problems/bugs and I used to halt the program to fix something and then run again.
Now the problem is after sometime everything went extremely slow, What are the possible reasons for the unexpected slowness? Could it be bad sectors? or problems with the filesystem?
I tried to copy the data to an external drive and the approximated time was 350 Hours!! with a speed of (4 kB/sec).
File System : Ext4
Platform : Ubuntu 13.04
5There are tools to verify if there are bad sectors, use those tools, and report back to us. – Ramhound – 2014-03-27T13:57:47.257
Don't try to access too many files at the same time. If you do, you wind up spending most of your time waiting for the disk head to move from file to file. Your data access pattern may be pathological, and that will hurt performance. – David Schwartz – 2014-03-28T17:13:20.587