Is there anyway to extract a tar.gz file faster than tar -zxvf filenamehere
?
We have large files, and trying to optimize the operation.
Is there anyway to extract a tar.gz file faster than tar -zxvf filenamehere
?
We have large files, and trying to optimize the operation.
pigz
is a parallel version of gzip. Although it only uses a single thread for decompression, it starts 3 additional threads for reading, writing, and check calculation. Your results may vary but we have seen significant improvement in decompression of some of our datasets. Once you install pigz, the tar file can be extracted with:
pigz -dc target.tar.gz | tar xf -
if there are many many many small files in the tar ball, cancel the ‘v’ parameter, try again!
If you want to see progress use something like pv
.
Here is an Example:
pigz -dc mysql-binary-backup.tar.gz | pv | tar xf -