Is there a compression method for compressing a group of very similar files, without archiving them?

1

I want to compress a large nuber of files that have near identical headers, and also some data, however I do not wish to archive them, nor do I wish to zip them individually(because the copression ratio would be much higher if substitutions of similar blocks could be done using a single table). Does a compression method exist to do this already, or should I implement it myself.

Note: Don't say "Disk space is cheap", because I may want to use this on an embedded system.

awiebe

Posted 2012-05-31T20:05:01.627

Reputation: 134

basically you are talking about a compressing filesystem? – Baarn – 2012-05-31T20:08:02.853

you mean that you want to save space in your files, but don't want to have to compress /extract them everytime you want to use them? Because almost all compressors can concatenate files before compressing... Seems that you want your filesystem to save space, that's it ? – woliveirajr – 2012-05-31T20:14:54.547

Answers

2

Don't say "Disk space is cheap", because I may want to use this on an embedded system.

Use squashfs or cramfs. A single compressed stream, which appears as many separate files once mounted.

Ben Voigt

Posted 2012-05-31T20:05:01.627

Reputation: 6 052

Asked: 2012-05-31T20:05:01.627

Viewed: 94 times

Active: 2012-05-31T21:46:55.173