Incompressible string

An incompressible string is a string with Kolmogorov complexity equal to its length, so that it has no shorter encodings.[1]

Example

Suppose we have the string 12349999123499991234, and we are using a compression method that works by putting a special character into the string (say '@') followed by a value that points to an entry in a lookup table (or dictionary) of repeating values. Let's imagine we have an algorithm that examines the string in 4 character chunks. Looking at our string, our algorithm might pick out the values 1234 and 9999 to place into its dictionary. Let's say 1234 is entry 0 and 9999 is entry 1. Now the string can become:

@0@1@0@1@0

Obviously, this is much shorter, although storing the dictionary itself will cost some space. However, the more repeats there are in the string, the better the compression will be.

Our algorithm can do better though, if it can view the string in chunks larger than 4 characters. Then it can put 12349999 and 1234 into the dictionary, giving us:

@0@0@1

Even shorter. Now consider another string:

1234999988884321

This string is incompressible by our algorithm. The only repeats that occur are 88 and 99. If we were to store 88 and 99 in our dictionary, we would produce:

1234@1@1@0@04321

Unfortunately this is just as long as the original string, because our placeholders for items in the dictionary are 2 characters long, and the items they replace are the same length. Hence, this string is incompressible by our algorithm.

gollark: …
gollark: My ridiculously convoluted serialization scheme appears to break on it somehow.
gollark: On 5.3 I get it using debug.getupvalue and on CC using getfenv.
gollark: Yes, I know.
gollark: The function environment:* on Lua 5.3 is serialized as nil somehow* on CC stackoverflows during its serialization

References
  1. V. Chandru and M.R.Rao, Algorithms and Theory of Computation Handbook, CRC Press 1999, p29-30.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.