Brotli

Brotli is a data format specification[2] for data streams compressed with a specific combination of the general-purpose LZ77 lossless compression algorithm, Huffman coding and 2nd order context modelling. Brotli is a compression algorithm developed by Google and serves best for text compression.

This article is about the compression algorithm. For Brötli, the Swiss-German bread roll it is named after, see Bread roll § Europe.
Brotli Compression Algorithm
Original author(s)Jyrki Alakuijala, Zoltán Szabadka
Developer(s)Jyrki Alakuijala, Eugene Kliuchnikov, Robert Obryk, Zoltán Szabadka, Lode Vandevenne
Initial release15 October 2013 (2013-10-15)
Stable release
1.0.7 / 28 October 2018 (2018-10-28)[1]
Repository
Written inC
Operating systemCross-platform
PlatformPortable
TypeData compression
LicenseMIT License
Websitegithub.com/google/brotli 

Google employees Jyrki Alakuijala and Zoltán Szabadka initially developed Brotli to decrease the size of transmissions of WOFF2 web fonts, and in that context Brotli was a continuation of the development of zopfli, which is a zlib-compatible implementation of the standard gzip and deflate specifications. Brotli allows a denser packing than gzip and deflate because of several algorithmic and format level improvements: the use of context models for literals and copy distances, describing copy distances through past distances, use of move-to-front queue in entropy code selection, joint-entropy coding of literal and copy lengths, the use of graph algorithms in block splitting, and a larger backward reference window are example improvements. The Brotli specification was generalized in September 2015 for HTTP stream compression (content-encoding type 'br'). This generalized iteration also improved the compression ratio by using a pre-defined dictionary of frequently used words and phrases.

History

Alakuijala and Szabadka completed the Brotli specification during 2013–2016. The specification was accompanied with a reference implementation developed by two additional authors, Evgenii Kliuchnikov and Lode Vandevenne, who had previously developed Google's zopfli implementation of deflate and gzip compatible compression in 2013.[3]:1 Unlike zopfli, which was a reimplementation of an existing data format specification, Brotli was a new data format, and allowed the authors to improve compression ratios even further.[4]

The Internet Engineering Task Force approved the Brotli compressed data format specification as an informational request for comment (RFC 7932) in July 2016.[2] The Brotli data format is an integral part of the 2nd iteration of the Web Open Font Format.[2]:3

While Google's zopfli implementation of the deflate compression algorithm is named after zöpfli, the Swiss German word for a snack-sized braided buttery bread, brotli is named after brötli, the Swiss German word for a bread roll.[4] Google's own implementation of the Brotli specification was released under the terms of the permissive free software MIT license in 2016. A formal validation of the Brotli specification was independently implemented by Mark Adler,cf. [2]:126 one of the co-authors of the zlib/gzip compression format and library. Adler's implementation was released under the terms of the similarly permissive Apache license.[5] Other implementations of the specification also exist, including one in the source-to-source haxe language.

Brotli is available as a port for Android in a terminal-interface with its own shared library.[6]

About

Brotli was first released in 2013 for off-line compression of web fonts.[7] The version of Brotli released in September 2015 by the Google software engineers contained enhancements in generic lossless data compression, with particular emphasis on use for HTTP compression. The encoder was partly rewritten, with the result that the compression ratio improved, both the encoder and the decoder have been sped up, the streaming API was improved, and more compression quality levels have been added. Additionally, the new release shows performance improvements across platforms, with decoding memory reduction.[4]

Unlike most general purpose compression algorithms, Brotli uses a pre-defined dictionary, roughly 120 KiB in size, in addition to the dynamically populated ("sliding window") dictionary. The pre-defined dictionary contains over 13000 common words, phrases and other substrings derived from a large corpus of text and HTML documents.[8][3] Using a pre-defined dictionary has been shown to increase compression where a file mostly contains commonly used words.[9]

Brotli's sliding window is limited to 16 MiB. This enables decoding on mobile phones with limited resources, but makes Brotli underperform on compression benchmarks having larger files. The constraints of the small window size can be alleviated by using Large Window Brotli, which is not compatible with RFC7932 (Brotli proper).

Streams compressed with Brotli have the content encoding type "br".

Industry support

Browsers and other clients
  • Mozilla Firefox introduced support for the 'br' content-encoding method in version 44 (released on 26 January 2016).[10]
  • Google Chrome has supported the 'br' content-encoding method since version 50 (released on 20 April 2016).[11]
  • Opera has supported the 'br' content-encoding method since version 38 (released 8 June 2016).[11]
  • Microsoft Edge has supported the 'br' content-encoding method since version 15 (released on 5 April 2017).[12]
  • Safari has supported the 'br' content-encoding method since version 11 (released on 5 October 2017).
  • cURL has a compile-time option to support the 'br' content-encoding method using libbrotli as of version 7.57, released on 29 November 2017.[13]

Web servers
  • For Apache HTTP Server, the 'br' content-encoding method has been supported by the mod_brotli module since version 2.4.26.[14]
  • Microsoft IIS has a IIS brotli community extension since March 2016 that adds support for the 'br' content-encoding method.
  • nginx has a ngx_brotli module provided by Google since December 2016.
  • Node.js features a built-in native en- and decoder since version 11.7.0, which can be used to support the 'br' content-encoding.
  • LiteSpeed Web Server has included the 'br' content-encoding method for static files only since version 5.2 in July 2017.
  • Cloudflare CDN offers a brotli option to compress data between its edge node and the user.[15]
  • NaviServer added support in version 4.99.17b1
  • Caddy (web server) Serves statically compressed .br files since version 0.9.4 from December 21st, 2016.
gollark: void.mortgage? WHO IS BUYING A SPECIFIC DOMAIN FOR MORTGAGE.
gollark: I don't know.
gollark: I'm looking at a list of ~350 void.whatever ones which are free.
gollark: SERIOUSLY? .lighting? This is so oddly specific.
gollark: Apparently there is *also* a LGBT TLD.

References
  1. "Releases - google/brotli". Retrieved 27 July 2019 – via GitHub.
  2. Alakuijala, Jyrki; Szabadka, Zoltan (2016), RFC 7932: Brotli Compressed Data Format, Internet Engineering Task Force Request for Comments, Fremont, CA: IETF Trust.
  3. Alakuijala, Jyrki; Kliuchnikov, Evgenii; Szabadka, Zoltan; Vandevenne, Lode (22 September 2015), "Comparison of Brotli, Deflate, Zopfli, LZMA, LZHAM and Bzip2 Compression Algorithms" (PDF), The Comprehensive R Archive Network, r-project.org.
  4. Szabadka, Zoltan (September 22, 2015), "Introducing Brotli: a new compression algorithm for the internet", Google Open Source Blog, Mountain View, CA: opensource.googleblog.com.
  5. Adler, Mark (Jan 26, 2015), "Brotli specification review and verification", Adler brotli, San Francisco: GitHub.
  6. "Brotli as a standalone program for Android". Master-Console(Github).
  7. Sheeter, Rod (February 18, 2015), "Smaller Fonts with WOFF 2.0 and unicode-range", Google Open Source Blog, Mountain View, CA: opensource.googleblog.com.
  8. Chirgwin, Richard (September 23, 2015), "Google's new squeeze: Brotli compression open-sourced", The Register, theregister.co.uk.
  9. Larkin, Henry (2007). "Word Indexing for Mobile Device Data Representations". 7th IEEE International Conference on Computer and Information Technology (CIT 2007). pp. 399–404. doi:10.1109/CIT.2007.22. ISBN 978-0-7695-2983-7..
  10. Goodger, Ben; et al. (26 January 2016), "Firefox 44 release notes", Mozilla Firefox, Mozilla Foundation.
  11. Baheux, Kenji (15 January 2016), "Accept-encoding: br on HTTPS connection", Chrome Platform Status, chromestatus.com.
  12. Trace, Rob (December 20, 2016), "Introducing Brotli compression in Microsoft Edge", Microft Edge Developer, blogs.windows.com
  13. Stenberg, Daniel; et al. "curl - Changes". curl.haxx.se. Retrieved 14 January 2018.
  14. "Changes with Apache 2.4.26", Apache HTTPD repository, svn.apache.org.
  15. "What will Cloudflare compress?". support.cloudflare.com.
Notes
 -  Finley, Klint (22 September 2015), "Hooli, I Mean Google, Gives Away Compression Code for Free", Wired Online, wired.com.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.