Adaptable recursive binary entropy coding technique

We present a novel data compression technique, called recursive interleaved entropy coding, that is based on recursive interleaving of variable-to variable length binary source codes. A compression module implementing this technique has the same functionality as arithmetic coding and can be used as the engine in various data compression algorithms. The encoder compresses a bit sequence by recursively encoding groups of bits that have similar estimated statistics, ordering the output in a way that is suited to the decoder. As a result, the decoder has low complexity. The encoding process for our technique is adaptable in that each bit to be encoded has an associated probability-of-zero estimate that may depend on previously encoded bits; this adaptability allows more effective compression. Recursive interleaved entropy coding may have advantages over arithmetic coding, including most notably the admission of a simple and fast decoder. Much variation is possible in the choice of component codes and in the interleaving structure, yielding coder designs of varying complexity and compression efficiency; coder designs that achieve arbitrarily small redundancy can be produced. We discuss coder design and performance estimation methods. We present practical encoding and decoding algorithms, as well as measured performance results.

[1]  Glen G. Langdon,et al.  An Introduction to Arithmetic Coding , 1984, IBM J. Res. Dev..

[2]  Yoshua Bengio,et al.  The Z-coder adaptive binary coder , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[3]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[4]  Paul G. Howard Interleaving entropy codes , 1997, Proceedings. Compression and Complexity of SEQUENCES 1997 (Cat. No.97TB100171).

[5]  Glen G. Langdon,et al.  An Overview of the Basic Principles of the Q-Coder Adaptive Binary Arithmetic Coder , 1988, IBM J. Res. Dev..

[6]  M. Klimesh,et al.  Memory-Efficient Recursive Interleaved Entropy Coding , 2001 .

[7]  Michael J. Gormish,et al.  Very high speed entropy coding , 1994, Proceedings of 1st International Conference on Image Processing.

[8]  Glen G. Langdon,et al.  Universal modeling and coding , 1981, IEEE Trans. Inf. Theory.

[9]  M. Klimesh,et al.  A New Entropy Coding Technique for Data Compression , 2001 .

[10]  Glen G. Langdon,et al.  Arithmetic Coding , 1979 .

[11]  Ian H. Witten,et al.  Arithmetic coding revisited , 1998, TOIS.

[12]  Shigenori Kino,et al.  Bi-level image coding with MELCODE-comparison of block type code and arithmetic type code , 1989, IEEE Global Telecommunications Conference, 1989, and Exhibition. 'Communications Technology for the 1990s and Beyond.

[13]  Khanh Nguyen-Phi,et al.  A new binary source coder and its application in bi-level image compression , 1996, Proceedings of GLOBECOM'96. 1996 IEEE Global Telecommunications Conference.

[14]  David C. van Voorhis,et al.  Optimal source codes for geometrically distributed integer alphabets (Corresp.) , 1975, IEEE Trans. Inf. Theory.

[15]  S. Golomb Run-length encodings. , 1966 .