Context formation by mutual information maximization

In this paper, the problem of how to form the contexts for context-based entropy coding is studied. The mutual information (MI) between the context and the encoded data is used to measure the context optimality. The MI decreases when contexts are combined together. Given a desired number of contexts, an algorithm is proposed for finding the set of contexts by iteratively combining the pairs that give the minimum MI reduction. The proposed algorithm is applied to form the contexts for the zero coding (ZC) primitive of the JPEG2000 image compression standard. Experimental results show that the number of contexts used as part of the standard can be reduced without loss in the coding performance.

[1]  Glen G. Langdon,et al.  An Overview of the Basic Principles of the Q-Coder Adaptive Binary Arithmetic Coder , 1988, IBM J. Res. Dev..

[2]  Xiaolin Wu.  High-order context modeling and embedded conditional entropy coding of wavelet coefficients for image compression , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[3]  Jozsef Vass,et al.  Significance-linked connected component analysis for wavelet image coding , 1999, IEEE Trans. Image Process..

[4]  Jin Li,et al.  An embedded still image coder with rate-distortion optimization , 1999, IEEE Trans. Image Process..

[5]  Xiaolin Wu,et al.  Lossless compression of continuous-tone images via context selection, quantization, and modeling , 1997, IEEE Trans. Image Process..

[6]  Michael T. Orchard,et al.  Image coding based on a morphological representation of wavelet data , 1999, IEEE Trans. Image Process..

[7]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[8]  C. Chrysafis,et al.  Efficient context-based entropy coding for lossy wavelet image compression , 1997, Proceedings DCC '97. Data Compression Conference.

[9]  William A. Pearlman,et al.  An image multiresolution representation for lossless and lossy compression , 1996, IEEE Trans. Image Process..

[10]  Xiaolin Wu.  Context quantization with Fisher discriminant for adaptive embedded wavelet image coding , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[11]  David S. Taubman,et al.  High performance scalable image compression with EBCOT. , 2000, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[12]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..