Entropy-Based Evaluation of Context Models for Wavelet-Transformed Images

Entropy is a measure of a message uncertainty. Among others aspects, it serves to determine the minimum coding rate that practical systems may attain. This paper defines an entropy-based measure to evaluate context models employed in wavelet-based image coding. The proposed measure is defined considering the mechanisms utilized by modern coding systems. It establishes the maximum performance achievable with each context model. This helps to determine the adequateness of the model under different coding conditions and serves to predict with high precision the coding rate achieved by practical systems. Experimental results evaluate four well-known context models using different types of images, coding rates, and transform strategies. They reveal that, under specific coding conditions, some widely-spread context models may not be as adequate as it is generally thought. The hints provided by this analysis may help to design simpler and more efficient wavelet-based image codecs.

[1]  Jianhua Chen.  Context modeling based on context quantization with application in wavelet image coding , 2004, IEEE Trans. Image Process..

[2]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2013, The Kluwer international series in engineering and computer science.

[3]  Xiaolin Wu.  Context quantization with Fisher discriminant for adaptive embedded wavelet image coding , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[4]  Michael W. Marcellin,et al.  Lossy-to-lossless 3D image coding through prior coefficient lookup tables , 2013, Inf. Sci..

[5]  William A. Pearlman,et al.  A Wavelet-Based Two-Stage Near-Lossless Coder , 2006, IEEE Transactions on Image Processing.

[6]  Enrico Magli,et al.  Transform Coding Techniques for Lossy Hyperspectral Data Compression , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Sheila S. Hemami,et al.  Robust Rate-Control for Wavelet-Based Image Coding via Conditional Probability Models , 2007, IEEE Transactions on Image Processing.

[8]  Panos Nasiopoulos,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Symmetry-Based Scalable Lossless Compression of 3D Medical Image Data , 2022 .

[9]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[10]  Francesc Aulí Llinàs,et al.  JPEG2000 Quality Scalability Without Quality Layers , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Dake He,et al.  On the Operational Rate-Distortion Performance of Uniform Scalar Quantization-Based Wyner–Ziv Coding of Laplace–Markov Sources , 2008, IEEE Transactions on Multimedia.

[12]  Francesc Aulí Llinàs.  Stationary Probability Model for Bitplane Image Coding Through Local Average of Wavelet Coefficients , 2011, IEEE Trans. Image Process..

[13]  Michael W. Marcellin,et al.  Stationary Probability Model for Microscopic Parallelism in JPEG2000 , 2014, IEEE Transactions on Multimedia.

[14]  Marta Karczewicz,et al.  Transform Coefficient Coding in HEVC , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  David He,et al.  Uniform Scalar Quantization Based Wyner-Ziv Coding of Laplace-Markov Source , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[16]  Mihaela van der Schaar,et al.  Operational rate-distortion modeling for wavelet video coders , 2006, IEEE Transactions on Signal Processing.

[17]  Michael W. Marcellin,et al.  Scanning Order Strategies for Bitplane Image Coding , 2012, IEEE Transactions on Image Processing.

[18]  Sheila S. Hemami,et al.  Efficient Entropy Estimation Based on Doubly Stochastic Models for Quantized Wavelet Image Data , 2007, IEEE Transactions on Image Processing.

[19]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[20]  Nasir D. Memon,et al.  CALIC-a context based adaptive lossless image codec , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[21]  Mihaela van der Schaar,et al.  Analytical Rate-Distortion-Complexity Modeling of Wavelet-Based Video Coders , 2008, IEEE Transactions on Signal Processing.

[22]  Jorma Rissanen,et al.  Generalized Kraft Inequality and Arithmetic Coding , 1976, IBM J. Res. Dev..

[23]  Peter Schelkens,et al.  Wavelet Coding of Volumetric Medical Datasets , 2003, IEEE Trans. Medical Imaging.

[24]  Michel Barlaud,et al.  Mutual information-based context quantization , 2010, Signal Process. Image Commun..

[25]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Pierre Moulin,et al.  Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients , 2001, IEEE Trans. Image Process..

[27]  William A. Pearlman,et al.  Efficient, low-complexity image coding with a set-partitioning embedded block coder , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Yoonsik Choe,et al.  Direction-adaptive context modeling for sign coding in embedded wavelet image coder , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[29]  Manuel P. Malumbres,et al.  E-LTW: An enhanced LTW encoder with sign coding and precise rate control , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[30]  Francesc Aulí Llinàs.  General Embedded Quantization for Wavelet-Based Lossy Image Coding , 2013, IEEE Transactions on Signal Processing.

[31]  Sheila S. Hemami,et al.  Efficient sign coding and estimation of zero-quantized coefficients in embedded wavelet image codecs , 2003, IEEE Trans. Image Process..

[32]  Zhen Liu,et al.  Mutual information-based analysis of JPEG2000 contexts , 2005, IEEE Transactions on Image Processing.

[33]  Hsueh-Ming Hang,et al.  One-Sided $\rho$-GGD Source Modeling and Rate-Distortion Optimization in Scalable Wavelet Video Coder , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Avideh Zakhor,et al.  Multirate 3-D subband coding of video , 1994, IEEE Trans. Image Process..

[35]  David S. Taubman,et al.  High performance scalable image compression with EBCOT , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).