Image compression via joint statistical characterization in the wavelet domain

We develop a probability model for natural images, based on empirical observation of their statistics in the wavelet transform domain. Pairs of wavelet coefficients, corresponding to basis functions at adjacent spatial locations, orientations, and scales, are found to be non-Gaussian in both their marginal and joint statistical properties. Specifically, their marginals are heavy-tailed, and although they are typically decorrelated, their magnitudes are highly correlated. We propose a Markov model that explains these dependencies using a linear predictor for magnitude coupled with both multiplicative and additive uncertainties, and show that it accounts for the statistics of a wide variety of images including photographic images, graphical images, and medical images. In order to directly demonstrate the power of the model, we construct an image coder called EPWIC (embedded predictive wavelet image coder), in which subband coefficients are encoded one bitplane at a time using a nonadaptive arithmetic encoder that utilizes conditional probabilities calculated from the model. Bitplanes are ordered using a greedy algorithm that considers the MSE reduction per encoded bit. The decoder uses the statistical model to predict coefficient values based on the bits it has received. Despite the simplicity of the model, the rate-distortion performance of the coder is roughly comparable to the best image coders in the literature.

[1]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[2]  M. Vetterli Multi-dimensional sub-band coding: Some theory and algorithms , 1984 .

[3]  Hamid Gharavi,et al.  Sub-Band Coding Of Digital Images Using Two-Dimensional Quadrature Mirror Filtering , 1986, Other Conferences.

[4]  John W. Woods,et al.  Subband coding of images , 1986, IEEE Trans. Acoust. Speech Signal Process..

[5]  Edward H. Adelson,et al.  Orthogonal Pyramid Transforms For Image Coding. , 1987, Other Conferences.

[6]  Eero P. Simoncelli Orthogonal sub-band image transforms , 1988 .

[7]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Alex Pentland,et al.  A practical approach to fractal-based image compression , 1991, [1991] Proceedings. Data Compression Conference.

[9]  Alex Pentland,et al.  Practical approach to fractal-based image compression , 1991, Other Conferences.

[10]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..

[11]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[12]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[13]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[14]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[15]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[16]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[17]  G. Wornell Wavelet-based representations for the 1/f family of fractal processes , 1993, Proc. IEEE.

[18]  David L. Donoho,et al.  Nonlinear Wavelet Methods for Recovery of Signals, Densities, and Spectra from Indirect and Noisy Da , 1993 .

[19]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[20]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[21]  Roberto Rinaldo,et al.  Image coding by block prediction of multiresolution subimages , 1995, IEEE Trans. Image Process..

[22]  Thomas R. Fischer,et al.  Image subband coding using arithmetic coded trellis coded quantization , 1995, IEEE Trans. Circuits Syst. Video Technol..

[23]  Ahmad Zandi,et al.  Implementation of compression with reversible embedded wavelets , 1995, Optics & Photonics.

[24]  Wilson C. Chung,et al.  A jointly optimized subband coder , 1996, IEEE Trans. Image Process..

[25]  Edward H. Adelson,et al.  Noise removal via Bayesian wavelet coring , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[26]  William A. Pearlman,et al.  An image multiresolution representation for lossless and lossy compression , 1996, IEEE Trans. Image Process..

[27]  Song-Chun Zhu,et al.  FRAME: filters, random fields, and minimax entropy towards a unified theory for texture modeling , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  D. Field,et al.  Natural image statistics and efficient coding. , 1996, Network.

[29]  Michael T. Orchard,et al.  Image coding based on mixture modeling of wavelet coefficients and a fast estimation-quantization framework , 1997, Proceedings DCC '97. Data Compression Conference.

[30]  Eero P. Simoncelli Statistical models for images: compression, restoration and synthesis , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[31]  Antonio Ortega,et al.  Efficient context-based lossy wavelet image coding , 1997 .

[32]  Antonio Ortega,et al.  Efficient context-based entropy cod-ing for lossy wavelet image coding , 1997 .

[33]  C.-C. Jay Kuo,et al.  A multi-threshold wavelet coder (MTWC) for high fidelity image compression , 1997, Proceedings of International Conference on Image Processing.

[34]  Jianhua Chen,et al.  Context modeling and entropy coding of wavelet coefficients for image compression , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  C. Chrysafis,et al.  Efficient context-based entropy coding for lossy wavelet image compression , 1997, Proceedings DCC '97. Data Compression Conference.

[36]  Eero P. Simoncelli,et al.  Progressive wavelet image coding based on a conditional probability model , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[37]  Michael W. Marcellin,et al.  Comparison of different methods of classification in subband coding of images , 1997, IEEE Trans. Image Process..

[38]  Eero P. Simoncelli,et al.  Embedded wavelet image compression based on a joint probability model , 1997, Proceedings of International Conference on Image Processing.

[39]  Eero P. Simoncelli,et al.  Texture characterization via joint statistics of wavelet coefficient magnitudes , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[40]  Eero P. Simoncelli Bayesian Denoising of Visual Images in the Wavelet Domain , 1999 .

[41]  Eero P. Simoncelli,et al.  Texture modeling and synthesis using joint statistics of complex wavelet coefficients , 1999 .