Image Restoration Using Space-Variant Gaussian Scale Mixtures in Overcomplete Pyramids

In recent years, Bayes least squares-Gaussian scale mixtures (BLS-GSM) has emerged as one of the most powerful methods for image restoration. Its strength relies on providing a simple and, yet, very effective local statistical description of oriented pyramid coefficient neighborhoods via a GSM vector. This can be viewed as a fine adaptation of the model to the signal variance at each scale, orientation, and spatial location. Here, we present an enhancement of the model by introducing a coarser adaptation level, where a larger neighborhood is used to estimate the local signal covariance within every subband. We formulate our model as a BLS estimator using space-variant GSM. The model can be also applied to image deconvolution, by first performing a global blur compensation, and then doing local adaptive denoising. We demonstrate through simulations that the proposed method, besides being model-based and noniterative, it is also robust and efficient. Its performance, measured visually and in L2-norm terms, is significantly higher than the original BLS-GSM method, both for denoising and deconvolution.

[1]  A. Haar Zur Theorie der orthogonalen Funktionensysteme , 1910 .

[2]  E. Kretzmer Statistics of television signals , 1952 .

[3]  Jong-Sen Lee,et al.  Digital Image Enhancement and Noise Filtering by Use of Local Statistics , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  M. West On scale mixtures of normal distributions , 1987 .

[5]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[7]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[8]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[9]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[10]  D. L. Donoho,et al.  Ideal spacial adaptation via wavelet shrinkage , 1994 .

[11]  D. Donoho,et al.  Translation-Invariant De-Noising , 1995 .

[12]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[13]  Aggelos K. Katsaggelos,et al.  Spatially adaptive wavelet-based multiscale image restoration , 1996, IEEE Trans. Image Process..

[14]  Eero P. Simoncelli Statistical models for images: compression, restoration and synthesis , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[15]  S. Mallat,et al.  Adaptive covariance estimation of locally stationary processes , 1998 .

[16]  Martin Vetterli,et al.  Spatially adaptive wavelet thresholding with context modeling for image denoising , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[17]  Pierre Moulin,et al.  Complexity-regularized image restoration , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[18]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[19]  Richard G. Baraniuk,et al.  Wavelet-domain regularized deconvolution for ill-conditioned systems , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[20]  Martin J. Wainwright,et al.  Visual adaptation as optimal information transmission , 1999, Vision Research.

[21]  S. Mallat,et al.  Minimax Restoration and Deconvolution , 1999 .

[22]  N. Kingsbury Image processing with complex wavelets , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[23]  Robert William Buccigrossi,et al.  Compression and segmentation of images using an intersubband wavelet probability model , 1999 .

[24]  Kannan Ramchandran,et al.  Low-complexity image denoising based on statistical modeling of wavelet coefficients , 1999, IEEE Signal Processing Letters.

[25]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[26]  Michael T. Orchard,et al.  Spatially adaptive image denoising under overcomplete expansion , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[27]  Martin J. Wainwright,et al.  Adaptive Wiener denoising using a Gaussian scale mixture model in the wavelet domain , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[28]  Nick G. Kingsbury,et al.  Image deconvolution using hidden Markov tree modeling of complex wavelet packets , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[29]  Levent Sendur,et al.  Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency , 2002, IEEE Trans. Signal Process..

[30]  Aleksandra Pizurica,et al.  A joint inter- and intrascale statistical model for Bayesian wavelet based image denoising , 2002, IEEE Trans. Image Process..

[31]  Justin K. Romberg,et al.  Multiscale geometric image processing , 2003, Visual Communications and Image Processing.

[32]  Robert D. Nowak,et al.  An EM algorithm for wavelet-based image restoration , 2003, IEEE Trans. Image Process..

[33]  Yakov I Nesterets,et al.  A method for local deconvolution. , 2003, Applied optics.

[34]  Aggelos K. Katsaggelos,et al.  Bayesian multichannel image restoration using compound Gauss-Markov random fields , 2003, IEEE Trans. Image Process..

[35]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[36]  Eero P. Simoncelli,et al.  Image restoration using Gaussian scale mixtures in the wavelet domain , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[37]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[38]  Richard G. Baraniuk,et al.  ForWaRD: Fourier-wavelet regularized deconvolution for ill-conditioned systems , 2004, IEEE Transactions on Signal Processing.

[39]  Stéphane Mallat,et al.  Sparse geometric image representations with bandelets , 2005, IEEE Transactions on Image Processing.

[40]  Javier Portilla,et al.  Two-level adaptive denoising using Gaussian scale mixtures in overcomplete oriented pyramids , 2005, IEEE International Conference on Image Processing 2005.

[41]  Robert D. Nowak,et al.  A bound optimization approach to wavelet-based image deconvolution , 2005, IEEE International Conference on Image Processing 2005.

[42]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[43]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[44]  Eero P. Simoncelli,et al.  Statistical Modeling of Images with Fields of Gaussian Scale Mixtures , 2006, NIPS.

[45]  José M. Bioucas-Dias,et al.  Bayesian wavelet-based image deconvolution: a GEM algorithm exploiting a class of heavy-tailed priors , 2006, IEEE Transactions on Image Processing.

[46]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[47]  Javier Portilla,et al.  Deblurring-by-Denoising using Spatially Adaptive Gaussian Scale Mixtures in Overcomplete Pyramids , 2006, 2006 International Conference on Image Processing.

[48]  Thomas W. Parks,et al.  Image denoising using total least squares , 2006, IEEE Transactions on Image Processing.

[49]  Karen O. Egiazarian,et al.  Shape-adaptive DCT for denoising and image reconstruction , 2006, Electronic Imaging.

[50]  Etienne E. Kerre,et al.  Perceived Image Quality Measurement of State-of-the-Art Noise Reduction Schemes , 2006, ACIVS.

[51]  Eero P. Simoncelli,et al.  Image Denoising with an Orientation-Adaptive Gaussian Scale Mixture Model , 2006, 2006 International Conference on Image Processing.

[52]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[53]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[54]  Karen O. Egiazarian,et al.  Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images , 2007, IEEE Transactions on Image Processing.