Image Restoration Using Gaussian Mixture Models With Spatially Constrained Patch Clustering

In this paper, we address the problem of recovering degraded images using multivariate Gaussian mixture model (GMM) as a prior. The GMM framework in our method for image restoration is based on the assumption that the accumulation of similar patches in a neighborhood are derived from a multivariate Gaussian probability distribution with a specific covariance and mean. Previous methods of image restoration with GMM have not considered spatial (geometric) distance between patches in clustering. Our conducted experiments show that in the case of constraining Gaussian estimates into a finite-sized windows, the patch clusters are more likely to be derived from the estimated multivariate Gaussian distributions, i.e., the proposed statistical patch-based model provides a better goodness-of-fit to statistical properties of natural images. A novel approach for computing aggregation weights for image reconstruction from recovered patches is introduced which is based on similarity degree of each patch to the estimated Gaussian clusters. The results admit that in the case of image denoising, our method is highly comparable with the state-of-the-art methods, and our image interpolation method outperforms previous state-of-the-art methods.

[1]  Abderrahim Elmoataz,et al.  Nonlocal Discrete Regularization on Weighted Graphs: A Framework for Image and Manifold Processing , 2008, IEEE Transactions on Image Processing.

[2]  Saeed Gazor,et al.  Image Denoising Employing a Mixture of Circular Symmetric Laplacian Models with Local Parameters in Complex Wavelet Domain , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[3]  Naonori Ueda,et al.  Deterministic annealing EM algorithm , 1998, Neural Networks.

[4]  Gérard Govaert,et al.  Gaussian parsimonious clustering models , 1995, Pattern Recognit..

[5]  Christian Jutten,et al.  Image interpolation using Gaussian Mixture Models with spatially constrained patch clustering , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Peyman Milanfar,et al.  Global Image Denoising , 2014, IEEE Transactions on Image Processing.

[7]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  Marshall F. Tappen,et al.  Learning non-local range Markov Random field for image restoration , 2011, CVPR 2011.

[9]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[10]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[11]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.

[13]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[14]  Yi-Qing Wang,et al.  E-PLE: an Algorithm for Image Inpainting , 2013, Image Process. Line.

[15]  Michael Elad,et al.  Stable recovery of sparse overcomplete representations in the presence of noise , 2006, IEEE Transactions on Information Theory.

[16]  Jean-Michel Morel,et al.  Implementation of the "Non-Local Bayes" (NL-Bayes) Image Denoising Algorithm , 2013, Image Process. Line.

[17]  Jean-Michel Morel,et al.  A Nonlocal Bayesian Image Denoising Algorithm , 2013, SIAM J. Imaging Sci..

[18]  Purang Abolmaesumi,et al.  Speckle Noise Reduction of Medical Ultrasound Images in Complex Wavelet Domain Using Mixture Priors , 2008, IEEE Transactions on Biomedical Engineering.

[19]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[20]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[21]  David B. Dunson,et al.  Nonparametric Bayesian Dictionary Learning for Analysis of Noisy and Incomplete Images , 2012, IEEE Transactions on Image Processing.

[22]  Douglas A. Reynolds,et al.  Speaker Verification Using Adapted Gaussian Mixture Models , 2000, Digit. Signal Process..

[23]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[24]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[25]  Bell Telephone,et al.  ROBUST ESTIMATES, RESIDUALS, AND OUTLIER DETECTION WITH MULTIRESPONSE DATA , 1972 .

[26]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[27]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[28]  Rémi Gribonval,et al.  Sparse representations in unions of bases , 2003, IEEE Trans. Inf. Theory.

[29]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[30]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[31]  Te-Won Lee,et al.  On the multivariate Laplace distribution , 2006, IEEE Signal Processing Letters.

[32]  Q. M. Jonathan Wu,et al.  Fast and Robust Spatially Constrained Gaussian Mixture Model for Image Segmentation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[34]  Karen O. Egiazarian,et al.  Compressed Sensing Image Reconstruction Via Recursive Spatially Adaptive Filtering , 2007, ICIP.

[35]  Javier Portilla,et al.  Non-convex sparse optimization through deterministic annealing and applications , 2008, 2008 15th IEEE International Conference on Image Processing.

[36]  Yaonan Wang,et al.  Background subtraction based on adaptive non-parametric model , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[37]  L. Shenton,et al.  A Bivariate Model for the Distribution of √b1 and b2 , 1977 .

[38]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[39]  Lie Wang,et al.  Orthogonal Matching Pursuit for Sparse Signal Recovery With Noise , 2011, IEEE Transactions on Information Theory.

[40]  N. J. H. Small Plotting squared radii , 1978 .

[41]  Saeed Gazor,et al.  Image Denoising Based on A Mixture of Bivariate Laplacian Models in Complex Wavelet Domain , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[42]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[43]  Xin Li,et al.  Image Recovery Via Hybrid Sparse Representations: A Deterministic Annealing Approach , 2011, IEEE Journal of Selected Topics in Signal Processing.

[44]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Thomas J. Hebert,et al.  Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm , 1998, IEEE Trans. Image Process..

[46]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[47]  Xin Li Exemplar-Based EM-like image denoising via manifold reconstruction , 2010, 2010 IEEE International Conference on Image Processing.

[48]  J. Doornik,et al.  An Omnibus Test for Univariate and Multivariate Normality , 2008 .

[49]  Jean-Michel Morel,et al.  SURE Guided Gaussian Mixture Image Denoising , 2013, SIAM J. Imaging Sci..

[50]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[51]  Jae-On Kim,et al.  The Treatment of Missing Data in Multivariate Analysis , 1977 .