Image Restoration Using Joint Statistical Modeling in a Space-Transform Domain

This paper presents a novel strategy for high-fidelity image restoration by characterizing both local smoothness and nonlocal self-similarity of natural images in a unified statistical manner. The main contributions are three-fold. First, from the perspective of image statistics, a joint statistical modeling (JSM) in an adaptive hybrid space-transform domain is established, which offers a powerful mechanism of combining local smoothness and nonlocal self-similarity simultaneously to ensure a more reliable and robust estimation. Second, a new form of minimization functional for solving the image inverse problem is formulated using JSM under a regularization-based framework. Finally, in order to make JSM tractable and robust, a new Split Bregman-based algorithm is developed to efficiently solve the above severely underdetermined inverse problem associated with theoretical proof of convergence. Extensive experiments on image inpainting, image deblurring, and mixed Gaussian plus salt-and-pepper noise removal applications verify the effectiveness of the proposed algorithm.

[1]  D. Louis Collins,et al.  New methods for MRI denoising based on sparseness and self-similarity , 2012, Medical Image Anal..

[2]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[3]  David B. Dunson,et al.  Nonparametric Bayesian Dictionary Learning for Analysis of Noisy and Incomplete Images , 2012, IEEE Transactions on Image Processing.

[4]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[5]  Gabriel Peyré,et al.  Image Processing with Nonlocal Spectral Bases , 2008, Multiscale Model. Simul..

[6]  K. Siddaraju,et al.  DIGITAL IMAGE RESTORATION , 2011 .

[7]  Richard A. Haddad,et al.  Adaptive median filters: new algorithms and results , 1995, IEEE Trans. Image Process..

[8]  Jian Zhang,et al.  Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization , 2014, Signal Process..

[9]  M. Varanasi,et al.  Parametric generalized Gaussian density estimation , 1989 .

[10]  Peyman Milanfar,et al.  Deblurring Using Regularized Locally Adaptive Kernel Regression , 2008, IEEE Transactions on Image Processing.

[11]  Jian-Feng Cai,et al.  Split Bregman Methods and Frame Based Image Restoration , 2009, Multiscale Model. Simul..

[12]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[13]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[15]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[16]  Karen O. Egiazarian,et al.  Video Denoising, Deblocking, and Enhancement Through Separable 4-D Nonlocal Spatiotemporal Transforms , 2012, IEEE Transactions on Image Processing.

[17]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[18]  Wen Gao,et al.  Compression Artifact Reduction by Overlapped-Block Transform Coefficient Estimation With Block Similarity , 2013, IEEE Transactions on Image Processing.

[19]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[20]  Xavier Bresson,et al.  Nonlocal Mumford-Shah Regularizers for Color Image Restoration , 2011, IEEE Transactions on Image Processing.

[21]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[22]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[23]  Jian Zhang,et al.  Improved total variation based image compressive sensing recovery by nonlocal regularization , 2012, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[24]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[25]  Guangtao Zhai,et al.  Image Reconstruction From Random Samples With Multiscale Hybrid Parametric and Nonparametric Modeling , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Wen Gao,et al.  Structural Group Sparse Representation for Image Compressive Sensing Recovery , 2013, 2013 Data Compression Conference.

[27]  Lixin Shen,et al.  Framelet Algorithms for De-Blurring Images Corrupted by Impulse Plus Gaussian Noise , 2011, IEEE Transactions on Image Processing.

[28]  Debin Zhao,et al.  High-quality image restoration from partial random samples in spatial domain , 2011, 2011 Visual Communications and Image Processing (VCIP).

[29]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[30]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[31]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[32]  Guangtao Zhai,et al.  Single Image Super-resolution With Detail Enhancement Based on Local Fractal Analysis of Gradient , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[34]  Wen Gao,et al.  Image Compressive Sensing Recovery via Collaborative Sparsity , 2012, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[35]  Mohamed-Jalal Fadili,et al.  3-D Data Denoising and Inpainting with the Low-Redundancy Fast Curvelet Transform , 2010, Journal of Mathematical Imaging and Vision.

[36]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[37]  Karen O. Egiazarian,et al.  Image restoration by sparse 3D transform-domain collaborative filtering , 2008, Electronic Imaging.

[38]  Lu Fang,et al.  Multichannel Nonlocal Means Fusion for Color Image Denoising , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[40]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[41]  Gaofeng Meng,et al.  Edge-Directed Single-Image Super-Resolution Via Adaptive Gradient Magnitude Self-Interpolation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  D. Donoho,et al.  Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) , 2005 .

[43]  K. J. Ray Liu,et al.  Image Denoising Games , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[44]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[45]  Abderrahim Elmoataz,et al.  Nonlocal Discrete Regularization on Weighted Graphs: A Framework for Image and Manifold Processing , 2008, IEEE Transactions on Image Processing.

[46]  GaoWen,et al.  Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization , 2014 .

[47]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[48]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[49]  Michael K. Ng,et al.  Fast Image Restoration Methods for Impulse and Gaussian Noises Removal , 2009, IEEE Signal Processing Letters.

[50]  Wen Gao,et al.  Compressed Sensing Recovery via Collaborative Sparsity , 2012, 2012 Data Compression Conference.

[51]  Karen O. Egiazarian,et al.  Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images , 2007, IEEE Transactions on Image Processing.