Whiteness Constraints in a Unified Variational Framework for Image Restoration

We propose a robust variational model for the restoration of images corrupted by blur and the general class of additive white noises. The key idea behind our proposal relies on a novel hard constraint imposed on the residual of the restoration, namely we characterize a residual whiteness set to which the restored image must belong. As the feasible set is unbounded, solution existence results for the proposed variational model are given. Moreover, based on theoretical derivations as well as on Monte Carlo simulations, we provide well-founded guidelines for setting the whiteness constraint limits. The solution of the non-trivial optimization problem, due to the non-smooth non-convex proposed model, is efficiently obtained by an alternating directions method of multipliers, which in particular reduces the solution to a sequence of convex optimization subproblems. Numerical results show the potentiality of the proposed model for restoring blurred images corrupted by several kinds of additive white noises.

[1]  M. S. Bartlett,et al.  Some probability limit theorems with statistical applications , 1953, Mathematical Proceedings of the Cambridge Philosophical Society.

[2]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[3]  Zhi-Quan Luo,et al.  Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems , 2015, ICASSP.

[4]  Thomas Brox,et al.  iPiano: Inertial Proximal Algorithm for Nonconvex Optimization , 2014, SIAM J. Imaging Sci..

[5]  Thomas Brox,et al.  On Iteratively Reweighted Algorithms for Nonsmooth Nonconvex Optimization in Computer Vision , 2015, SIAM J. Imaging Sci..

[6]  Yiqiu Dong,et al.  Cauchy Noise Removal by Nonconvex ADMM with Convergence Guarantees , 2017, Journal of Scientific Computing.

[7]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[8]  Gilles Aubert,et al.  A Variational Approach to Removing Multiplicative Noise , 2008, SIAM J. Appl. Math..

[9]  Michael Elad,et al.  The Little Engine That Could: Regularization by Denoising (RED) , 2016, SIAM J. Imaging Sci..

[10]  Michael Werman,et al.  Probabilistic Analysis of Regularization , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Yann Gousseau,et al.  A Correlation-Based Dissimilarity Measure for Noisy Patches , 2017, SSVM.

[12]  P. Hansen.  Discrete Inverse Problems: Insight and Algorithms , 2010 .

[13]  Serena Morigi,et al.  Image restoration with Poisson–Gaussian mixed noise , 2014, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[14]  Serena Morigi,et al.  Constrained TV p -ℓ 2 Model for Image Restoration. , 2016 .

[15]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[16]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[17]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[18]  Wotao Yin,et al.  Global Convergence of ADMM in Nonconvex Nonsmooth Optimization , 2015, Journal of Scientific Computing.

[19]  Xiaojun Chen,et al.  Alternating Direction Method of Multipliers for a Class of Nonconvex and Nonsmooth Problems with Applications to Background/Foreground Extraction , 2015, SIAM J. Imaging Sci..

[20]  Bernard Widrow,et al.  Quantization Noise: Roundoff Error in Digital Computation, Signal Processing, Control, and Communications , 2008 .

[21]  Mila Nikolova,et al.  Bilevel Image Denoising Using Gaussianity Tests , 2015, SSVM.

[22]  Dianne P. O'Leary,et al.  Residual periodograms for choosing regularization parameters for ill-posed problems , 2008 .

[23]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[24]  Jean-Michel Morel,et al.  SURE Guided Gaussian Mixture Image Denoising , 2013, SIAM J. Imaging Sci..

[25]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..

[26]  Tieyong Zeng,et al.  Variational Approach for Restoring Blurred Images with Cauchy Noise , 2015, SIAM J. Imaging Sci..

[27]  Thierry Blu,et al.  Image Denoising in Mixed Poisson–Gaussian Noise , 2011, IEEE Transactions on Image Processing.

[28]  J. Neyman.  Outline of a Theory of Statistical Estimation Based on the Classical Theory of Probability , 1937 .

[29]  Suyash P. Awate,et al.  Unsupervised, information-theoretic, adaptive image filtering for image restoration , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Amel Benazza-Benyahia,et al.  A Nonlinear Stein-Based Estimator for Multichannel Image Denoising , 2007, IEEE Transactions on Signal Processing.

[31]  Zhou Wang,et al.  The Use of Residuals in Image Denoising , 2009, ICIAR.

[32]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[33]  Stochastic Relaxation , 2014, Computer Vision, A Reference Guide.

[34]  Serena Morigi,et al.  A Unified Framework for the Restoration of Images Corrupted by Additive White Noise , 2017, SSVM.

[35]  Dirk A. Lorenz,et al.  Minimization of Non-smooth, Non-convex Functionals by Iterative Thresholding , 2014, Journal of Optimization Theory and Applications.

[36]  Serena Morigi,et al.  Variational Image Restoration with Constraints on Noise Whiteness , 2014, Journal of Mathematical Imaging and Vision.

[37]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[38]  Alessandro Foi,et al.  Optimal Inversion of the Anscombe Transformation in Low-Count Poisson Image Denoising , 2011, IEEE Transactions on Image Processing.

[39]  Anthony J. Yezzi,et al.  Variational Image Denoising Based on Autocorrelation Whiteness , 2013, SIAM J. Imaging Sci..

[40]  Xuecheng Tai,et al.  AUGMENTED LAGRANGIAN METHOD FOR TOTAL VARIATION RESTORATION WITH NON-QUADRATIC FIDELITY , 2011 .

[41]  Adi Ben-Israel,et al.  A concentrated Cauchy distribution with finite moments , 2013, Ann. Oper. Res..

[42]  Guoyin Li,et al.  Global Convergence of Splitting Methods for Nonconvex Composite Optimization , 2014, SIAM J. Optim..

[43]  Christian Clason,et al.  L∞ fitting for inverse problems with uniform noise , 2012 .

[44]  Benjamin Pfaff,et al.  Handbook Of Image And Video Processing , 2016 .

[45]  Serena Morigi,et al.  Constrained TV$$_p$$p-$$\ell _2$$ℓ2 Model for Image Restoration , 2015 .

[46]  B. Widrow,et al.  Quantization Noise: Dither , 2008 .

[47]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[48]  Massimo Fornasier,et al.  Linearly Constrained Nonsmooth and Nonconvex Minimization , 2012, SIAM J. Optim..

[49]  P. Hansen,et al.  Exploiting Residual Information in the Parameter Choice for Discrete Ill-Posed Problems , 2006 .

[50]  L Benini,et al.  Image enhancement variational methods for enabling strong cost reduction in OLED‐based point‐of‐care immunofluorescent diagnostic systems , 2018, International journal for numerical methods in biomedical engineering.

[51]  O. Scherzer.  Handbook of mathematical methods in imaging , 2011 .

[52]  Aggelos K. Katsaggelos,et al.  Parameter Estimation in TV Image Restoration Using Variational Distribution Approximation , 2008, IEEE Transactions on Image Processing.

[53]  R. Chan,et al.  An Adaptive Strategy for the Restoration of Textured Images using Fractional Order Regularization , 2013 .

[54]  Mila Nikolova,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004, Journal of Mathematical Imaging and Vision.

[55]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .