Bregman Cost for Non-Gaussian Noise

One of the tasks of the Bayesian inverse problem is to find a good estimate based on the posterior probability density. The most common point estimators are the conditional mean (CM) and maximum a posteriori (MAP) estimates, which correspond to the mean and the mode of the posterior, respectively. From a theoretical point of view it has been argued that the MAP estimate is only in an asymptotic sense a Bayes estimator for the uniform cost function, while the CM estimate is a Bayes estimator for the means squared cost function. Recently, it has been proven that the MAP estimate is a proper Bayes estimator for the Bregman cost if the image is corrupted by Gaussian noise. In this work we extend this result to other noise models with log-concave likelihood density, by introducing two related Bregman cost functions for which the CM and the MAP estimates are proper Bayes estimators. Moreover, we also prove that the CM estimate outperforms the MAP estimate, when the error is measured in a certain Bregman distance, a result previously unknown also in the case of additive Gaussian noise.

[1]  Thierry Blu,et al.  Image Denoising in Mixed Poisson–Gaussian Noise , 2011, IEEE Transactions on Image Processing.

[2]  Tieyong Zeng,et al.  Variational Approach for Restoring Blurred Images with Cauchy Noise , 2015, SIAM J. Imaging Sci..

[3]  E. Somersalo,et al.  Statistical and computational inverse problems , 2004 .

[4]  Gilles Aubert,et al.  Efficient Schemes for Total Variation Minimization Under Constraints in Image Processing , 2009, SIAM J. Sci. Comput..

[5]  M. Hurn,et al.  Loss Functions for Bayesian Image Analysis , 1997 .

[6]  Thomas J. Asaki,et al.  A Variational Approach to Reconstructing Images Corrupted by Poisson Noise , 2007, Journal of Mathematical Imaging and Vision.

[7]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[8]  Carola-Bibiane Schönlieb,et al.  Bilevel approaches for learning of variational imaging models , 2015, ArXiv.

[9]  Andrew M. Stuart,et al.  Inverse problems: A Bayesian perspective , 2010, Acta Numerica.

[10]  A. M. Stuart,et al.  Sparse deterministic approximation of Bayesian inverse problems , 2011, 1103.4522.

[11]  A. Stuart,et al.  MAP estimators and their consistency in Bayesian nonparametric inverse problems , 2013, 1303.4795.

[12]  Alessandro Foi,et al.  Noise estimation and removal in MR imaging: The variance-stabilization approach , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  José M. Bioucas-Dias,et al.  Restoration of Poissonian Images Using Alternating Direction Optimization , 2010, IEEE Transactions on Image Processing.

[14]  Tony F. Chan,et al.  Image processing and analysis , 2005 .

[15]  Mila Nikolova,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004, Journal of Mathematical Imaging and Vision.

[16]  Gilles Aubert,et al.  A Variational Approach to Removing Multiplicative Noise , 2008, SIAM J. Appl. Math..

[17]  Martin Burger,et al.  Maximum a posteriori probability estimates in infinite-dimensional Bayesian inverse problems , 2014, 1412.5816.

[18]  Lin He,et al.  Error estimation for Bregman iterations and inverse scale space methods in image restoration , 2007, Computing.

[19]  Dominic Welsh,et al.  Probability: An Introduction , 1986 .

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  Serena Morigi,et al.  Image restoration with Poisson–Gaussian mixed noise , 2014, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[22]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[23]  Lionel Moisan,et al.  Posterior Expectation of the Total Variation Model: Properties and Experiments , 2013, SIAM J. Imaging Sci..

[24]  H. Gudbjartsson,et al.  The rician distribution of noisy mri data , 1995, Magnetic resonance in medicine.

[25]  O. Scherzer.  Handbook of mathematical methods in imaging , 2011 .

[26]  Stanley Osher,et al.  Multiplicative Denoising and Deblurring: Theory and Algorithms , 2003 .

[27]  Junfeng Yang,et al.  An Efficient TVL1 Algorithm for Deblurring Multichannel Images Corrupted by Impulsive Noise , 2009, SIAM J. Sci. Comput..

[28]  S. Osher,et al.  Convergence rates of convex variational regularization , 2004 .

[29]  L. Bregman.  The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[30]  Tieyong Zeng,et al.  A Convex Variational Model for Restoring Blurred Images with Multiplicative Noise , 2013, SIAM J. Imaging Sci..

[31]  M. Burger,et al.  Maximum a posteriori estimates in linear inverse problems with log-concave priors are proper Bayes estimators , 2014, 1402.5297.

[32]  Tieyong Zeng,et al.  Total Variation Restoration of Images Corrupted by Poisson Noise with Iterated Conditional Expectations , 2015, SSVM.

[33]  Benjamin Pfaff,et al.  Handbook Of Image And Video Processing , 2016 .