Efficient unsupervised variational Bayesian image reconstruction using a sparse gradient prior

Abstract In this paper, we present an efficient unsupervised Bayesian approach and a prior distribution adapted to piecewise regular images. This approach is based on a hierarchical prior distribution promoting sparsity on image gradients. It is fully automatic since hyperparameters are estimated jointly with the image of interest. The estimation of all unknowns is performed efficiently thanks to a fast variational Bayesian approximation method. We highlight the good performance of the proposed approach through comparisons with state of the art approaches on an application to a diffraction tomographic problem.

[1]  Matthew J. Beal,et al.  The variational Bayesian EM algorithm for incomplete data: with application to scoring graphical model structures , 2003 .

[2]  Li Wang,et al.  Model Selection in the Sparsity Context for Inverse Problems in Bayesian Framework , 2017 .

[3]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[4]  Jun Zhu,et al.  Online Bayesian Passive-Aggressive Learning , 2013, ICML.

[5]  Curtis R. Vogel,et al.  Ieee Transactions on Image Processing Fast, Robust Total Variation{based Reconstruction of Noisy, Blurred Images , 2022 .

[6]  Hagai Attias,et al.  A Variational Bayesian Framework for Graphical Models , 1999 .

[7]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[8]  Hugues Talbot,et al.  A Majorize-Minimize Subspace Approach for ℓ2-ℓ0 Image Regularization , 2011, SIAM J. Imaging Sci..

[9]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jiri Matas,et al.  DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Jean-Christophe Pesquet,et al.  A Variational Bayesian Approach for Image Restoration—Application to Image Deblurring With Poisson–Gaussian Noise , 2016, IEEE Transactions on Computational Imaging.

[12]  Heye Zhang,et al.  Reweighted Anisotropic Total Variation Minimization for Limited-Angle CT Reconstruction , 2017, IEEE Transactions on Nuclear Science.

[13]  Michael Unser,et al.  Fast 3D reconstruction method for differential phase contrast X-ray CT. , 2016, Optics express.

[14]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[15]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[16]  Ali Mohammad-Djafari,et al.  Joint NDT Image Restoration and Segmentation Using Gauss–Markov–Potts Prior Models and Variational Bayesian Computation , 2009, IEEE Transactions on Image Processing.

[17]  Ali Mohammad-Djafari,et al.  Bayesian 3D X-ray Computed Tomography with a Hierarchical Prior Model for Sparsity in Haar Transform Domain , 2018, Entropy.

[18]  Thomas Rodet,et al.  A Measure-Theoretic Variational Bayesian Algorithm for Large Dimensional Problems , 2014, SIAM J. Imaging Sci..

[19]  Alfred O. Hero,et al.  A Survey of Stochastic Simulation and Optimization Methods in Signal Processing , 2015, IEEE Journal of Selected Topics in Signal Processing.

[20]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[21]  Thomas Rodet,et al.  Efficient Variational Bayesian Approximation Method Based on Subspace Optimization , 2015, IEEE Transactions on Image Processing.

[22]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[23]  Gene H. Golub,et al.  Generalized cross-validation as a method for choosing a good ridge parameter , 1979, Milestones in Matrix Computation.

[24]  Lionel Moisan,et al.  Total variation denoising using posterior expectation , 2008, 2008 16th European Signal Processing Conference.

[25]  P. L. Combettes,et al.  Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone Operators , 2011, Set-Valued and Variational Analysis.

[26]  Wei Wei,et al.  Cluster Sparsity Field for Hyperspectral Imagery Denoising , 2016, ECCV.

[27]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[28]  V. Šmídl,et al.  The Variational Bayes Method in Signal Processing , 2005 .

[29]  José M. Bioucas-Dias,et al.  Adaptive total variation image deblurring: A majorization-minimization approach , 2009, Signal Process..

[30]  Liqing Zhang,et al.  Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[32]  Yi Wang,et al.  Scale-Recurrent Network for Deep Image Deblurring , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[33]  Jean-François Giovannelli,et al.  Unsupervised Bayesian convex deconvolution based on a field with an explicit partition function. , 2008, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[34]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[35]  Aggelos K. Katsaggelos,et al.  Parameter estimation in spike and slab variational inference for blind image deconvolution , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[36]  Andy M. Yip,et al.  Recent Developments in Total Variation Image Restoration , 2004 .

[37]  Qianshun Chang,et al.  Efficient Algorithm for Isotropic and Anisotropic Total Variation Deblurring and Denoising , 2013, J. Appl. Math..

[38]  M. Burger,et al.  Accurate EM-TV algorithm in PET with low SNR , 2008, 2008 IEEE Nuclear Science Symposium Conference Record.

[39]  Yuping Duan,et al.  Total Variation-Based Phase Retrieval for Poisson Noise Removal , 2018, SIAM J. Imaging Sci..

[40]  Frédéric Champagnat,et al.  A connection between half-quadratic criteria and EM algorithms , 2004, IEEE Signal Processing Letters.

[41]  Rafael Molina,et al.  On the Hierarchical Bayesian Approach to Image Restoration: Applications to Astronomical Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Zoubin Ghahramani,et al.  Propagation Algorithms for Variational Bayesian Learning , 2000, NIPS.

[43]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[44]  Ronald J. Jaszczak,et al.  Fully Bayesian estimation of Gibbs hyperparameters for emission computed tomography data , 1997, IEEE Transactions on Medical Imaging.

[45]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[46]  Guy Gilboa,et al.  Nonlocal Linear Image Regularization and Supervised Segmentation , 2007, Multiscale Model. Simul..

[47]  Pingkun Yan,et al.  Sparse coding for image denoising using spike and slab prior , 2013, Neurocomputing.

[48]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[49]  Aggelos K. Katsaggelos,et al.  Variational Bayesian Super Resolution , 2011, IEEE Transactions on Image Processing.

[50]  John W. Woods,et al.  Compound Gauss-Markov random fields for image estimation , 1991, IEEE Trans. Signal Process..

[51]  A. Mohammad-Djafari,et al.  Variational Bayesian inversion for microwave breast imaging , 2014 .