Fast variational Bayesian approaches applied to large dimensional problems

This paper introduces two unsupervised approaches for large dimensional ill-posed inverse problems. These approaches are based on improved variational Bayesian (VB) methodologies, where a functional optimization problem is involved. We propose to solve this problem by adapting the subspace optimization methods into the functional space. The application of these approaches to image processing problems is considered thanks to a TV prior. We highlight the efficiency of our approaches through comparisons with a classical VB based one on a super-resolution problem.

[1]  Ronald J. Jaszczak,et al.  Fully Bayesian estimation of Gibbs hyperparameters for emission computed tomography data , 1997, IEEE Transactions on Medical Imaging.

[2]  Manfred K. Warmuth,et al.  Exponentiated Gradient Versus Gradient Descent for Linear Predictors , 1997, Inf. Comput..

[3]  Hagai Attias,et al.  A Variational Bayesian Framework for Graphical Models , 1999 .

[4]  D. Hunter,et al.  A Tutorial on MM Algorithms , 2004 .

[5]  A. Miele,et al.  Study on a memory gradient method for the minimization of functions , 1969 .

[6]  V. Šmídl,et al.  The Variational Bayes Method in Signal Processing , 2005 .

[7]  R. Cooke Real and Complex Analysis , 2011 .

[8]  Rafael Molina,et al.  On the Hierarchical Bayesian Approach to Image Restoration: Applications to Astronomical Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Aggelos K. Katsaggelos,et al.  Variational Bayesian Super Resolution , 2011, IEEE Transactions on Image Processing.

[10]  Jie Shen,et al.  A new super-memory gradient method with curve search rule , 2005, Appl. Math. Comput..

[11]  Thomas Rodet,et al.  A Measure-Theoretic Variational Bayesian Algorithm for Large Dimensional Problems , 2014, SIAM J. Imaging Sci..

[12]  José M. Bioucas-Dias,et al.  Adaptive total variation image deconvolution: A majorization-minimization approach , 2006, 2006 14th European Signal Processing Conference.

[13]  Émilie Chouzenoux,et al.  A Majorize–Minimize Strategy for Subspace Optimization Applied to Image Restoration , 2011, IEEE Transactions on Image Processing.