Bayesian inference for inverse problems

Traditionally, the MaxEnt workshops start by a tutorial day. This paper summarizes my talk during 2001’th workshop at John Hopkins University. The main idea in this talk is to show how the Bayesian inference can naturally give us all the necessary tools we need to solve real inverse problems: starting by simple inversion where we assume to know exactly the forward model and all the input model parameters up to more realistic advanced problems of myopic or blind inversion where we may be uncertain about the forward model and we may have noisy data. Starting by an introduction to inverse problems through a few examples and explaining their ill posedness nature, I briefly presented the main classical deterministic methods such as data matching and classical regularization methods to show their limitations. I then presented the main classical probabilistic methods based on likelihood, information theory and maximum entropy and the Bayesian inference framework for such problems. I show that the Bayesian framew...

[1]  R. Hanson.  A Numerical Method for Solving Fredholm Integral Equations of the First Kind Using Singular Values , 1971 .

[2]  D. Titterington.  Common structure of smoothing techniques in statistics , 1985 .

[3]  John Skilling,et al.  Theory of Maximum Entropy Image Reconstruction , 1986 .

[4]  P. Hall,et al.  Common Structure of Techniques for Choosing Smoothing Parameters in Regression Problems , 1987 .

[5]  M. Bertero,et al.  Ill-posed problems in early vision , 1988, Proc. IEEE.

[6]  L. Younes.  Estimation and annealing for Gibbsian fields , 1988 .

[7]  L. Younes.  Parametric Inference for imperfectly observed Gibbsian fields , 1989 .

[8]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[9]  Chin-Tu Chen,et al.  Image Restoration Using Gibbs Priors: Boundary Modeling, Treatment of Blurring, and Selection of Hyperparameter , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Empirical Bayes and conditional inference with many nuisance parameters , 1992 .

[11]  Richard M. Leahy,et al.  Statistic-based MAP image-reconstruction from Poisson data using Gibbs priors , 1992, IEEE Trans. Signal Process..

[12]  Alfred O. Hero,et al.  Complete-data spaces and generalized EM algorithms , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  Yves Goussard,et al.  GCV and ML Methods of Determining Parameters in Image Restoration by Regularization: Fast Computation in the Spatial Domain and Experimental Comparison , 1993, J. Vis. Commun. Image Represent..

[14]  Ali Mohammad-Djafari,et al.  On the estimation of hyperparameters in Bayesian approach of solving inverse problems , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Ken D. Sauer,et al.  Maximum likelihood scale estimation for a class of Markov random fields , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[17]  Yves Goussard,et al.  Unsupervised deconvolution of sparse spike trains using stochastic approximation , 1996, IEEE Trans. Signal Process..

[18]  A. Mohammad-Djafari.  A full Bayesian approach for inverse problems , 2001, physics/0111123.

[19]  Gif-sur-Yvette.,et al.  Scale Invariant Markov Models for Bayesian Inversion of Linear Inverse Problems , 2001, physics/0111124.

[20]  Guy Le Besnerais,et al.  A new look at entropy for solving linear inverse problems , 1999, IEEE Trans. Inf. Theory.

[21]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[22]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.