Markovian reconstruction using a GNC approach

This paper is concerned with the reconstruction of images (or signals) from incomplete, noisy data, obtained at the output of an observation system. The solution is defined in maximum a posteriori (MAP) sense and it appears as the global minimum of an energy function joining a convex data-fidelity term and a Markovian prior energy. The sought images are composed of nearly homogeneous zones separated by edges and the prior term accounts for this knowledge. This term combines general nonconvex potential functions (PFs) which are applied to the differences between neighboring pixels. The resultant MAP energy generally exhibits numerous local minima. Calculating its local minimum, placed in the vicinity of the maximum likelihood estimate, is inexpensive but the resultant estimate is usually disappointing. Optimization using simulated annealing is practical only in restricted situations. Several deterministic suboptimal techniques approach the global minimum of special MAP energies, employed in the field of image denoising, at a reasonable numerical cost. The latter techniques are not directly applicable to general observation systems, nor to general Markovian prior energies. This work is devoted to the generalization of one of them, the graduated nonconvexity (GNC) algorithm, in order to calculate nearly-optimal MAP solutions in a wide range of situations. In fact, GNC provides a solution by tracking a set of minima along a sequence of approximate energies, starting from a convex energy and progressing toward the original energy. In this paper, we develop a common method to derive efficient GNC-algorithms for the minimization of MAP energies which arise in the context of any observation system giving rise to a convex data-fidelity term and of Markov random field (MRF) energies involving any nonconvex and/or nonsmooth PFs. As a side-result, we propose how to construct pertinent initializations which allow us to obtain meaningful solutions using local minimization of these MAP energies. Two numerical experiments-an image deblurring and an emission tomography reconstruction-illustrate the performance of the proposed technique.

[1]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[2]  John W. Woods,et al.  Simulated annealing in compound Gaussian random fields , 1990, IEEE Trans. Inf. Theory.

[3]  Chengda Yang Efficient Stochastic Algorithms on Locally Bounded Image Space , 1993, CVGIP Graph. Model. Image Process..

[4]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[5]  Ali Mohammad-Djafari,et al.  Inversion of large-support ill-posed linear operators using a piecewise Gaussian MRF , 1998, IEEE Trans. Image Process..

[6]  Avinash C. Kak,et al.  Principles of computerized tomographic imaging , 2001, Classics in applied mathematics.

[7]  Aggelos K. Katsaggelos,et al.  Restoration of Severely Blurred High Range Images Using Stochastic and Deterministic Relaxation Algorithms in Compound Gauss Markov Random Fields , 1997, EMMCVPR.

[8]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[9]  Julian Besag,et al.  Digital Image Processing: Towards Bayesian image analysis , 1989 .

[10]  S. Mitter,et al.  Metropolis-type annealing algorithms for global optimization in R d , 1993 .

[11]  Andrew Blake,et al.  Comparison of the Efficiency of Deterministic and Stochastic Algorithms for Visual Reconstruction , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Stan Z. Li,et al.  On Discontinuity-Adaptive Smoothness Priors in Computer Vision , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Wesley E. Snyder,et al.  Image Relaxation: Restoration and Feature Extraction , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  L. L. Cam,et al.  Maximum likelihood : an introduction , 1990 .

[15]  Charles A. Bouman,et al.  Segmentation of textured images using a multiple resolution approach , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[16]  Ken D. Sauer,et al.  A unified approach to statistical tomography using coordinate descent optimization , 1996, IEEE Trans. Image Process..

[17]  D. Geman Random fields and inverse problems in imaging , 1990 .

[18]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[20]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[21]  C. Hwang,et al.  Diffusion for global optimization in R n , 1987 .

[22]  B. R. Hunt,et al.  The Application of Constrained Least Squares Estimation to Image Restoration by Digital Computer , 1973, IEEE Transactions on Computers.

[23]  Stuart Geman,et al.  Statistical methods for tomographic image reconstruction , 1987 .

[24]  Naoki Saito Superresolution of noisy band-limited data by data adaptive regularization and its application to seismic trace inversion , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[25]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[26]  Ken D. Sauer,et al.  A local update strategy for iterative reconstruction from projections , 1993, IEEE Trans. Signal Process..

[27]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[28]  José L. Marroquín Deterministic Interactive Particle Models for Image Processing and Computer Graphics , 1993, CVGIP Graph. Model. Image Process..

[29]  Wesley E. Snyder,et al.  Mean field annealing: a formalism for constructing GNC-like algorithms , 1992, IEEE Trans. Neural Networks.

[30]  Gabor T. Herman,et al.  Image reconstruction from projections : the fundamentals of computerized tomography , 1980 .

[31]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  S. Mitter,et al.  RECURSIVE STOCHASTIC ALGORITHMS FOR GLOBAL OPTIMIZATION IN , 2022 .

[33]  E. Wasserstrom Numerical Solutions by the Continuation Method , 1973 .

[34]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[35]  Y. G. Leclerc,et al.  Constructing Simple Stable Descriptions for Image Partitioning Final Submission to Ijcv , 1994 .

[36]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Federico Girosi,et al.  Parallel and Deterministic Algorithms from MRFs: Surface Reconstruction , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[39]  Rama Chellappa,et al.  Graduated nonconvexity algorithm for image estimation using compound Gauss Markov field models , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[40]  G. Bilbro,et al.  Mean-field approximation minimizes relative entropy , 1991 .