Inversion of large-support ill-posed linear operators using a piecewise Gaussian MRF

We propose a method for the reconstruction of signals and images observed partially through a linear operator with a large support (e.g., a Fourier transform on a sparse set). This inverse problem is ill-posed and we resolve it by incorporating the prior information that the reconstructed objects are composed of smooth regions separated by sharp transitions. This feature is modeled by a piecewise Gaussian (PG) Markov random field (MRF), known also as the weak-string in one dimension and the weak-membrane in two dimensions. The reconstruction is defined as the maximum a posteriori estimate. The prerequisite for the use of such a prior is the success of the optimization stage. The posterior energy corresponding to a PG MRF is generally multimodal and its minimization is particularly problematic. In this context, general forms of simulated annealing rapidly become intractable when the observation operator extends over a large support. In this paper, global optimization is dealt with by extending the graduated nonconvexity (GNC) algorithm to ill-posed linear inverse problems. GNC has been pioneered by Blake and Zisserman in the field of image segmentation. The resulting algorithm is mathematically suboptimal but it is seen to be very efficient in practice. We show that the original GNC does not correctly apply to ill-posed problems. Our extension is based on a proper theoretical analysis, which provides further insight into the GNC. The performance of the proposed algorithm is corroborated by a synthetic example in the area of diffraction tomography.

[1]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[2]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[3]  Dominique Lesselier,et al.  Eddy current testing of anomalies in conductive materials. II. Quantitative imaging via deterministic and stochastic inversion techniques , 1992 .

[4]  Yves Goussard,et al.  Markov modeling for Bayesian restoration of two-dimensional layered structures , 1993, IEEE Trans. Inf. Theory.

[5]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[6]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[7]  Gabor T. Herman,et al.  Image Reconstruction From Projections , 1975, Real Time Imaging.

[8]  Wesley E. Snyder,et al.  Image Relaxation: Restoration and Feature Extraction , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  John W. Woods,et al.  Compound Gauss-Markov random fields for image estimation , 1991, IEEE Trans. Signal Process..

[10]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Julian Besag,et al.  Digital Image Processing: Towards Bayesian image analysis , 1989 .

[12]  Andrew Blake,et al.  Comparison of the Efficiency of Deterministic and Stochastic Algorithms for Visual Reconstruction , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Chengda Yang Efficient Stochastic Algorithms on Locally Bounded Image Space , 1993, CVGIP Graph. Model. Image Process..

[14]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[15]  José M. N. Leitão,et al.  Simulated tearing: an algorithm for discontinuity-preserving visual surface reconstruction , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[16]  A. Tarantola Inverse problem theory : methods for data fitting and model parameter estimation , 1987 .

[17]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  E. Wasserstrom Numerical Solutions by the Continuation Method , 1973 .

[19]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[20]  Anthony J. Devaney,et al.  Diffraction tomographic reconstruction from intensity data , 1992, IEEE Trans. Image Process..

[21]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[22]  Joseph A. O'Sullivan,et al.  Roughness penalties on finite domains , 1995, IEEE Trans. Image Process..

[23]  J. M. Dinten,et al.  Tomographic reconstruction of axially symmetric objects: Regularization by a Markovian modelization , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[24]  P. Green Bayesian reconstructions from emission tomography data using a modified EM algorithm. , 1990, IEEE transactions on medical imaging.

[25]  Gabor T. Herman,et al.  Image Reconstruction From Projections , 1975, Real Time Imaging.

[26]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Federico Girosi,et al.  Parallel and Deterministic Algorithms from MRFs: Surface Reconstruction , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Charles A. Bouman,et al.  Segmentation of textured images using a multiple resolution approach , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[29]  Antonin Chambolle Dualité Mumford-Shah / Canny-Deriche et segmentation progressive d'images , 1993 .

[30]  G Demoment,et al.  Maximum entropy image reconstruction in X-ray and diffraction tomography. , 1988, IEEE transactions on medical imaging.

[31]  Guy Le Besnerais,et al.  Synthèse d'ouverture en radio-astronomie par maximum d'entropie sur la moyenne , 1991 .

[32]  Naoki Saito Superresolution of noisy band-limited data by data adaptive regularization and its application to seismic trace inversion , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[33]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[34]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[35]  Wesley E. Snyder,et al.  Mean field annealing: a formalism for constructing GNC-like algorithms , 1992, IEEE Trans. Neural Networks.

[36]  Mila Nikolova Parameter selection for a Markovian signal reconstruction with edge detection , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.