Iterative image reconstruction : a point of view

Several iterative methods are available for solving the ill-posed problem of image reconstruction. They are motivated by different approaches and may derive from methods used for the solution of linear equations or the minimization of suitable functionals. In this paper we adopt the approach flowing from maximum likelihood to Bayesian formulation of image reconstruction and providing a generalization of the classical regularization theory. This approach leads to the minimization of functionals derived from properties of the noise and, possibly, from additional information on the solution. We investigate a class of scaled gradient methods, based on a suitable decomposition of the gradient, and we show that this class contains some of the methods used for the solution of maximum likelihood problems in image reconstruction. We also obtain very simple regularized versions of these methods. Constraints of non-negativity and flux conservation are taken into account by considering scaled gradient projection (SGP) methods, derived from the previous approach, and for them a convergence proof can be given. Numerical experience on a particular problem shows that SGP can provide a considerable increase in efficiency with respect to the standard algorithm used for that problem. Work is in progress in order to understand whether a similar gain can be achieved in other cases.

[1]  J. Hadamard Sur les problemes aux derive espartielles et leur signification physique , 1902 .

[2]  J. Hadamard,et al.  Lectures on Cauchy's Problem in Linear Partial Differential Equations , 1924 .

[3]  A. Tikhonov On the stability of inverse problems , 1943 .

[4]  Fritz John,et al.  Continuous dependence on data for solutions of partial differential equations with a prescribed bound , 1960 .

[5]  M. Foster An Application of the Wiener-Kolmogorov Smoothing Theory to Matrix Inversion , 1961 .

[6]  A Tikhonov,et al.  Solution of Incorrectly Formulated Problems and the Regularization Method , 1963 .

[7]  K. Miller,et al.  Some Problems in Numerical Analytic Continuation , 1965 .

[8]  Otto Neall Strand,et al.  Statistical Estimation of the Numerical Solution of a Fredholm Integral Equation of the First Kind , 1968, JACM.

[9]  K. Miller Least Squares Methods for Ill-Posed Problems with a Prescribed Bound , 1970 .

[10]  Joel Franklin,et al.  Well-posed stochastic extensions of ill-posed linear problems☆ , 1970 .

[11]  Valentin F. Turchin,et al.  The use of mathematical-statistics methods in the solution of incorrectly posed problems , 1971 .

[12]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[13]  L. Lucy An iterative technique for the rectification of observed distributions , 1974 .

[14]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[15]  Mario Bertero,et al.  The Stability of Inverse Problems , 1980 .

[16]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[17]  K. Lange,et al.  EM reconstruction algorithms for emission and transmission tomography. , 1984, Journal of computer assisted tomography.

[18]  L. Shepp,et al.  A Statistical Model for Positron Emission Tomography , 1985 .

[19]  Mario Bertero,et al.  Linear inverse problems with discrete data. I. General formulation and singular system analysis , 1985 .

[20]  M. Daube-Witherspoon,et al.  An Iterative Image Space Reconstruction Algorthm Suitable for Volume ECT , 1986, IEEE Transactions on Medical Imaging.

[21]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[22]  M. E. Daube-Witherspoon,et al.  An iterative image space reconstruction algorithm suitable for volume ECT.IEEE Trans. , 1986 .

[23]  B. Schorr,et al.  On an iterative method for a class of integral equations of the first kind , 1987 .

[24]  Stuart Geman,et al.  Statistical methods for tomographic image reconstruction , 1987 .

[25]  Alvaro R. De Pierro OntheConvergence oftheIterative ImageSpace Reconstruction Algorithm forVolumeECT , 1987 .

[26]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[27]  B. Schorr,et al.  On properties of the iterative maximum likelihood reconstruction method , 1989 .

[28]  Alfredo N. Iusem Convergence analysis for a multiplicatively relaxed EM algorithm , 1991 .

[29]  H. N. Mülthei Iterative continuous maximum‐likelihood reconstruction method , 1992 .

[30]  R. White,et al.  Image recovery from data acquired with a charge-coupled-device camera. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[31]  D S Biggs,et al.  Acceleration of iterative image restoration algorithms. , 1997, Applied optics.

[32]  José Mario Martínez,et al.  Nonmonotone Spectral Projected Gradient Methods on Convex Sets , 1999, SIAM J. Optim..

[33]  H Lantéri,et al.  A general method to devise maximum-likelihood signal restoration multiplicative algorithms with non-negativity constraints , 2001, Signal Process..

[34]  M Berteroi,et al.  Linear inverse problems with discrete data. I. General formulation and singular system analysis , 1985 .

[35]  H. Lantéri,et al.  Penalized maximum likelihood image restoration with positivity constraints:multiplicative algorithms , 2002 .

[36]  J. M. Martínez,et al.  Inexact spectral projected gradient methods on convex sets , 2003 .

[37]  Luca Zanni,et al.  Gradient projection methods for quadratic programs and applications in training support vector machines , 2005, Optim. Methods Softw..

[38]  W. Hager,et al.  The cyclic Barzilai-–Borwein method for unconstrained optimization , 2006 .

[39]  Bin Zhou,et al.  Gradient Methods with Adaptive Step-Sizes , 2006, Comput. Optim. Appl..

[40]  Roger Fletcher,et al.  New algorithms for singly linearly constrained quadratic programs subject to lower and upper bounds , 2006, Math. Program..

[41]  Marcel Carbillet,et al.  Iterative methods for the reconstruction of astronomical images with high dynamic range , 2007 .

[43]  M. Bertero,et al.  The study of an iterative method for the reconstruction of images corrupted by Poisson and Gaussian noise , 2008 .

[44]  Krzysztof C. Kiwiel,et al.  Breakpoint searching algorithms for the continuous quadratic knapsack problem , 2007, Math. Program..

[45]  L. Zanni,et al.  A scaled gradient projection method for constrained image deblurring , 2008 .

[46]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .