On regularization methods of EM-Kaczmarz type

We consider regularization methods of Kaczmarz type in connection with the expectation-maximization (EM) algorithm for solving ill-posed equations. For noisy data, our methods are stabilized extensions of the well-established ordered-subsets expectation-maximization iteration (OS-EM). We show monotonicity properties of the methods and present a numerical experiment which indicates that the extended OS-EM methods we propose are much faster than the standard EM algorithm in a relevant application.

[1]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[2]  Jeffrey A. Fessler,et al.  On complete-data spaces for PET reconstruction algorithms , 1993 .

[3]  Markus Haltmeier,et al.  Experimental evaluation of reconstruction algorithms for limited view photoacoustic tomography with line detectors , 2007 .

[4]  M. Hanke,et al.  A convergence analysis of the Landweber iteration for nonlinear ill-posed problems , 1995 .

[5]  Charles Byrne,et al.  Block-iterative algorithms , 2009, Int. Trans. Oper. Res..

[6]  Otmar Scherzer,et al.  KACZMARZ METHODS FOR REGULARIZING NONLINEAR ILL-POSED EQUATIONS II: APPLICATIONS , 2007 .

[7]  Peter Kuchment,et al.  Mathematics of thermoacoustic and photoacoustic tomography , 2007 .

[8]  Otmar Scherzer,et al.  KACZMARZ METHODS FOR REGULARIZING NONLINEAR ILL-POSED EQUATIONS I: CONVERGENCE ANALYSIS , 2007 .

[9]  B. Schorr,et al.  On an iterative method for a class of integral equations of the first kind , 1987 .

[10]  H. Malcolm Hudson,et al.  Accelerated image reconstruction using ordered subsets of projection data , 1994, IEEE Trans. Medical Imaging.

[11]  P. Eggermont,et al.  Maximum penalized likelihood estimation and smoothed em algorithms for positive integral equatioins of the first kind , 1996 .

[12]  L. Shepp,et al.  A Statistical Model for Positron Emission Tomography , 1985 .

[13]  R. Anderssen,et al.  Joint additive Kullback–Leibler residual minimization and regularization for linear inverse problems , 2007 .

[14]  J. M. M. Anderson,et al.  Positron emission tomography, Borel measures and weak convergence , 1996 .

[15]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[16]  Otmar Scherzer,et al.  On Steepest-Descent-Kaczmarz methods for regularizing systems of nonlinear ill-posed equations , 2008, Appl. Math. Comput..

[17]  Lihong V. Wang,et al.  Photoacoustic imaging in biomedicine , 2006 .

[18]  L. Lucy.  An iterative technique for the rectification of observed distributions , 1974 .

[19]  A. Kondor,et al.  Method of convergent weights — An iterative procedure for solving Fredholm's integral equations of the first kind , 1983 .

[20]  H. Engl,et al.  CORRIGENDUM: The expectation-maximization algorithm for ill-posed integral equations: a convergence analysis , 2007 .

[21]  Otmar Scherzer,et al.  A convergence analysis of iterative methods for the solution of nonlinear ill-posed problems under affinely invariant conditions , 1998 .

[22]  Otmar Scherzer,et al.  Convergence Analysis Of A Landweber—Kaczmarz Method For Solving Nonlinear Ill-Posed Problems , 2002 .

[23]  Barbara Kaltenbacher,et al.  Iterative Regularization Methods for Nonlinear Ill-Posed Problems , 2008, Radon Series on Computational and Applied Mathematics.

[24]  P. P. B. Eggermont,et al.  Nonlinear Smoothing and the EM Algorithm for Positive Integral Equations of the First Kind , 1999 .

[25]  H. N. Mülthei.  Iterative continuous maximum‐likelihood reconstruction method , 1992 .

[26]  Peter Kuchment,et al.  Mathematics of thermoacoustic tomography , 2007, European Journal of Applied Mathematics.

[27]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[28]  B. Schorr,et al.  On properties of the iterative maximum likelihood reconstruction method , 1989 .