Ieee Transactions on Image Processing: to Appear Penalized Maximum-likelihood Image Reconstruction Using Space-alternating Generalized Em Algorithms

Most expectation-maximization (EM) type algorithms for penalized maximum-likelihood image reconstruction converge slowly, particularly when one incorporates additive background effects such as scatter, random coincidences, dark current, or cosmic radiation. In addition, regularizing smoothness penalties (or priors) introduce parameter coupling, rendering intractable the M-steps of most EM-type algorithms. This paper presents space-alternating generalized EM (SAGE) algorithms for image reconstruction, which update the parameters sequentially using a sequence of small "hidden" data spaces, rather than simultaneously using one large complete-data space. The sequential update decouples the M-step, so the maximization can typically be performed analytically. We introduce new hidden-data spaces that are less informative than the conventional complete-data space for Poisson data and that yield significant improvements in convergence rate. This acceleration is due to statistical considerations, not numerical overrelaxation methods, so monotonic increases in the objective function are guaranteed. We provide a general global convergence proof for SAGE methods with nonnegativity constraints.

[1]  Jeffrey A. Fessler.  Hidden-data spaces for maximum-likelihood PET reconstruction , 1992, IEEE Conference on Nuclear Science Symposium and Medical Imaging.

[2]  Stuart Geman,et al.  Statistical methods for tomographic image reconstruction , 1987 .

[3]  Jeffrey A. Fessler.  Penalized weighted least-squares image reconstruction for positron emission tomography , 1994, IEEE Trans. Medical Imaging.

[4]  Alfred O. Hero,et al.  Complete-data spaces and generalized EM algorithms , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  K. Lange,et al.  A Theoretical Study of Some Maximum Likelihood Algorithms for Emission and Transmission Tomography , 1987, IEEE Transactions on Medical Imaging.

[6]  L. J. Thomas,et al.  Noise and Edge Artifacts in Maximum-Likelihood Reconstructions for Emission Tomography , 1987, IEEE Transactions on Medical Imaging.

[7]  Ken D. Sauer,et al.  A local update strategy for iterative reconstruction from projections , 1993, IEEE Trans. Signal Process..

[8]  M I Miller,et al.  Bayesian image reconstruction for emission tomography incorporating Good's roughness prior on massively parallel processors. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Alfred O. Hero,et al.  Space-alternating generalized expectation-maximization algorithm , 1994, IEEE Trans. Signal Process..

[10]  A. Hero,et al.  New complete-data spaces and faster algorithms for penalized-likelihood emission tomography , 1993, 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference.

[11]  Jeffrey A. Fessler,et al.  On complete-data spaces for PET reconstruction algorithms , 1993 .

[12]  H. Malcolm Hudson,et al.  Accelerated image reconstruction using ordered subsets of projection data , 1994, IEEE Trans. Medical Imaging.

[13]  A. Hero,et al.  Asymptotic Convergence Properties of EM-Type Algorithms , 1993 .

[14]  Xiao-Li Meng,et al.  Maximum likelihood estimation via the ECM algorithm: A general framework , 1993 .

[15]  S. Joshi,et al.  Maximum a posteriori estimation with Good's roughness for three-dimensional optical-sectioning microscopy. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[16]  A. R. De Pierro,et al.  On the relation between the ISRA and the EM algorithm for positron emission tomography , 1993, IEEE Trans. Medical Imaging.

[17]  A. Hero,et al.  A recursive algorithm for computing Cramer-Rao- type bounds on estimator covariance , 1994, IEEE Trans. Inf. Theory.

[18]  A. Hero,et al.  SPACE-ALTERNATING GENERALIZED EM ALGORITHMS FOR PENALIZED MAXIMUM-LIKELIHOOD IMAGE RECONSTRUCTION , 1997 .

[19]  Brian D. Ripley,et al.  Deconvolution in Optical Astronomy. A Bayesian Approach , 1992 .

[20]  K. Lange.  Convergence of EM image reconstruction algorithms with Gibbs smoothing. , 1990, IEEE transactions on medical imaging.

[21]  Jeffrey A. Fessler,et al.  Convergence in Norm for Alternating Expectation-Maximization (EM) Type Algorithms , 1995 .

[22]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[23]  P. Green.  Bayesian reconstructions from emission tomography data using a modified EM algorithm. , 1990, IEEE transactions on medical imaging.

[24]  Aaron D. Lanterman,et al.  Regularizing images in emission tomography via an extension of Good's roughness penalty , 1992, IEEE Conference on Nuclear Science Symposium and Medical Imaging.

[25]  T. Hebert,et al.  A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors. , 1989, IEEE transactions on medical imaging.

[26]  R.E. Carson,et al.  Scatter correction in maximum-likelihood reconstruction of PET data , 1992, IEEE Conference on Nuclear Science Symposium and Medical Imaging.

[27]  R. Jaszczak,et al.  On Bayesian image reconstruction from projections: uniform and nonuniform a priori source information. , 1989, IEEE transactions on medical imaging.

[28]  Alvaro R. De Pierro,et al.  A modified expectation maximization algorithm for penalized likelihood estimation in emission tomography , 1995, IEEE Trans. Medical Imaging.

[29]  Simon R. Cherry,et al.  Fast gradient-based methods for Bayesian reconstruction of transmission and emission PET images , 1994, IEEE Trans. Medical Imaging.

[30]  Thomas M. Cover,et al.  An algorithm for maximizing expected log investment return , 1984, IEEE Trans. Inf. Theory.

[31]  M I Miller,et al.  Maximum likelihood SPECT in clinical computation times using mesh-connected parallel computers. , 1991, IEEE transactions on medical imaging.

[32]  D. Snyder,et al.  Corrections for accidental coincidences and attenuation in maximum-likelihood image reconstruction for positron-emission tomography. , 1991, IEEE transactions on medical imaging.

[33]  E. Veklerov,et al.  Stopping Rule for the MLE Algorithm Based on Statistical Hypothesis Testing , 1987, IEEE Transactions on Medical Imaging.

[34]  E. Levitan,et al.  A Maximum a Posteriori Probability Expectation Maximization Algorithm for Image Reconstruction in Emission Tomography , 1987, IEEE Transactions on Medical Imaging.

[35]  Ken D. Sauer,et al.  A unified approach to statistical tomography using coordinate descent optimization , 1996, IEEE Trans. Image Process..

[36]  R. White,et al.  Image recovery from data acquired with a charge-coupled-device camera. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[37]  J. D. Wilson,et al.  A smoothed EM approach to indirect estimation problems, with particular reference to stereology and emission tomography , 1990 .

[38]  Jim Kay,et al.  Edge Preserving Image Restoration , 1992 .

[39]  G T Herman,et al.  Performance evaluation of an iterative image reconstruction algorithm for positron emission tomography. , 1991, IEEE transactions on medical imaging.

[40]  Michael I. Miller,et al.  Maximum a posteriori estimation for SPECT using regularization techniques on massively-parallel computers , 1991, Conference Record of the 1991 IEEE Nuclear Science Symposium and Medical Imaging Conference.

[41]  K. Lange,et al.  EM reconstruction algorithms for emission and transmission tomography. , 1984, Journal of computer assisted tomography.

[42]  Linda Kaufman,et al.  Implementing and Accelerating the EM Algorithm for Positron Emission Tomography , 1987, IEEE Transactions on Medical Imaging.

[43]  D. Rubin,et al.  The ECME algorithm: A simple extension of EM and ECM with faster monotone convergence , 1994 .

[44]  M. Rosenlicht.  Introduction to Analysis , 1970 .