A unified approach to statistical tomography using coordinate descent optimization

Over the past years there has been considerable interest in statistically optimal reconstruction of cross-sectional images from tomographic data. In particular, a variety of such algorithms have been proposed for maximum a posteriori (MAP) reconstruction from emission tomographic data. While MAP estimation requires the solution of an optimization problem, most existing reconstruction algorithms take an indirect approach based on the expectation maximization (EM) algorithm. We propose a new approach to statistically optimal image reconstruction based on direct optimization of the MAP criterion. The key to this direct optimization approach is greedy pixel-wise computations known as iterative coordinate decent (ICD). We propose a novel method for computing the ICD updates, which we call ICD/Newton-Raphson. We show that ICD/Newton-Raphson requires approximately the same amount of computation per iteration as EM-based approaches, but the new method converges much more rapidly (in our experiments, typically five to ten iterations). Other advantages of the ICD/Newton-Raphson method are that it is easily applied to MAP estimation of transmission tomograms, and typical convex constraints, such as positivity, are easily incorporated.

[1]  Louis A. Hageman,et al.  Iterative Solution of Large Linear Systems. , 1971 .

[2]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[3]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[4]  K. Lange,et al.  EM reconstruction algorithms for emission and transmission tomography. , 1984, Journal of computer assisted tomography.

[5]  Michael I. Miller,et al.  The Use of Sieves to Stabilize Images Produced with the EM Algorithm for Emission Tomography , 1985, IEEE Transactions on Nuclear Science.

[6]  L. Shepp,et al.  A Statistical Model for Positron Emission Tomography , 1985 .

[7]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[8]  E. Veklerov,et al.  Stopping Rule for the MLE Algorithm Based on Statistical Hypothesis Testing , 1987, IEEE Transactions on Medical Imaging.

[9]  H. Hart,et al.  Bayesian Image Processing in Two Dimensions , 1987, IEEE Transactions on Medical Imaging.

[10]  Linda Kaufman,et al.  Implementing and Accelerating the EM Algorithm for Positron Emission Tomography , 1987, IEEE Transactions on Medical Imaging.

[11]  K. Lange,et al.  A Theoretical Study of Some Maximum Likelihood Algorithms for Emission and Transmission Tomography , 1987, IEEE Transactions on Medical Imaging.

[12]  Z. Liang,et al.  Bayesian image processing of data from constrained source distributions—II. valued, uncorrelated and correlated constraints , 1987 .

[13]  Z. Liang,et al.  Bayesian image processing of data from constrained source distributions—I. non-valued, uncorrelated and correlated constraints , 1987 .

[14]  Richard M. Leahy,et al.  Fast MLE for SPECT using an intermediate polar representation and a stopping criterion , 1988 .

[15]  M. Gilardi,et al.  Physical performance of the latest generation of commercial positron scanner , 1988 .

[16]  H. Stark,et al.  Tomographic image reconstruction using the theory of convex projections. , 1988, IEEE transactions on medical imaging.

[17]  W. Moses,et al.  Orbiting transmission source for positron tomography , 1988 .

[18]  T. Hebert,et al.  A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors. , 1989, IEEE transactions on medical imaging.

[19]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[20]  P. Green Bayesian reconstructions from emission tomography data using a modified EM algorithm. , 1990, IEEE transactions on medical imaging.

[21]  K. Lange Convergence of EM image reconstruction algorithms with Gibbs smoothing. , 1990, IEEE transactions on medical imaging.

[22]  G T Herman,et al.  Performance evaluation of an iterative image reconstruction algorithm for positron emission tomography. , 1991, IEEE transactions on medical imaging.

[23]  J. Fessler,et al.  Joint maximum likelihood estimation of emission and attenuation densities in PET , 1991, Conference Record of the 1991 IEEE Nuclear Science Symposium and Medical Imaging Conference.

[24]  Andrew E. Yagle,et al.  Acceleration and filtering in the generalized Landweber iteration using a variable shaping matrix , 1991, Conference Record of the 1991 IEEE Nuclear Science Symposium and Medical Imaging Conference.

[25]  D. Snyder,et al.  Corrections for accidental coincidences and attenuation in maximum-likelihood image reconstruction for positron-emission tomography. , 1991, IEEE transactions on medical imaging.

[26]  D. M. Goodman,et al.  Applying Conjugate Gradients To Image Processing Problems , 1991, Proceedings of the Seventh Workshop on Multidimensional Signal Processing.

[27]  Alvaro R. De Pierro,et al.  On methods for maximum a posteriori image reconstruction with a normal prior , 1992, J. Vis. Commun. Image Represent..

[28]  Ken D. Sauer,et al.  Bayesian estimation of transmission tomograms using segmentation based optimization , 1992 .

[29]  Harrison H. Barrett,et al.  Evaluation of statistical methods of image reconstruction through ROC analysis [emission tomography] , 1992, IEEE Trans. Medical Imaging.

[30]  Thomas J. Hebert,et al.  The GEM MAP algorithm with 3-D SPECT system response , 1992, IEEE Trans. Medical Imaging.

[31]  Ken D. Sauer,et al.  A local update strategy for iterative reconstruction from projections , 1993, IEEE Trans. Signal Process..

[32]  Tinsu Pan,et al.  Preconditioning methods for improved convergence rates in iterative reconstructions , 1993, IEEE Trans. Medical Imaging.

[33]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[34]  Alfred O. Hero,et al.  Complete-data spaces and generalized EM algorithms , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  Simon R. Cherry,et al.  Fast gradient-based methods for Bayesian reconstruction of transmission and emission PET images , 1994, IEEE Trans. Medical Imaging.

[36]  Ken D. Sauer,et al.  Maximum likelihood scale estimation for a class of Markov random fields , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[37]  Jeffrey A. Fessler Penalized weighted least-squares image reconstruction for positron emission tomography , 1994, IEEE Trans. Medical Imaging.

[38]  Edward J. Delp,et al.  Discontinuity preserving regularization of inverse visual problems , 1994, IEEE Trans. Syst. Man Cybern..

[39]  John M. Ollinger,et al.  Maximum-likelihood reconstruction of transmission images in emission computed tomography via the EM algorithm , 1994, IEEE Trans. Medical Imaging.

[40]  Jeffrey A. Fessler,et al.  Ieee Transactions on Image Processing: to Appear Globally Convergent Algorithms for Maximum a Posteriori Transmission Tomography , 2022 .

[41]  Jeffrey A. Fessler,et al.  Ieee Transactions on Image Processing: to Appear Hybrid Poisson/polynomial Objective Functions for Tomographic Image Reconstruction from Transmission Scans , 2022 .

[42]  Ken D. Sauer,et al.  Parallel computation of sequential pixel updates in statistical tomographic reconstruction , 1995, Proceedings., International Conference on Image Processing.

[43]  Alvaro R. De Pierro,et al.  A modified expectation maximization algorithm for penalized likelihood estimation in emission tomography , 1995, IEEE Trans. Medical Imaging.

[44]  Ken D. Sauer,et al.  Provably convergent coordinate descent in statistical tomographic reconstruction , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[45]  Ken D. Sauer,et al.  Efficient ML estimation of the shape parameter for generalized Gaussian MRFs , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[46]  A. Hero,et al.  SPACE-ALTERNATING GENERALIZED EM ALGORITHMS FOR PENALIZED MAXIMUM-LIKELIHOOD IMAGE RECONSTRUCTION , 1997 .

[47]  Ken D. Sauer,et al.  ML parameter estimation for Markov random fields with applications to Bayesian tomography , 1998, IEEE Trans. Image Process..