Conjugate-gradient preconditioning methods for shift-variant PET image reconstruction

Gradient-based iterative methods often converge slowly for tomographic image reconstruction and image restoration problems, but can be accelerated by suitable preconditioners. Diagonal preconditioners offer some improvement in convergence rate, but do not incorporate the structure of the Hessian matrices in imaging problems. Circulant preconditioners can provide remarkable acceleration for inverse problems that are approximately shift-invariant, i.e., for those with approximately block-Toeplitz or block-circulant Hessians. However, in applications with nonuniform noise variance, such as arises from Poisson statistics in emission tomography and in quantum-limited optical imaging, the Hessian of the weighted least-squares objective function is quite shift-variant, and circulant preconditioners perform poorly. Additional shift-variance is caused by edge-preserving regularization methods based on nonquadratic penalty functions. This paper describes new preconditioners that approximate more accurately the Hessian matrices of shift-variant imaging problems. Compared to diagonal or circulant preconditioning, the new preconditioners lead to significantly faster convergence rates for the unconstrained conjugate-gradient (CG) iteration. We also propose a new efficient method for the line-search step required by CG methods. Applications to positron emission tomography (PET) illustrate the method.

[1]  A. Formiconi,et al.  Compensation of spatial system response in SPECT with conjugate gradient reconstruction technique. , 1989, Physics in medicine and biology.

[2]  E U Mumcuoğlu,et al.  Bayesian reconstruction of PET images: methodology and performance analysis. , 1996, Physics in medicine and biology.

[3]  Raymond H. Chan,et al.  Cosine transform based preconditioners for total variation minimization problems in image processing , 1995 .

[4]  T. Chan An Optimal Circulant Preconditioner for Toeplitz Systems , 1988 .

[5]  Raymond H. Chan,et al.  Conjugate Gradient Methods for Toeplitz Systems , 1996, SIAM Rev..

[6]  Raymond H. Chan,et al.  Best-conditioned circulant preconditioners , 1995 .

[7]  Jeffrey A. Fessler,et al.  New Statistical Models for Randoms-Precorrected PET Scans , 1997, IPMI.

[8]  Raymond H. Chan,et al.  SINE TRANSFORM BASED PRECONDITIONERS FOR SYMMETRIC TOEPLITZ SYSTEMS , 1996 .

[9]  J. Fessler Conjugate-Gradient Preconditioning Methods : Numerical Results , 1997 .

[10]  Tinsu Pan,et al.  Preconditioning methods for improved convergence rates in iterative reconstructions , 1993, IEEE Trans. Medical Imaging.

[11]  Linda Kaufman,et al.  Implementing and Accelerating the EM Algorithm for Positron Emission Tomography , 1987, IEEE Transactions on Medical Imaging.

[12]  Jeffrey A. Fessler,et al.  Ieee Transactions on Image Processing: to Appear Hybrid Poisson/polynomial Objective Functions for Tomographic Image Reconstruction from Transmission Scans , 2022 .

[13]  Michel Barlaud,et al.  Two deterministic half-quadratic regularization algorithms for computed imaging , 1994, Proceedings of 1st International Conference on Image Processing.

[14]  E.U. Mumcuoglu,et al.  A gradient projection conjugate gradient algorithm for Bayesian PET reconstruction , 1994, Proceedings of 1994 IEEE Nuclear Science Symposium - NSS'94.

[15]  Jeffrey A. Fessler Mean and variance of implicitly defined biased estimators (such as penalized maximum likelihood): applications to tomography , 1996, IEEE Trans. Image Process..

[16]  Jeffrey A. Fessler,et al.  Spatial resolution properties of penalized-likelihood image reconstruction: space-invariant tomographs , 1996, IEEE Trans. Image Process..

[17]  Gerardo Toraldo,et al.  On the Solution of Large Quadratic Programming Problems with Bound Constraints , 1991, SIAM J. Optim..

[18]  O. Axelsson Iterative solution methods , 1995 .

[19]  Jeffrey A. Fessler,et al.  Combined diagonal/Fourier preconditioning methods for image reconstruction in emission tomography , 1995, Proceedings., International Conference on Image Processing.

[20]  Alvaro R. De Pierro,et al.  A modified expectation maximization algorithm for penalized likelihood estimation in emission tomography , 1995, IEEE Trans. Medical Imaging.

[21]  J. Nagy,et al.  FFT-based preconditioners for Toeplitz-block least squares problems , 1993 .

[22]  Jeffrey A. Fessler Preconditioning methods for shift-variant image reconstruction , 1997, Proceedings of International Conference on Image Processing.

[23]  D S Lalush,et al.  A fast and stable maximum a posteriori conjugate gradient reconstruction algorithm. , 1995, Medical physics.

[24]  Robert M. Lewitt,et al.  Fourier correction for spatially variant collimator blurring in SPECT , 1995, IEEE Trans. Medical Imaging.

[25]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Curtis R. Vogel,et al.  Fast numerical methods for total variation minimization in image reconstruction , 1995, Optics & Photonics.

[27]  Simon R. Cherry,et al.  Fast gradient-based methods for Bayesian reconstruction of transmission and emission PET images , 1994, IEEE Trans. Medical Imaging.

[28]  Jeffrey A. Fessler,et al.  Grouped-coordinate ascent algorithms for penalized-likelihood transmission image reconstruction , 1997, IEEE Transactions on Medical Imaging.

[29]  R. White,et al.  Image recovery from data acquired with a charge-coupled-device camera. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[30]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[31]  K. Lange Convergence of EM image reconstruction algorithms with Gibbs smoothing. , 1990, IEEE transactions on medical imaging.

[32]  Yoram Bresler,et al.  A fast and accurate Fourier algorithm for iterative parallel-beam tomography , 1996, IEEE Trans. Image Process..

[33]  Linda Kaufman,et al.  Maximum likelihood, least squares, and penalized least squares for PET , 1993, IEEE Trans. Medical Imaging.

[34]  Mehiddin Al-Baali,et al.  On the Order of Convergence of Preconditioned Nonlinear Conjugate Gradient Methods , 1996, SIAM J. Sci. Comput..

[35]  O. Nalcioglu,et al.  Constrained Iterative Reconstruction by the Conjugate Gradient Method , 1985, IEEE Transactions on Medical Imaging.

[36]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[37]  P. Green Iteratively reweighted least squares for maximum likelihood estimation , 1984 .

[38]  Gabor T. Herman,et al.  Quadratic optimization for image reconstruction, II , 1976 .

[39]  M. Bierlaire,et al.  On iterative algorithms for linear least squares problems with bound constraints , 1991 .

[40]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[41]  D. Lalush,et al.  The importance of preconditioners in fast Poisson-based iterative reconstruction algorithms for SPECT , 1995, 1995 IEEE Nuclear Science Symposium and Medical Imaging Conference Record.

[42]  J.A. Fessler,et al.  Fully 3D PET image reconstruction using a Fourier preconditioned conjugate-gradient algorithm , 1996, 1996 IEEE Nuclear Science Symposium. Conference Record.

[43]  Jeffrey A. Fessler Penalized weighted least-squares image reconstruction for positron emission tomography , 1994, IEEE Trans. Medical Imaging.

[44]  Simon R. Cherry,et al.  A phantom study of the quantitative behavior of Bayesian PET reconstruction methods , 1995, 1995 IEEE Nuclear Science Symposium and Medical Imaging Conference Record.

[45]  Ken D. Sauer,et al.  A local update strategy for iterative reconstruction from projections , 1993, IEEE Trans. Signal Process..

[46]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[47]  Raymond H. Chan,et al.  Generalization of Strang's Preconditioner with Applications to Toeplitz Least Squares Problems , 1996, Numer. Linear Algebra Appl..

[48]  Alfred O. Hero,et al.  Recursive algorithms for computing the Cramer-Rao bound , 1997, IEEE Trans. Signal Process..

[49]  James G. Nagy,et al.  Iterative image restoration using approximate inverse preconditioning , 1996, IEEE Trans. Image Process..

[50]  C. Helstrom,et al.  Compensation for readout noise in CCD images , 1995 .

[51]  Jeffrey A. Fessler,et al.  Grouped coordinate descent algorithms for robust edge-preserving image restoration , 1997, Optics & Photonics.

[52]  Dianne P. O'Leary,et al.  Restoring Images Degraded by Spatially Variant Blur , 1998, SIAM J. Sci. Comput..