Distributed MLEM: An Iterative Tomographic Image Reconstruction Algorithm for Distributed Memory Architectures

The processing speed for positron emission tomography (PET) image reconstruction has been greatly improved in recent years by simply dividing the workload to multiple processors of a graphics processing unit (GPU). However, if this strategy is generalized to a multi-GPU cluster, the processing speed does not improve linearly with the number of GPUs. This is because large data transfer is required between the GPUs after each iteration, effectively reducing the parallelism. This paper proposes a novel approach to reformulate the maximum likelihood expectation maximization (MLEM) algorithm so that it can scale up to many GPU nodes with less frequent inter-node communication. While being mathematically different, the new algorithm maximizes the same convex likelihood function as MLEM, thus converges to the same solution. Experiments on a multi-GPU cluster demonstrate the effectiveness of the proposed approach.

[1]  A J Reader,et al.  Statistical list-mode image reconstruction for the high resolution research tomograph. , 2004, Physics in medicine and biology.

[2]  J. Karp,et al.  Performance of Philips Gemini TF PET/CT scanner with special consideration for its time-of-flight imaging capabilities. , 2007, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[3]  S. Wang,et al.  Decomposition Method with a Variable Parameter for a Class of Monotone Variational Inequality Problems , 2001 .

[4]  Guillem Pratx,et al.  Fully 3D list-mode time-of-flight PET image reconstruction on GPUs using CUDA. , 2011, Medical physics.

[5]  W. W. Moses,et al.  List-mode maximum-likelihood reconstruction applied to positron emission mammography (PEM) with irregular sampling , 2000, IEEE Transactions on Medical Imaging.

[6]  B. He,et al.  Alternating Direction Method with Self-Adaptive Penalty Parameters for Monotone Variational Inequalities , 2000 .

[7]  Carl Kesselman,et al.  Generalized communicators in the Message Passing Interface , 1996, Proceedings. Second MPI Developer's Conference.

[8]  E. Levitan,et al.  A Maximum a Posteriori Probability Expectation Maximization Algorithm for Image Reconstruction in Emission Tomography , 1987, IEEE Transactions on Medical Imaging.

[9]  M. Werner,et al.  Dynamic Load Balancing on Distributed Listmode Time-of-Flight Image Reconstruction , 2006, 2006 IEEE Nuclear Science Symposium Conference Record.

[10]  M Defrise,et al.  Non-Gaussian space-variant resolution modelling for list-mode reconstruction , 2010, Physics in medicine and biology.

[11]  Fang Xu,et al.  Accelerating popular tomographic reconstruction algorithms on commodity PC graphics hardware , 2005, IEEE Transactions on Nuclear Science.

[12]  M. Desco,et al.  GPU-Based Fast Iterative Reconstruction of Fully 3-D PET Sinograms , 2011, IEEE Transactions on Nuclear Science.

[13]  K Thielemans,et al.  Image-based point spread function implementation in a fully 3D OSEM reconstruction algorithm for PET , 2010, Physics in medicine and biology.

[14]  Craig S. Levin,et al.  Fast, Accurate and Shift-Varying Line Projections for Iterative Reconstruction Using the GPU , 2009, IEEE Transactions on Medical Imaging.

[15]  Guillem Pratx,et al.  Online detector response calculations for high-resolution PET image reconstruction , 2011, Physics in medicine and biology.

[16]  Robert M. Lewitt,et al.  Overview of methods for image reconstruction from projections in emission computed tomography , 2003, Proc. IEEE.

[17]  Jinyi Qi,et al.  Iterative image reconstruction for positron emission tomography based on a detector response function estimated from point source measurements , 2009, Physics in medicine and biology.

[18]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[19]  K. Erlandsson,et al.  Fast accurate iterative reconstruction for low-statistics positron volume imaging. , 1998, Physics in medicine and biology.

[20]  Á. R. De Pierro,et al.  Fast EM-like methods for maximum "a posteriori" estimates in emission tomography. , 2001, IEEE transactions on medical imaging.

[21]  Teresa Reginska,et al.  A Regularization Parameter in Discrete Ill-Posed Problems , 1996, SIAM J. Sci. Comput..

[22]  R. Rockafellar.  Monotone Operators and the Proximal Point Algorithm , 1976 .

[23]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[24]  G T Herman,et al.  Performance evaluation of an iterative image reconstruction algorithm for positron emission tomography. , 1991, IEEE transactions on medical imaging.

[25]  S. Matej,et al.  Iterative image reconstruction using geometrically ordered subsets with list-mode data , 2004, IEEE Symposium Conference Record Nuclear Science 2004..

[26]  Jong Chul Ye,et al.  Fully 3D iterative scatter-corrected OSEM for HRRT PET using a GPU. , 2011, Physics in medicine and biology.

[27]  H. Barrett,et al.  List-mode likelihood: EM algorithm and image quality estimation demonstrated on 2-D PET , 1998, IEEE Transactions on Medical Imaging.

[28]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[29]  Nadim Joni Shah,et al.  Fully-3D PET Image Reconstruction Using Scanner-Independent, Adaptive Projection Data and Highly Rotation-Symmetric Voxel Assemblies , 2011, IEEE Transactions on Medical Imaging.

[30]  David P. Rodgers,et al.  Improvements in multiprocessor system design , 1985, ISCA '85.

[31]  Craig S. Levin,et al.  Algorithms that exploit multi-interaction photon events in sub-millimeter resolution CZT detectors for PET , 2011, 2011 IEEE Nuclear Science Symposium Conference Record.

[32]  Jack Dongarra,et al.  MPI: The Complete Reference , 1996 .

[33]  Joel S. Karp,et al.  Efficient 3-D TOF PET Reconstruction Using View-Grouped Histo-Images: DIRECT—Direct Image Reconstruction for TOF , 2009, IEEE Transactions on Medical Imaging.

[34]  G. Pratx,et al.  GRAY: High Energy Photon Ray Tracer for PET Applications , 2006, 2006 IEEE Nuclear Science Symposium Conference Record.

[35]  Truong Q. Nguyen,et al.  A method for choosing the regularization parameter in generalized Tikhonov regularized linear inverse problems , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[36]  Simon R. Cherry,et al.  Fully 3D Bayesian image reconstruction for the ECAT EXACT HR , 1997 .

[37]  Andrew J. Reader,et al.  EM algorithm system modeling by image-space techniques for PET reconstruction , 2003 .

[38]  Jinyi Qi,et al.  Fast iterative image reconstruction using sparse matrix factorization with GPU acceleration , 2011, Medical Imaging.

[39]  H. Malcolm Hudson,et al.  Accelerated image reconstruction using ordered subsets of projection data , 1994, IEEE Trans. Medical Imaging.