Improved Low-Count Quantitative PET Reconstruction With an Iterative Neural Network

Image reconstruction in low-count PET is particularly challenging because gammas from natural radioactivity in Lu-based crystals cause high random fractions that lower the measurement signal-to-noise-ratio (SNR). In model-based image reconstruction (MBIR), using more iterations of an unregularized method may increase the noise, so incorporating regularization into the image reconstruction is desirable to control the noise. New regularization methods based on learned convolutional operators are emerging in MBIR. We modify the architecture of an iterative neural network, BCD-Net, for PET MBIR, and demonstrate the efficacy of the trained BCD-Net using XCAT phantom data that simulates the low true coincidence count-rates with high random fractions typical for Y-90 PET patient imaging after Y-90 microsphere radioembolization. Numerical results show that the proposed BCD-Net significantly improves CNR and RMSE of the reconstructed images compared to MBIR methods using non-trained regularizers, total variation (TV) and non-local means (NLM). Moreover, BCD-Net successfully generalizes to test data that differs from the training data. Improvements were also demonstrated for the clinically relevant phantom measurement data where we used training and testing datasets having very different activity distributions and count-levels.

[1]  Il Yong Chun,et al.  Momentum-Net for Low-Dose CT Image Reconstruction , 2020, ArXiv.

[2]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[3]  Jeffrey A. Fessler,et al.  Momentum-Net: Fast and Convergent Iterative Neural Network for Inverse Problems , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Morteza Mardani,et al.  Deep Generative Adversarial Neural Networks for Compressive Sensing MRI , 2019, IEEE Transactions on Medical Imaging.

[5]  Jeffrey A. Fessler,et al.  Application of trained Deep BCD-Net to iterative low-count PET image reconstruction , 2018, 2018 IEEE Nuclear Science Symposium and Medical Imaging Conference Proceedings (NSS/MIC).

[6]  Junshen Xu,et al.  200x Low-dose PET Reconstruction using Deep Learning , 2017, ArXiv.

[7]  Jong Hoon Kim,et al.  Penalized PET Reconstruction Using Deep Learning Prior and Local Linear Fitting , 2018, IEEE Transactions on Medical Imaging.

[8]  Yoram Bresler,et al.  Learning sparsifying filter banks , 2015, SPIE Optical Engineering + Applications.

[9]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[10]  Jeffrey A. Fessler,et al.  Deep BCD-Net Using Identical Encoding-Decoding CNN Structures for Iterative Image Recovery , 2018, 2018 IEEE 13th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP).

[11]  Jeffrey A. Fessler,et al.  Fast and convergent iterative image recovery using trained convolutional neural networks , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[12]  William H. Press,et al.  Numerical recipes in C , 2002 .

[13]  Michael Unser,et al.  CNN-Based Projected Gradient Descent for Consistent CT Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[14]  Alexander S. Pasciak,et al.  Radioembolization and the Dynamic Role of 90Y PET/CT , 2014, Front. Oncol..

[15]  Louis B. Rall,et al.  Automatic differentiation , 1981 .

[16]  Il Yong Chun,et al.  Image-Domain Material Decomposition Using an Iterative Neural Network for Dual-Energy CT , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[17]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[18]  Jeffrey A. Fessler,et al.  Alternating Direction Method of Multiplier for Tomography With Nonlocal Regularizers , 2014, IEEE Transactions on Medical Imaging.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Á. R. De Pierro,et al.  A modified expectation maximization algorithm for penalized likelihood estimation in emission tomography. , 1995, IEEE transactions on medical imaging.

[21]  Quanzheng Li,et al.  Iterative PET Image Reconstruction Using Convolutional Neural Network Representation , 2017, IEEE Transactions on Medical Imaging.

[22]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[23]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[24]  Jian-Feng Cai,et al.  Data-driven tight frame construction and image denoising , 2014 .

[25]  Maurizio Conti,et al.  (90)Y -PET imaging: Exploring limitations and accuracy under conditions of low counts and high random fraction. , 2015, Medical physics.

[26]  Max A. Viergever,et al.  Quantitative Monte Carlo–Based 90Y SPECT Reconstruction , 2013, The Journal of Nuclear Medicine.

[27]  Xiao Jin,et al.  Quantitative comparison of OSEM and penalized likelihood image reconstruction using relative difference penalties for clinical PET , 2015, Physics in medicine and biology.

[28]  Antonin Chambolle,et al.  An introduction to continuous optimization for imaging , 2016, Acta Numerica.

[29]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[30]  Jong Chul Ye,et al.  Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems , 2017, SIAM J. Imaging Sci..

[31]  Jeffrey A. Fessler,et al.  Convolutional analysis operator learning: Application to sparse-view CT : (Invited Paper) , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[32]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Emil Y. Sidky,et al.  Optimization-Based Image Reconstruction From Low-Count, List-Mode TOF-PET Data , 2018, IEEE Transactions on Biomedical Engineering.

[34]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[35]  Pascal Vincent,et al.  fastMRI: An Open Dataset and Benchmarks for Accelerated MRI , 2018, ArXiv.

[36]  Thomas J. Fuchs,et al.  DeepPET: A deep encoder–decoder network for directly solving the PET image reconstruction inverse problem , 2018, Medical Image Anal..

[37]  Jeffrey A. Fessler,et al.  BCD-Net for Low-dose CT Reconstruction: Acceleration, Convergence, and Generalization , 2019, MICCAI.

[38]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[39]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[40]  J. Nuyts,et al.  A concave prior penalizing relative differences for maximum-a-posteriori reconstruction in emission tomography , 2000 .

[41]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[42]  Jeffrey A. Fessler,et al.  Convolutional Analysis Operator Learning: Acceleration and Convergence , 2018, IEEE Transactions on Image Processing.

[43]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[44]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[45]  Jeffrey A. Fessler,et al.  Convolutional Analysis Operator Learning: Dependence on Training Data , 2019, IEEE Signal Processing Letters.

[46]  Il Yong Chun,et al.  Incorporating Handcrafted Filters in Convolutional Analysis Operator Learning for Ill-Posed Inverse Problems , 2019, 2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[47]  Hongki Lim,et al.  A PET reconstruction formulation that enforces non-negativity in projection space for bias reduction in Y-90 imaging. , 2018, Physics in medicine and biology.

[48]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[49]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[50]  Leslie Ying,et al.  Artificial Neural Network Enhanced Bayesian PET Image Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[51]  W. Segars,et al.  4D XCAT phantom for multimodality imaging research. , 2010, Medical physics.