Rapid high-quality PET Patlak parametric image generation based on direct reconstruction and temporal nonlocal neural network

Parametric imaging based on dynamic positron emission tomography (PET) has wide applications in neurology. Compared to indirect methods, direct reconstruction methods, which reconstruct parametric images directly from the raw PET data, have superior image quality due to better noise modeling and richer information extracted from the PET raw data. For low-dose scenarios, the advantages of direct methods are more obvious. However, the wide adoption of direct reconstruction is inevitably impeded by the excessive computational demand and deficiency of the accessible raw data. In addition, motion modeling inside dynamic PET image reconstruction raises more computational challenges for direct reconstruction methods. In this work, we focused on the 18F-FDG Patlak model, and proposed a data-driven approach which can estimate the motion corrected full-dose direct Patlak images from the dynamic PET reconstruction series, based on a proposed novel temporal non-local convolutional neural network. During network training, direct reconstruction with motion correction based on full-dose dynamic PET sinograms was performed to obtain the training labels. The reconstructed full-dose /low-dose dynamic PET images were supplied as the network input. In addition, a temporal non-local block based on the dynamic PET images was proposed to better recover the structural information and reduce the image noise. During testing, the proposed network can directly output high-quality Patlak parametric images from the full-dose /low-dose dynamic PET images in seconds. Experiments based on 15 full-dose and 15 low-dose 18F-FDG brain datasets were conducted and analyzed to validate the feasibility of the proposed framework. Results show that the proposed framework can generate better image quality than reference methods.

[1]  Guobao Wang,et al.  Total-Body Dynamic Reconstruction and Parametric Imaging on the uEXPLORER , 2019, The Journal of Nuclear Medicine.

[2]  Ken D. Sauer,et al.  Direct reconstruction of kinetic parameter images from dynamic PET data , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[3]  J. Ouyang,et al.  Direct parametric reconstruction in dynamic PET myocardial perfusion imaging: in vivo studies , 2017, Physics in medicine and biology.

[4]  Kris Thielemans,et al.  A survey of approaches for direct parametric image reconstruction in emission tomography. , 2008, Medical physics.

[5]  Richard M. Leahy,et al.  Patlak Image Estimation From Dual Time-Point List-Mode PET Data , 2014, IEEE Transactions on Medical Imaging.

[6]  Jeih-San Liow,et al.  Linearized Reference Tissue Parametric Imaging Methods: Application to [11C]DASB Positron Emission Tomography Studies of the Serotonin Transporter in Human Brain , 2003, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[7]  Quanzheng Li,et al.  Iterative PET Image Reconstruction Using Convolutional Neural Network Representation , 2017, IEEE Transactions on Medical Imaging.

[8]  Kris Thielemans,et al.  Study of direct and indirect parametric estimation methods of linear models in dynamic positron emission tomography. , 2008, Medical physics.

[9]  Richard M. Leahy,et al.  Non-Local Means Denoising of Dynamic PET Images , 2013, PloS one.

[10]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[11]  Paul Kinahan,et al.  Attenuation correction for a combined 3D PET/CT scanner. , 1998, Medical physics.

[12]  Joanna M. Wardlaw,et al.  Tracer kinetic modelling for DCE-MRI quantification of subtle blood–brain barrier permeability , 2016, NeuroImage.

[13]  Guobao Wang,et al.  Generalized Algorithms for Direct Reconstruction of Parametric Images From Dynamic PET Data , 2009, IEEE Transactions on Medical Imaging.

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  Ciprian Catana,et al.  PET Image Reconstruction Using Deep Image Prior , 2019, IEEE Transactions on Medical Imaging.

[16]  Guobao Wang,et al.  Direct Estimation of Kinetic Parametric Images for Dynamic PET , 2013, Theranostics.

[17]  C S Patlak,et al.  Graphical Evaluation of Blood-to-Brain Transfer Constants from Multiple-Time Uptake Data , 1983, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[18]  Dinggang Shen,et al.  Deep auto-context convolutional neural networks for standard-dose PET image estimation from low-dose PET/MRI , 2017, Neurocomputing.

[19]  C. Tsoumpas,et al.  Convergence properties of algorithms for direct parametric estimation of linear models in dynamic PET , 2007, 2007 IEEE Nuclear Science Symposium Conference Record.

[20]  Guobao Wang,et al.  Acceleration of the direct reconstruction of linear parametric images using nested algorithms , 2010, Physics in medicine and biology.

[21]  Huafeng Liu,et al.  Clinically Translatable Direct Patlak Reconstruction from Dynamic PET with Motion Correction Using Convolutional Neural Network , 2020, MICCAI.

[22]  Richard E. Carson,et al.  Direct 4-D PET List Mode Parametric Reconstruction With a Novel EM Algorithm , 2012, IEEE Transactions on Medical Imaging.

[23]  Habib Zaidi,et al.  Whole-body direct 4D parametric PET imaging employing nested generalized Patlak expectation–maximization reconstruction , 2016, Physics in medicine and biology.

[24]  A. Rahmim,et al.  Direct 4D reconstruction of parametric images incorporating anato-functional joint entropy , 2010, 2008 IEEE Nuclear Science Symposium Conference Record.

[25]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[26]  Georgios I. Angelis,et al.  Direct reconstruction of parametric images using any spatiotemporal 4D image based model and maximum likelihood expectation maximisation , 2010, IEEE Nuclear Science Symposuim & Medical Imaging Conference.

[27]  Yun Zhou,et al.  Direct 4D parametric imaging for linearized models of reversibly binding PET tracers using generalized AB-EM reconstruction , 2012, Physics in medicine and biology.

[28]  Jieqing Jiao,et al.  Direct Parametric Reconstruction With Joint Motion Estimation/Correction for Dynamic Brain PET Data , 2017, IEEE Transactions on Medical Imaging.

[29]  Nassir Navab,et al.  Direct Parametric Image Reconstruction in Reduced Parameter Space for Rapid Multi-Tracer PET Imaging , 2015, IEEE Transactions on Medical Imaging.

[30]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[31]  Jiahe Tian,et al.  PET image denoising using unsupervised deep learning , 2019, European Journal of Nuclear Medicine and Molecular Imaging.

[32]  Jieqing Jiao,et al.  Direct Parametric Reconstruction With Joint Motion Estimation/Correction for Dynamic Brain PET Data , 2017, IEEE Trans. Medical Imaging.

[33]  Nassir Navab,et al.  Direct Parametric Reconstruction Using Anatomical Regularization for Simultaneous PET/MRI Data , 2015, IEEE Transactions on Medical Imaging.

[34]  Jean-Michel Morel,et al.  Non-Local Means Denoising , 2011, Image Process. Line.

[35]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[36]  Yunmei Chen,et al.  3D Tensor Based Nonlocal Low Rank Approximation in Dynamic PET Reconstruction , 2019, Sensors.

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Guobao Wang,et al.  Direct Patlak Reconstruction From Dynamic PET Data Using the Kernel Method With MRI Information Based on Structural Similarity , 2018, IEEE Transactions on Medical Imaging.

[39]  N. Volkow,et al.  Distribution Volume Ratios without Blood Sampling from Graphical Analysis of PET Data , 1996, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[40]  Junshen Xu,et al.  200x Low-dose PET Reconstruction using Deep Learning , 2017, ArXiv.

[41]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[42]  Steven R Meikle,et al.  Direct Estimation of Voxel-Wise Neurotransmitter Response Maps From Dynamic PET Data , 2019, IEEE Transactions on Medical Imaging.

[43]  Yang-Ming Zhu,et al.  Full-Dose PET Image Estimation from Low-Dose PET Image Using Deep Learning: a Pilot Study , 2018, Journal of Digital Imaging.

[44]  Huafeng Liu,et al.  Penalized-Likelihood PET Image Reconstruction Using 3D Structural Convolutional Sparse Coding , 2019, IEEE Transactions on Biomedical Engineering.

[45]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.