Penalized PET Reconstruction Using Deep Learning Prior and Local Linear Fitting

Motivated by the great potential of deep learning in medical imaging, we propose an iterative positron emission tomography reconstruction framework using a deep learning-based prior. We utilized the denoising convolutional neural network (DnCNN) method and trained the network using full-dose images as the ground truth and low dose images reconstructed from downsampled data by Poisson thinning as input. Since most published deep networks are trained at a predetermined noise level, the noise level disparity of training and testing data is a major problem for their applicability as a generalized prior. In particular, the noise level significantly changes in each iteration, which can potentially degrade the overall performance of iterative reconstruction. Due to insufficient existing studies, we conducted simulations and evaluated the degradation of performance at various noise conditions. Our findings indicated that DnCNN produces additional bias induced by the disparity of noise levels. To address this issue, we propose a local linear fitting function incorporated with the DnCNN prior to improve the image quality by preventing unwanted bias. We demonstrate that the resultant method is robust against noise level disparities despite the network being trained at a predetermined noise level. By means of bias and standard deviation studies via both simulations and clinical experiments, we show that the proposed method outperforms conventional methods based on total variation and non-local means penalties. We thereby confirm that the proposed method improves the reconstruction result both quantitatively and qualitatively.

[1]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[2]  Jong Chul Ye,et al.  Sparse-View Spectral CT Reconstruction Using Spectral Patch-Based Low-Rank Penalty , 2015, IEEE Transactions on Medical Imaging.

[3]  Pingkun Yan,et al.  CT Image Denoising with Perceptive Deep Neural Networks , 2017, ArXiv.

[4]  Quanzheng Li,et al.  Iterative Low-Dose CT Reconstruction With Priors Trained by Artificial Neural Network , 2017, IEEE Transactions on Medical Imaging.

[5]  Dimitris Visvikis,et al.  Artificial intelligence, machine (deep) learning and radio(geno)mics: definitions and nuclear medicine imaging applications , 2019, European Journal of Nuclear Medicine and Molecular Imaging.

[6]  Jeong-Hee Kim,et al.  Serotonin transporter availability in thalamic subregions in schizophrenia: A study using 7.0-T MRI with [11C]DASB high-resolution PET , 2015, Psychiatry Research: Neuroimaging.

[7]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[10]  Jong Chul Ye,et al.  Fully 3D iterative scatter-corrected OSEM for HRRT PET using a GPU. , 2011, Physics in medicine and biology.

[11]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[12]  Quanzheng Li,et al.  A Cascaded Convolutional Nerual Network for X-ray Low-dose CT Image Denoising , 2017, ArXiv.

[13]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[14]  Jong Beom Ra,et al.  Ultra-Fast Hybrid CPU–GPU Multiple Scatter Simulation for 3-D PET , 2014, IEEE Journal of Biomedical and Health Informatics.

[15]  Quanzheng Li,et al.  Iterative PET Image Reconstruction Using Convolutional Neural Network Representation , 2017, IEEE Transactions on Medical Imaging.

[16]  D. Snyder,et al.  Corrections for accidental coincidences and attenuation in maximum-likelihood image reconstruction for positron-emission tomography. , 1991, IEEE transactions on medical imaging.

[17]  Guobao Wang,et al.  Penalized Likelihood PET Image Reconstruction Using Patch-Based Edge-Preserving Regularization , 2012, IEEE Transactions on Medical Imaging.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  L. Dixon,et al.  Automatic differentiation of algorithms , 2000 .

[20]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[21]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[22]  Richard Nock,et al.  Making Deep Neural Networks Robust to Label Noise: A Loss Correction Approach , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Jong Beom Ra,et al.  Dynamic PET reconstruction using temporal patch-based low rank penalty for ROI-based brain kinetic analysis , 2015, Physics in medicine and biology.

[24]  S. Hyun,et al.  Development of Predictive Models in Patients with Epiphora Using Lacrimal Scintigraphy and Machine Learning , 2019, Nuclear Medicine and Molecular Imaging.

[25]  Joan Bruna,et al.  Training Convolutional Networks with Noisy Labels , 2014, ICLR 2014.

[26]  Jens Gregor,et al.  DirectPET: full-size neural network PET reconstruction from sinogram data , 2020, Journal of medical imaging.

[27]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[28]  C. McCollough TU-FG-207A-04: Overview of the Low Dose CT Grand Challenge. , 2016, Medical physics.

[29]  John L. Humm,et al.  From PET detectors to PET scanners , 2003, European Journal of Nuclear Medicine and Molecular Imaging.

[30]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[31]  Julien Mairal,et al.  Optimization with First-Order Surrogate Functions , 2013, ICML.

[32]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[33]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[34]  Hakan Erdogan,et al.  Ordered subsets algorithms for transmission tomography. , 1999, Physics in medicine and biology.

[35]  Klaus Wienhard,et al.  The ECAT HRRT: performance and first clinical application of the new high resolution research tomograph , 2000 .