Dynamic PET Image Reconstruction Using Nonnegative Matrix Factorization Incorporated With Deep Image Prior

We propose a method that reconstructs dynamic positron emission tomography (PET) images from given sinograms by using non-negative matrix factorization (NMF) incorporated with a deep image prior (DIP) for appropriately constraining the spatial patterns of resultant images. The proposed method can reconstruct dynamic PET images with higher signal-to-noise ratio (SNR) and blindly decompose an image matrix into pairs of spatial and temporal factors. The former represent homogeneous tissues with different kinetic parameters and the latter represent the time activity curves that are observed in the corresponding homogeneous tissues. We employ U-Nets combined in parallel for DIP and each of the U-nets is used to extract each spatial factor decomposed from the data matrix. Experimental results show that the proposed method outperforms conventional methods and can extract spatial factors that represent the homogeneous tissues.

[1]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Christine Guillemot,et al.  Image Inpainting : Overview and Recent Advances , 2014, IEEE Signal Processing Magazine.

[4]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[5]  Habib Zaidi,et al.  Four-dimensional (4D) image reconstruction strategies in dynamic PET: beyond conventional independent frame reconstruction. , 2009, Medical physics.

[6]  A. Lammertsma,et al.  Simplified Reference Tissue Model for PET Receptor Studies , 1996, NeuroImage.

[7]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[8]  Jérôme Idier,et al.  Algorithms for Nonnegative Matrix Factorization with the β-Divergence , 2010, Neural Computation.

[9]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[10]  Hidekata Hontani,et al.  Simultaneous PET Image Reconstruction and Feature Extraction Method using Non-negative, Smooth, and Sparse Matrix Factorization , 2018, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[11]  D J Brooks,et al.  Comparison of Methods for Analysis of Clinical [11C]Raclopride Studies , 1996, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[12]  Ken D. Sauer,et al.  Direct reconstruction of kinetic parameter images from dynamic PET data , 2005, IEEE Transactions on Medical Imaging.

[13]  Sara Garbarino,et al.  A new compartmental method for the analysis of liver FDG kinetics in small animal models , 2015, EJNMMI Research.

[14]  F. Natterer.  The Mathematics of Computerized Tomography , 1986 .

[15]  Evangelos Papoutsellis,et al.  Infimal convolution spatiotemporal PET reconstruction using total variation based priors , 2018 .

[16]  Huafeng Liu,et al.  Low Dose PET Image Reconstruction with Total Variation Using Alternating Direction Method , 2016, PloS one.

[17]  D. Shen,et al.  LRTV: MR Image Super-Resolution With Low-Rank and Total Variation Regularizations , 2015, IEEE Transactions on Medical Imaging.

[18]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[19]  Ciprian Catana,et al.  PET Image Reconstruction Using Deep Image Prior , 2019, IEEE Transactions on Medical Imaging.

[20]  Hidekata Hontani,et al.  A robust PET image reconstruction using constrained non-negative matrix factorization , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[21]  J. Logan.  Graphical analysis of PET data applied to reversible and irreversible tracers. , 1999, Nuclear medicine and biology.

[22]  Robert Y. L. Chu,et al.  Radiological Imaging: The Theory of Image Formation, Detection, and Processing. Volume 2 by H. H. Barrett and W. Swindell , 1983 .

[23]  K. Lange,et al.  A Theoretical Study of Some Maximum Likelihood Algorithms for Emission and Transmission Tomography , 1987, IEEE Transactions on Medical Imaging.

[24]  Giacomo Caviglia,et al.  A physiology-based parametric imaging method for FDG–PET data , 2017, 1702.06067.

[25]  Bernd Weissmuller,et al.  Radiological Imaging The Theory Of Image Formation Detection And Processing , 2016 .

[26]  T. Jones,et al.  Parametric image reconstruction using spectral analysis of PET projection data. , 1998, Physics in medicine and biology.

[27]  Yuichi Kimura,et al.  PET kinetic analysis—compartmental model , 2006, Annals of nuclear medicine.

[28]  David J. Schlyer,et al.  Graphical Analysis of Reversible Radioligand Binding from Time—Activity Measurements Applied to [N-11C-Methyl]-(−)-Cocaine PET Studies in Human Subjects , 1990, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[29]  Dimitris Visvikis,et al.  Dynamic PET image reconstruction integrating temporal regularization associated with respiratory motion correction for applications in oncology , 2013, Physics in medicine and biology.

[30]  Jieqing Jiao,et al.  Direct Parametric Reconstruction With Joint Motion Estimation/Correction for Dynamic Brain PET Data , 2017, IEEE Transactions on Medical Imaging.

[31]  I. Buvat,et al.  Iterative Kinetic Parameter Estimation within Fully 4D PET Image Reconstruction , 2006, 2006 IEEE Nuclear Science Symposium Conference Record.

[32]  Nassir Navab,et al.  Direct Parametric Reconstruction Using Anatomical Regularization for Simultaneous PET/MRI Data , 2015, IEEE Transactions on Medical Imaging.

[33]  A.J. Reader,et al.  Inter-frame filtering for list-mode EM reconstruction in high-resolution 4-D PET , 2003, IEEE Transactions on Nuclear Science.

[34]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.