Prediction of FDG uptake in Lung Tumors from CT Images Using Generative Adversarial Networks

In modern medicine, combined PET-CT is a commonly-used tool in clinical diagnostics, which is especially important in oncology for staging or treatment planning. Variations in FDG uptake visible in a PET image, which indicate variances in metabolic activity, are not visually recognizable within a CT scan from the same region, making both imaging modalities necessary for diagnosis and exposing the patient to a high amount of radiation. In this study, we investigate the possibility of using generative adversarial networks (GANs) to synthesize a PET image from a CT scan to predict metabolic activity.

[1]  David Dagan Feng,et al.  Classification of thresholded regions based on selective use of PET, CT and PET-CT image features , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Bin Yang,et al.  Automated Detection of High FDG Uptake Regions in CT Images , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Issam El-Naqa,et al.  Exploring feature-based approaches in PET images for predicting cancer treatment outcomes , 2009, Pattern Recognit..

[4]  Vicky Goh,et al.  Quantifying tumour heterogeneity in 18F-FDG PET/CT imaging by texture analysis , 2012, European Journal of Nuclear Medicine and Molecular Imaging.

[5]  F-18 FDG-PET and PET/CT Imaging of Cancer Patients , 2008 .

[6]  A. Gallamini,et al.  Positron Emission Tomography (PET) in Oncology , 2014, Cancers.

[7]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Dinggang Shen,et al.  Deep auto-context convolutional neural networks for standard-dose PET image estimation from low-dose PET/MRI , 2017, Neurocomputing.

[9]  I. Francis,et al.  The clinical role of CT/PET in oncology: an update , 2005, Cancer imaging : the official publication of the International Cancer Imaging Society.

[10]  L. Schrader,et al.  Application of machine learning methodology for pet-based definition of lung cancer , 2010, Current oncology.

[11]  J. Ruhlmann,et al.  Clinical PET in oncology. , 2000, Revista espanola de medicina nuclear.

[12]  David Dagan Feng,et al.  Synthesis of Positron Emission Tomography (PET) Images via Multi-channel Generative Adversarial Networks (GANs) , 2017, CMMI/RAMBO/SWITCH@MICCAI.

[13]  Yang-Ming Zhu,et al.  Full-Dose PET Image Estimation from Low-Dose PET Image Using Deep Learning: a Pilot Study , 2018, Journal of Digital Imaging.

[14]  Dinggang Shen,et al.  3D conditional generative adversarial networks for high-quality PET image estimation at low dose , 2018, NeuroImage.

[15]  Hayit Greenspan,et al.  Cross-Modality Synthesis from CT to PET using FCN and GAN Networks for Improved Automated Lesion Detection , 2018, Eng. Appl. Artif. Intell..

[16]  Simon Wan,et al.  Tumor Heterogeneity and Permeability as Measured on the CT Component of PET/CT Predict Survival in Patients with Non–Small Cell Lung Cancer , 2013, Clinical Cancer Research.

[17]  Ze Jin,et al.  Automated method for extraction of lung tumors using a machine learning classifier with knowledge of radiation oncologists on data sets of planning CT and FDG-PET/CT images , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[19]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.