GAN-based survival prediction model from CT images of patients with idiopathic pulmonary fibrosis

We developed a novel survival prediction model for images, called pix2surv, based on a conditional generative adversarial network (cGAN), and evaluated its performance based on chest CT images of patients with idiopathic pulmonary fibrosis (IPF). The architecture of the pix2surv model has a time-generator network that consists of an encoding convolutional network, a fully connected prediction network, and a discriminator network. The fully connected prediction network is trained to generate survival-time images from the chest CT images of each patient. The discriminator network is a patchbased convolutional network that is trained to differentiate the “fake pair” of a chest CT image and a generated survivaltime image from the “true pair” of an input CT image and the observed survival-time image of a patient. For evaluation, we retrospectively collected 75 IPF patients with high-resolution chest CT and pulmonary function tests. The survival predictions of the pix2surv model on these patients were compared with those of an established clinical prognostic biomarker known as the gender, age, and physiology (GAP) index by use of a two-sided t-test with bootstrapping. Concordance index (C-index) and relative absolute error (RAE) were used as measures of the prediction performance. Preliminary results showed that the survival prediction by the pix2surv model yielded more than 15% higher C-index value and more than 10% lower RAE values than those of the GAP index. The improvement in survival prediction by the pix2surv model was statistically significant (P < 0.0001). Also, the separation between the survival curves for the low- and high-risk groups was larger with pix2surv than that of the GAP index. These results show that the pix2surv model outperforms the GAP index in the prediction of the survival time and risk stratification of patients with IPF, indicating that the pix2surv model can be an effective predictor of the overall survival of patients with IPF.

[1]  Paul Kinahan,et al.  Radiomics: Images Are More than Pictures, They Are Data , 2015, Radiology.

[2]  Takeshi Johkoh,et al.  American Thoracic Society Documents An Official ATS / ERS / JRS / ALAT Statement : Idiopathic Pulmonary Fibrosis : Evidence-based Guidelines for Diagnosis and Management , 2011 .

[3]  R. Mak,et al.  Handcrafted versus deep learning radiomics for prediction of cancer therapy response. , 2019, The Lancet. Digital health.

[4]  F. Harrell,et al.  Evaluating the yield of medical tests. , 1982, JAMA.

[5]  J. Murchison,et al.  Predicting outcomes in rheumatoid arthritis related interstitial lung disease , 2018, European Respiratory Journal.

[6]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  S. Ourselin,et al.  Predicting Outcomes in Idiopathic Pulmonary Fibrosis Using Automated Computed Tomographic Analysis , 2018, American journal of respiratory and critical care medicine.

[8]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[9]  Avishek Chatterjee,et al.  Radiomics and Artificial Intelligence for Biomarker and Prediction Model Development in Oncology , 2019, Computational and structural biotechnology journal.

[10]  R. Gillies,et al.  Repeatability and Reproducibility of Radiomic Features: A Systematic Review , 2018, International journal of radiation oncology, biology, physics.

[11]  D. Coultas,et al.  Is idiopathic pulmonary fibrosis an environmental disease? , 2006, Proceedings of the American Thoracic Society.

[12]  S. Nathan,et al.  Idiopathic Pulmonary Fibrosis in United States Automated Claims. Incidence, Prevalence, and Algorithm Validation. , 2015, American journal of respiratory and critical care medicine.

[13]  W. Seeger,et al.  The European IPF registry (eurIPFreg): baseline characteristics and survival of patients with idiopathic pulmonary fibrosis , 2018, Respiratory Research.

[14]  Eric A Hoffman,et al.  Computed Tomographic Biomarkers in Idiopathic Pulmonary Fibrosis. The Future of Quantitative Analysis , 2019, American journal of respiratory and critical care medicine.

[15]  Joyce S Lee,et al.  A Multidimensional Index and Staging System for Idiopathic Pulmonary Fibrosis , 2012, Annals of Internal Medicine.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  R. Hubbard,et al.  Global incidence and mortality of idiopathic pulmonary fibrosis: a systematic review , 2015, European Respiratory Journal.