Reproducibility of radiomics for deciphering tumor phenotype with imaging

Radiomics (radiogenomics) characterizes tumor phenotypes based on quantitative image features derived from routine radiologic imaging to improve cancer diagnosis, prognosis, prediction and response to therapy. Although radiomic features must be reproducible to qualify as biomarkers for clinical care, little is known about how routine imaging acquisition techniques/parameters affect reproducibility. To begin to fill this knowledge gap, we assessed the reproducibility of a comprehensive, commonly-used set of radiomic features using a unique, same-day repeat computed tomography data set from lung cancer patients. Each scan was reconstructed at 6 imaging settings, varying slice thicknesses (1.25 mm, 2.5 mm and 5 mm) and reconstruction algorithms (sharp, smooth). Reproducibility was assessed using the repeat scans reconstructed at identical imaging setting (6 settings in total). In separate analyses, we explored differences in radiomic features due to different imaging parameters by assessing the agreement of these radiomic features extracted from the repeat scans reconstructed at the same slice thickness but different algorithms (3 settings in total). Our data suggest that radiomic features are reproducible over a wide range of imaging settings. However, smooth and sharp reconstruction algorithms should not be used interchangeably. These findings will raise awareness of the importance of properly setting imaging acquisition parameters in radiomics/radiogenomics research.

[1]  W. J. Dixon,et al.  Processing Data for Outliers , 1953 .

[2]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.

[3]  M. Kuo,et al.  Radiogenomic analysis to identify imaging phenotypes associated with drug response gene expression programs in hepatocellular carcinoma. , 2007, Journal of vascular and interventional radiology : JVIR.

[4]  Binsheng Zhao,et al.  Evaluating variability in tumor measurements from same-day repeat CT scans of patients with non-small cell lung cancer. , 2009, Radiology.

[5]  R. Jeraj,et al.  Variability of textural features in FDG PET images due to different acquisition modes and reconstruction parameters , 2010, Acta oncologica.

[6]  M. Hatt,et al.  Intratumor Heterogeneity Characterized by Textural Features on Baseline 18F-FDG PET Images Predicts Response to Concomitant Radiochemotherapy in Esophageal Cancer , 2011, The Journal of Nuclear Medicine.

[7]  Ferenc A. Jolesz,et al.  Radiogenomic Mapping of Edema/Cellular Invasion MRI-Phenotypes in Glioblastoma Multiforme , 2011, PloS one.

[8]  Olivier Gevaert,et al.  Non-small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data--methods and preliminary results. , 2012, Radiology.

[9]  Andre Dekker,et al.  Radiomics: the process and the challenges. , 2012, Magnetic resonance imaging.

[10]  Patrick Granton,et al.  Radiomics: extracting more information from medical images using advanced feature analysis. , 2012, European journal of cancer.

[11]  L. Tanoue,et al.  Variability of Lung Tumor Measurements on Repeat Computed Tomography Scans Taken Within 15 Minutes , 2012 .

[12]  Lawrence H. Schwartz,et al.  Assessing the effect of CT slice interval on unidimensional, bidimensional and volumetric measurements of solid tumours , 2012, Cancer imaging : the official publication of the International Cancer Imaging Society.

[13]  Vicky Goh,et al.  Assessment of tumor heterogeneity by CT texture analysis: can the largest cross-sectional area be used as an alternative to whole tumor analysis? , 2013, European journal of radiology.

[14]  P. Lambin,et al.  Stability of FDG-PET Radiomics features: An integrated analysis of test-retest and inter-observer variability , 2013, Acta oncologica.

[15]  M. Martel,et al.  High quality machine-robust image features: identification in nonsmall cell lung cancer computed tomography images. , 2013, Medical physics.

[16]  L. Schwartz,et al.  Segmentation of lung lesions on CT scans using watershed, active contours, and Markov random field. , 2013, Medical physics.

[17]  Binsheng Zhao,et al.  Exploring intra- and inter-reader variability in uni-dimensional, bi-dimensional, and volumetric measurements of solid tumors on CT scans reconstructed at different slice intervals. , 2013, European journal of radiology.

[18]  Lawrence H. Schwartz,et al.  Epidermal growth factor receptor mutation in lung adenocarcinomas: relationship with CT characteristics and histologic subtypes. , 2013, Radiology.

[19]  P. Lambin,et al.  Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation , 2014, PloS one.

[20]  P. Lambin,et al.  Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach , 2014, Nature Communications.

[21]  W. Tsai,et al.  Exploring Variability in CT Characterization of Tumors: A Preliminary Phantom Study. , 2014, Translational oncology.

[22]  H. Hricak,et al.  Radiogenomics of clear cell renal cell carcinoma: associations between CT imaging features and mutations. , 2013, Radiology.

[23]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[24]  Robert J. Gillies,et al.  Test–Retest Reproducibility Analysis of Lung CT Image Features , 2014, Journal of Digital Imaging.

[25]  Subha Madhavan,et al.  NCI Workshop Report: Clinical and Computational Requirements for Correlating Imaging Phenotypes with Genomics Signatures , 2014, Translational oncology.

[26]  Chaya S Moskowitz,et al.  Are there imaging characteristics associated with lung adenocarcinomas harboring ALK rearrangements? , 2014, Lung cancer.

[27]  P. Lambin,et al.  CT-based radiomic signature predicts distant metastasis in lung adenocarcinoma. , 2015, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[28]  Michael F. McNitt-Gray,et al.  Determining the Variability of Lesion Size Measurements from CT Patient Data Sets Acquired under “No Change” Conditions12 , 2015, Translational oncology.