Uncertainty Quantification in Radiogenomics: EGFR Amplification in Glioblastoma

BACKGROUND: Radiogenomics uses machine-learning (ML) to directly connect the morphologic and physiological appearance of tumors on clinical imaging with underlying genomic features. Despite extensive growth in the area of radiogenomics across many cancers, and its potential role in advancing clinical decision making, no published studies have directly addressed uncertainty in these model predictions. METHODS: We developed a radiogenomics ML model to quantify uncertainty using transductive Gaussian Processes (GP) and a unique dataset of 95 image-localized biopsies with spatially matched MRI from 25 untreated Glioblastoma (GBM) patients. The model generated predictions for regional EGFR amplification status (a common and important target in GBM) to resolve the intratumoral genetic heterogeneity across each individual tumor - a key factor for future personalized therapeutic paradigms. The model used probability distributions for each sample prediction to quantify uncertainty, and used transductive learning to reduce the overall uncertainty. We compared predictive accuracy and uncertainty of the transductive learning GP model against a standard GP model using leave-one-patient-out cross validation. RESULTS: Predictive uncertainty informed the likelihood of achieving an accurate sample prediction. When stratifying predictions based on uncertainty, we observed substantially higher performance in the group cohort (75% accuracy, n=95) and amongst sample predictions with the lowest uncertainty (83% accuracy, n=72) compared to predictions with higher uncertainty (48% accuracy, n=23), due largely to data interpolation (rather than extrapolation). CONCLUSION: We present a novel approach to quantify radiogenomics uncertainty to enhance model performance and clinical interpretability. This should help integrate more reliable radiogenomics models for improved medical decision-making.

[1]  Sanjeev Chawla,et al.  Use of magnetic perfusion-weighted imaging to determine epidermal growth factor receptor variant III expression in glioblastoma. , 2012, Neuro-oncology.

[2]  H. Fine,et al.  Many tumors in one: a daunting therapeutic prospect. , 2011, Cancer cell.

[3]  Christopher Nimsky,et al.  Gliomas: histopathologic evaluation of changes in directionality and magnitude of water diffusion at diffusion-tensor MR imaging. , 2006, Radiology.

[4]  J. Brian Gray,et al.  Introduction to Linear Regression Analysis , 2002, Technometrics.

[5]  William D. Dunn,et al.  MR imaging predictors of molecular profile and survival: multi-institutional study of the TCGA glioblastoma data set. , 2013, Radiology.

[6]  Leland S. Hu,et al.  Radiogenomics to characterize regional genetic heterogeneity in glioblastoma , 2016, Neuro-oncology.

[7]  Yonatan Aumann,et al.  Efficient Calculation of Interval Scores for DNA Copy Number Data Analysis , 2005, RECOMB.

[8]  V. P. Collins,et al.  Intratumor heterogeneity in human glioblastoma reflects cancer evolutionary dynamics , 2013, Proceedings of the National Academy of Sciences.

[9]  Richard A. Johnson,et al.  A new family of power transformations to improve normality or symmetry , 2000 .

[10]  Mitchel S Berger,et al.  Regional variation in histopathologic features of tumor specimens from treatment-naive glioblastoma correlates with anatomic and physiologic MR Imaging. , 2012, Neuro-oncology.

[11]  Jingping Xie,et al.  Assessing tumor cytoarchitecture using multiecho DSC‐MRI derived measures of the transverse relaxivity at tracer equilibrium (TRATE) , 2015, Magnetic resonance in medicine.

[12]  Jonathan Karnon,et al.  Model Parameter Estimation and Uncertainty Analysis , 2012, Medical decision making : an international journal of the Society for Medical Decision Making.

[13]  Francisco M. De La Vega,et al.  Genome and Transcriptome Sequencing in Prospective Metastatic Triple-Negative Breast Cancer Uncovers Therapeutic Vulnerabilities , 2012, Molecular Cancer Therapeutics.

[14]  T. Carpenter,et al.  Improved delineation of glioma margins and regions of infiltration with the use of diffusion tensor imaging: an image-guided biopsy study. , 2006, AJNR. American journal of neuroradiology.

[15]  Eric W. Klee,et al.  Integrated Genomic Characterization Reveals Novel, Therapeutically Relevant Drug Targets in FGFR and EGFR Pathways in Sporadic Intrahepatic Cholangiocarcinoma , 2014, PLoS genetics.

[16]  R M Weisskoff,et al.  Relative cerebral blood volume maps corrected for contrast agent extravasation significantly correlate with glioma tumor grade, whereas uncorrected maps do not. , 2006, AJNR. American journal of neuroradiology.

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[19]  L. M. Nithya,et al.  A Survey on Semi-Supervised Learning Techniques , 2014, ArXiv.

[20]  Ahmed Hosny,et al.  Artificial intelligence in radiology , 2018, Nature Reviews Cancer.

[21]  Durga L. Shrestha,et al.  Machine learning approaches for estimation of prediction interval for the model output , 2006, Neural Networks.

[22]  Lucia Specia,et al.  Exploring Prediction Uncertainty in Machine Translation Quality Estimation , 2016, CoNLL.

[23]  D. Haussler,et al.  The Somatic Genomic Landscape of Glioblastoma , 2013, Cell.

[24]  Joshua M. Korn,et al.  Comprehensive genomic characterization defines human glioblastoma genes and core pathways , 2008, Nature.

[25]  Benjamin J. Raphael,et al.  Integrated Genomic Analyses of Ovarian Carcinoma , 2011, Nature.

[26]  Aleix Prat Aparicio Comprehensive molecular portraits of human breast tumours , 2012 .

[27]  Dimitri Solomatine,et al.  A novel method to estimate model uncertainty using machine learning techniques , 2009 .

[28]  A. G. Ramakrishnan,et al.  Neural network-based segmentation of textures using Gabor features , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[29]  Carl E. Rasmussen,et al.  Evaluating Predictive Uncertainty Challenge , 2005, MLCW.

[30]  J Quinonero Candela,et al.  Machine Learning Challenges. Evaluating Predictive Uncertainty, Visual Object Classification, and Recognising Tectual Entailment , 2006, Lecture Notes in Computer Science.

[31]  R. Steenbakkers,et al.  The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping. , 2020, Radiology.

[32]  Selene M. Virk,et al.  Integrated genomic analysis of survival outliers in glioblastoma , 2016, Neuro-oncology.

[33]  A. Gupta,et al.  Pretreatment Dynamic Susceptibility Contrast MRI Perfusion in Glioblastoma: Prediction of EGFR Gene Amplification , 2015, Clinical Neuroradiology.

[34]  G. Riggins,et al.  Molecular targeting of glioblastoma: Drug discovery and therapies. , 2011, Trends in molecular medicine.

[35]  J. Debbins,et al.  Correlations between Perfusion MR Imaging Cerebral Blood Volume, Microvessel Quantification, and Clinical Outcome Using Stereotactic Analysis in Recurrent High-Grade Glioma , 2012, American Journal of Neuroradiology.

[36]  Lei Zhang,et al.  Transductive Gaussian processes for image denoising , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[37]  Jeffrey J Meyer,et al.  Cancer Genome Atlas Network. Comprehensive molecular characterization of human colon and rectal cancer. Nature 2012. (5) , 2013 .

[38]  K. Dreyer,et al.  When Machines Think: Radiology's Next Frontier. , 2017, Radiology.

[39]  Ru-Fang Yeh,et al.  Glioblastoma multiforme regional genetic and cellular expression patterns: influence on anatomic and physiologic MR imaging. , 2010, Radiology.

[40]  Tracy T Batchelor,et al.  Magnetic Resonance Imaging Characteristics Predict Epidermal Growth Factor Receptor Amplification Status in Glioblastoma , 2005, Clinical Cancer Research.

[41]  S. Choi,et al.  Cerebral Blood Volume Calculated by Dynamic Susceptibility Contrast-Enhanced Perfusion MR Imaging: Preliminary Correlation Study with Glioblastoma Genetic Profiles , 2013, PloS one.

[42]  Paul S Mischel,et al.  Relationship between gene expression and enhancement in glioblastoma multiforme: exploratory DNA microarray analysis. , 2008, Radiology.

[43]  B. Erickson,et al.  Impact of Software Modeling on the Accuracy of Perfusion MRI in Glioma , 2015, American Journal of Neuroradiology.

[44]  Teresa Wu,et al.  Multi-Parametric MRI and Texture Analysis to Visualize Spatial Histologic Heterogeneity and Tumor Extent in Glioblastoma , 2015, PloS one.

[45]  Scott N. Hwang,et al.  Outcome prediction in patients with glioblastoma by using imaging, clinical, and genomic biomarkers: focus on the nonenhancing component of the tumor. , 2014, Radiology.

[46]  Tej D. Azad,et al.  Magnetic resonance image features identify glioblastoma phenotypic subtypes with distinct molecular pathway activities , 2015, Science Translational Medicine.

[47]  Richard E. Kennedy,et al.  Statistical issues in the analysis of DNA Copy Number Variations , 2008, Int. J. Comput. Biol. Drug Des..

[48]  Steffen Löck,et al.  Image biomarker standardisation initiative , 2016 .

[49]  K. Polyak,et al.  Intra-tumour heterogeneity: a looking glass for cancer? , 2012, Nature Reviews Cancer.

[50]  Leland S. Hu,et al.  Reevaluating the imaging definition of tumor progression: perfusion MRI quantifies recurrent glioblastoma tumor fraction, pseudoprogression, and radiation necrosis to predict survival , 2012, Neuro-oncology.

[51]  C. McPherson,et al.  Whole genome sequencing of glioblastoma multiforme identifies multiple structural variations involved in EGFR activation. , 2014, Mutagenesis.