Comparison of Machine Learning Classifiers to Predict Patient Survival and Genetics of GBM: Towards a Standardized Model for Clinical Implementation

Radiomic models have been shown to outperform clinical data for outcome prediction in glioblastoma (GBM). However, clinical implementation is limited by lack of parameters standardization. We aimed to compare nine machine learning classifiers, with different optimization parameters, to predict overall survival (OS), isocitrate dehydrogenase (IDH) mutation, O-6methylguanine-DNA-methyltransferase (MGMT) promoter methylation, epidermal growth factor receptor (EGFR) VII amplification and Ki-67 expression in GBM patients, based on radiomic features from conventional and advanced MR. 156 adult patients with pathologic diagnosis of GBM were included. Three tumoral regions were analyzed: contrast-enhancing tumor, necrosis and nonenhancing tumor, selected by manual segmentation. Radiomic features were extracted with a custom version of Pyradiomics, and selected through Boruta algorithm. A Grid Search algorithm was applied when computing 4 times K-fold cross validation (K=10) to get the highest mean and lowest spread of accuracy. Once optimal parameters were identified, model performances were assessed in terms of Area Under The Curve-Receiver Operating Characteristics (AUC-ROC). Metaheuristic and ensemble classifiers showed the best performance across tasks. xGB obtained maximum accuracy for OS Machine Learning predictions for GBM 2 (74.5%), AB for IDH mutation (88%), MGMT methylation (71,7%), Ki-67 expression (86,6%), and EGFR amplification (81,6%). Best performing features shed light on possible correlations between MR and tumor histology.

[1]  Paul Kinahan,et al.  Radiomics: Images Are More than Pictures, They Are Data , 2015, Radiology.

[2]  Yang Liu,et al.  Relationship between Glioblastoma Heterogeneity and Survival Time: An MR Imaging Texture Analysis , 2017, American Journal of Neuroradiology.

[3]  B. Rosen,et al.  High resolution measurement of cerebral blood flow using intravascular tracer bolus passages. Part I: Mathematical approach and statistical analysis , 1996, Magnetic resonance in medicine.

[4]  Martin Sill,et al.  Radiogenomics of Glioblastoma: Machine Learning-based Classification of Molecular Characteristics by Using Multiparametric and Multiregional MR Imaging Features. , 2016, Radiology.

[5]  Philippe Lambin,et al.  Quantitative radiomics studies for tissue characterization: a review of technology and methodological procedures , 2017, The British journal of radiology.

[6]  Annette M. Molinaro,et al.  Genetic and molecular epidemiology of adult diffuse glioma , 2019, Nature Reviews Neurology.

[7]  Richard Reilly,et al.  Machine learning: a useful radiological adjunct in determination of a newly diagnosed glioma’s grade and IDH status , 2018, Journal of Neuro-Oncology.

[8]  William H. Sanders,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2014 .

[9]  Chaofeng Liang,et al.  A Fully-Automatic Multiparametric Radiomics Model: Towards Reproducible and Prognostic Imaging Signature for Prediction of Overall Survival in Glioblastoma Multiforme , 2017, Scientific Reports.

[10]  Ekaba Bisong,et al.  Building Machine Learning and Deep Learning Models on Google Cloud Platform: A Comprehensive Guide for Beginners , 2019 .

[11]  Leland S. Hu,et al.  Radiogenomics to characterize regional genetic heterogeneity in glioblastoma , 2016, Neuro-oncology.

[12]  Shang Gao,et al.  Grouped SMOTE With Noise Filtering Mechanism for Classifying Imbalanced Data , 2019, IEEE Access.

[13]  C. Bettegowda,et al.  Genomic discoveries in adult astrocytoma. , 2015, Current opinion in genetics & development.

[14]  Jennie W. Taylor,et al.  Association of Maximal Extent of Resection of Contrast-Enhanced and Non-Contrast-Enhanced Tumor With Survival Within Molecular Subgroups of Patients With Newly Diagnosed Glioblastoma. , 2020, JAMA oncology.

[15]  Francisco Herrera,et al.  SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary , 2018, J. Artif. Intell. Res..

[16]  A. Madabhushi,et al.  Radiomic features from the peritumoral brain parenchyma on treatment-naïve multi-parametric MR imaging predict long versus short-term survival in glioblastoma multiforme: Preliminary findings , 2017, European Radiology.

[17]  Khan M. Iftekharuddin,et al.  Glioblastoma and Survival Prediction , 2017, BrainLes@MICCAI.

[18]  Evangelia I. Zacharaki,et al.  Learning MRI-based classification models for MGMT methylation status prediction in glioblastoma , 2017, Comput. Methods Programs Biomed..

[19]  Seok-Gu Kang,et al.  Radiomic MRI Phenotyping of Glioblastoma: Improving Survival Prediction. , 2018, Radiology.

[20]  A. Bozzao,et al.  Apparent diffusion coefficient obtained by magnetic resonance imaging as a prognostic marker in glioblastomas: correlation with MGMT promoter methylation status , 2013, European Radiology.

[21]  Omar S. Al-Kadi,et al.  Texture Analysis of Aggressive and Nonaggressive Lung Tumor CE CT Images , 2008, IEEE Transactions on Biomedical Engineering.

[22]  Peter Chang,et al.  Imaging Genetic Heterogeneity in Glioblastoma and Other Glial Tumors: Review of Current Methods and Future Directions. , 2018, AJR. American journal of roentgenology.

[23]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[24]  M Schumacher,et al.  An Experimental Evaluation of Boosting Methods for Classification , 2010, Methods of Information in Medicine.

[25]  Poonam Sonar,et al.  Classification and segmentation of brain tumor using Adaboost classifier , 2016, 2016 International Conference on Global Trends in Signal Processing, Information Computing and Communication (ICGTSPICC).

[26]  A. Rao,et al.  Texture Feature Ratios from Relative CBV Maps of Perfusion MRI Are Associated with Patient Survival in Glioblastoma , 2016, American Journal of Neuroradiology.

[27]  Harini Veeraraghavan,et al.  Impact of image preprocessing on the scanner dependence of multi-parametric MRI radiomic features and covariate shift in multi-institutional glioblastoma datasets , 2019, Physics in medicine and biology.

[28]  Shiao Y. Woo,et al.  Evaluation of peritumoral edema in the delineation of radiotherapy clinical target volumes for glioblastoma. , 2007, International journal of radiation oncology, biology, physics.

[29]  H. Heinzl,et al.  Peritumoral edema on MRI at initial diagnosis: an independent prognostic factor for glioblastoma? , 2009, European journal of neurology.

[30]  Yonehiro Kanemura,et al.  Radiomics and MGMT promoter methylation for prognostication of newly diagnosed glioblastoma , 2019, Scientific Reports.

[31]  P. LaViolette,et al.  Precise ex vivo histological validation of heightened cellularity and diffusion-restricted necrosis in regions of dark apparent diffusion coefficient in 7 cases of high-grade glioma. , 2014, Neuro-oncology.

[32]  S. Bakas,et al.  Imaging signatures of glioblastoma molecular characteristics: A radiogenomics review , 2020, Journal of magnetic resonance imaging : JMRI.

[33]  Lawrence O. Hall,et al.  Synthetic minority image over-sampling technique: How to improve AUC for glioblastoma patient survival prediction , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[34]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[35]  Carla E. Brodley,et al.  Class Imbalance, Redux , 2011, 2011 IEEE 11th International Conference on Data Mining.

[36]  W. Qin,et al.  Radiomics signature: A potential biomarker for the prediction of MGMT promoter methylation in glioblastoma , 2018, Journal of magnetic resonance imaging : JMRI.

[37]  B. Ang,et al.  Overall survival prediction in glioblastoma multiforme patients from volumetric, shape and texture features using machine learning. , 2018, Surgical oncology.

[38]  P. Lambin,et al.  Machine Learning methods for Quantitative Radiomic Biomarkers , 2015, Scientific Reports.

[39]  Chaofeng Liang,et al.  Multiregional radiomics features from multiparametric MRI for prediction of MGMT methylation status in glioblastoma multiforme: A multicentre study , 2018, European Radiology.

[40]  Christoforos Anagnostopoulos,et al.  When is the area under the receiver operating characteristic curve an appropriate measure of classifier performance? , 2013, Pattern Recognit. Lett..

[41]  Kaibin Xu,et al.  Relationship between necrotic patterns in glioblastoma and patient survival: fractal dimension and lacunarity analyses using magnetic resonance imaging , 2017, Scientific Reports.

[42]  Janki Naik,et al.  Tumor Detection and Classification using Decision Tree in Brain MRI , 2013 .

[43]  Juan J. Martinez,et al.  Evaluation of tumor-derived MRI-texture features for discrimination of molecular subtypes and prediction of 12-month survival status in glioblastoma. , 2015, Medical physics.

[44]  J. Lemée,et al.  Intratumoral heterogeneity in glioblastoma: don't forget the peritumoral brain zone. , 2015, Neuro-oncology.

[45]  David T. W. Jones,et al.  Radiomic subtyping improves disease stratification beyond key molecular, clinical, and standard imaging characteristics in patients with glioblastoma , 2018, Neuro-oncology.

[46]  H. Aydin,et al.  R132H Mutation in IDH1 Gene is Associated with Increased Tumor HIF1‐Alpha and Serum VEGF Levels in Primary Glioblastoma Multiforme , 2017, Annals of clinical and laboratory science.

[47]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[48]  J. Martinez-Climent,et al.  Cellular Plasticity Confers Migratory and Invasive Advantages to a Population of Glioblastoma‐Initiating Cells that Infiltrate Peritumoral Tissue , 2013, Stem cells.

[49]  V. Gebski,et al.  Cut‐point for Ki‐67 proliferation index as a prognostic marker for glioblastoma , 2019, Asia-Pacific journal of clinical oncology.

[50]  M. J. van den Bent,et al.  Imaging Correlates of Adult Glioma Genotypes. , 2017, Radiology.

[51]  R. Mahfouz,et al.  EGFR as a clinical marker in glioblastomas and other gliomas , 2018, The International journal of biological markers.

[52]  Heinz Handels,et al.  Image Features for Brain Lesion Segmentation Using Random Forests , 2015, Brainles@MICCAI.

[53]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[54]  Kashif Rajpoot,et al.  Brain tumor classification from multi-modality MRI using wavelets and machine learning , 2017, Pattern Analysis and Applications.

[55]  J. Buckner,et al.  MRI texture features as biomarkers to predict MGMT methylation status in glioblastomas , 2016, Medical physics.

[56]  Chung-Ming Lo,et al.  Radiomic model for predicting mutations in the isocitrate dehydrogenase gene in glioblastomas , 2017, Oncotarget.

[57]  Raymond Y Huang,et al.  Multimodal MRI features predict isocitrate dehydrogenase genotype in high-grade gliomas , 2017, Neuro-oncology.

[58]  Mitchel S Berger,et al.  Regional variation in histopathologic features of tumor specimens from treatment-naive glioblastoma correlates with anatomic and physiologic MR Imaging. , 2012, Neuro-oncology.

[59]  S. Heiland,et al.  IDH mutation status is associated with a distinct hypoxia/angiogenesis transcriptome signature which is non-invasively predictable with rCBV imaging in human glioma , 2015, Scientific Reports.

[60]  Kook Jin Ahn,et al.  Analysis of peritumoral hyperintensity on pre-operative T2-weighted MR images in glioblastoma: Additive prognostic value of Minkowski functionals , 2019, PloS one.

[61]  Witold R. Rudnicki,et al.  Feature Selection with the Boruta Package , 2010 .

[62]  Jian Ma,et al.  A comparative assessment of ensemble learning for credit scoring , 2011, Expert Syst. Appl..

[63]  A. Tamimi,et al.  Epidemiology and Outcome of Glioblastoma , 2017 .

[64]  D. Dong,et al.  Development and Validation of a MRI-Based Radiomics Prognostic Classifier in Patients with Primary Glioblastoma Multiforme. , 2019, Academic radiology.

[65]  Camel Tanougast,et al.  A quantitative study of shape descriptors from glioblastoma multiforme phenotypes for predicting survival outcome. , 2016, The British journal of radiology.

[66]  S A Sheth,et al.  A Multiparametric Model for Mapping Cellularity in Glioblastoma Using Radiographically Localized Biopsies , 2017, American Journal of Neuroradiology.

[67]  Alexander F. I. Osman,et al.  A Multi-parametric MRI-Based Radiomics Signature and a Practical ML Model for Stratifying Glioblastoma Patients Based on Survival Toward Precision Oncology , 2019, Front. Comput. Neurosci..

[68]  Luke Macyszyn,et al.  Imaging patterns predict patient survival and molecular subtype in glioblastoma via machine learning techniques. , 2016, Neuro-oncology.