Using Machine Learning Algorithms to Predict Immunotherapy Response in Patients with Advanced Melanoma

Purpose: Several biomarkers of response to immune checkpoint inhibitors (ICI) show potential but are not yet scalable to the clinic. We developed a pipeline that integrates deep learning on histology specimens with clinical data to predict ICI response in advanced melanoma. Experimental Design: We used a training cohort from New York University (New York, NY) and a validation cohort from Vanderbilt University (Nashville, TN). We built a multivariable classifier that integrates neural network predictions with clinical data. A ROC curve was generated and the optimal threshold was used to stratify patients as high versus low risk for progression. Kaplan–Meier curves compared progression-free survival (PFS) between the groups. The classifier was validated on two slide scanners (Aperio AT2 and Leica SCN400). Results: The multivariable classifier predicted response with AUC 0.800 on images from the Aperio AT2 and AUC 0.805 on images from the Leica SCN400. The classifier accurately stratified patients into high versus low risk for disease progression. Vanderbilt patients classified as high risk for progression had significantly worse PFS than those classified as low risk (P = 0.02 for the Aperio AT2; P = 0.03 for the Leica SCN400). Conclusions: Histology slides and patients' clinicodemographic characteristics are readily available through standard of care and have the potential to predict ICI treatment outcomes. With prospective validation, we believe our approach has potential for integration into clinical practice.

[1]  N. Razavian,et al.  Predicting endometrial cancer subtypes and molecular features from histopathology images using multi-resolution deep learning models , 2020, bioRxiv.

[2]  A. Regev,et al.  Integrative molecular and clinical modeling of clinical outcomes to PD1 blockade in patients with metastatic melanoma , 2019, Nature Medicine.

[3]  D. Rimm,et al.  An open source automated tumor infiltrating lymphocyte algorithm for prognosis in melanoma , 2019, Nature Communications.

[4]  Jing Wang,et al.  Deep Learning Based on Standard H&E Images of Primary Melanoma Tumors Identifies Patients at Risk for Visceral Recurrence and Death , 2019, Clinical Cancer Research.

[5]  Yan Jing,et al.  Artificial intelligence in dermatology: past, present, and future , 2019, Chinese medical journal.

[6]  J. Larkin,et al.  Pembrolizumab versus ipilimumab in advanced melanoma (KEYNOTE-006): post-hoc 5-year results from an open-label, multicentre, randomised, controlled, phase 3 study. , 2019, The Lancet. Oncology.

[7]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[8]  Nathalie Harder,et al.  Automatic discovery of image-based signatures for ipilimumab response prediction in malignant melanoma , 2019, Scientific Reports.

[9]  N. Razavian,et al.  A Deep Learning Approach for Rapid Mutational Screening in Melanoma , 2019, bioRxiv.

[10]  C. Brennan,et al.  Tumor mutational load predicts survival after immunotherapy across multiple cancer types , 2019, Nature Genetics.

[11]  D. Schadendorf,et al.  Nivolumab plus ipilimumab or nivolumab alone versus ipilimumab alone in advanced melanoma (CheckMate 067): 4-year outcomes of a multicentre, randomised, phase 3 trial. , 2018, The Lancet. Oncology.

[12]  S. Adams,et al.  Predictive Biomarkers for Checkpoint Immunotherapy: Current Status and Challenges for Clinical Application , 2018, Cancer Immunology Research.

[13]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[14]  G. Freeman,et al.  Signatures of T cell dysfunction and exclusion predict cancer immunotherapy response , 2018, Nature Medicine.

[15]  H. Haenssle,et al.  Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists , 2018, Annals of oncology : official journal of the European Society for Medical Oncology.

[16]  Eytan Ruppin,et al.  Robust prediction of response to immune checkpoint blockade therapy in metastatic melanoma , 2018, Nature Medicine.

[17]  Wei Zhang,et al.  Exosomal PD-L1 Contributes to Immunosuppression and is Associated with anti-PD-1 Response , 2018, Nature.

[18]  T. Kirchhoff,et al.  Primary Melanoma Histologic Subtype: Impact on Survival and Response to Therapy , 2018, Journal of the National Cancer Institute.

[19]  D. Milne,et al.  Clinical and palliative care outcomes for patients of poor performance status treated with antiprogrammed death‐1 monoclonal antibodies for advanced melanoma , 2017, Asia-Pacific journal of clinical oncology.

[20]  V. de Giorgi,et al.  Clinicopathological predictors of recurrence in nodular and superficial spreading cutaneous melanoma: a multivariate analysis of 214 cases , 2017, Journal of Translational Medicine.

[21]  David M. Woods,et al.  Predictors of responses to immune checkpoint blockade in advanced melanoma , 2017, Nature Communications.

[22]  J. Malvehy,et al.  Prognostic role of the histological subtype of melanoma on the hands and feet in Caucasians , 2017, Melanoma research.

[23]  E. Hsueh,et al.  Utility of PD-L1 immunohistochemistry assays for predicting PD-1/PD-L1 inhibitor response , 2017, Biomarker Research.

[24]  S. Elledge,et al.  Tumor aneuploidy correlates with markers of immune evasion and with reduced response to immunotherapy , 2017, Science.

[25]  Nassir Navab,et al.  Structure-Preserving Color Normalization and Sparse Stain Separation for Histological Images , 2016, IEEE Transactions on Medical Imaging.

[26]  J. Soria,et al.  Immune-related adverse events with immune checkpoint blockade: a comprehensive review. , 2016, European journal of cancer.

[27]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  J. Larkin,et al.  Prognostic score for patients with advanced melanoma treated with ipilimumab. , 2015, European journal of cancer.

[30]  A. Wilm,et al.  LoFreq: a sequence-quality aware, ultra-sensitive variant caller for uncovering cell-population heterogeneity from high-throughput sequencing datasets , 2012, Nucleic acids research.

[31]  D. Schadendorf,et al.  Improved survival with ipilimumab in patients with metastatic melanoma. , 2010, The New England journal of medicine.

[32]  for the Statistics Subcommittee of the NCI—EORTC Worki Diagnostics REporting recommendations for tumor MARKer prognostic studies (REMARK) , 2005, Nature Clinical Practice Oncology.

[33]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.