An Interpretable Algorithm for Uveal Melanoma Subtyping from Whole Slide Cytology Images

Algorithmic decision support is rapidly becoming a staple of personalized medicine, especially for high-stakes recommendations in which access to certain information can drastically alter the course of treatment, and thus, patient outcome; a prominent example is radiomics for cancer subtyping. Because in these scenarios the stakes are high, it is desirable for decision systems to not only provide recommendations but supply transparent reasoning in support thereof. For learning-based systems, this can be achieved through an interpretable design of the inference pipeline. Herein we describe an automated yet interpretable system for uveal melanoma subtyping with digital cytology images from fine needle aspiration biopsies. Our method embeds every automatically segmented cell of a candidate cytology image as a point in a 2D manifold defined by many representative slides, which enables reasoning about the cell-level composition of the tissue sample, paving the way for interpretable subtyping of the biopsy. Finally, a rule-based slide-level classification algorithm is trained on the partitions of the circularly distorted 2D manifold. This process results in a simple rule set that is evaluated automatically but highly transparent for human verification. On our in house cytology dataset of 88 uveal melanoma patients, the proposed method achieves an accuracy of 87.5% that compares favorably to all competing approaches, including deep “black box” models. The method comes with a user interface to facilitate interaction with cell-level content, which may offer additional insights for pathological assessment. Department of Computer Science, Johns Hopkins University, MD, USA Wilmer Eye Institute, School of Medicine, Johns Hopkins University, MD, USA. Correspondence to: Haomin Chen <hchen135@jhu.edu>, Mathias Unberath <unberath@jhu.edu>. Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. Copyright 2021 by the author(s).

[1]  Yong Jae Lee,et al.  YOLACT: Real-Time Instance Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[2]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Isabelle Bloch,et al.  Improving Interpretability for Computer-aided Diagnosis tools on Whole Slide Imaging with Multiple Instance Learning and Gradient-based Explanations , 2020, iMIMIC/MIL3iD/LABELS@MICCAI.

[4]  Zhipeng Jia,et al.  Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features , 2017, BMC Bioinformatics.

[5]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[6]  Mathias Unberath,et al.  An Interactive Approach to Region of Interest Selection in Cytologic Analysis of Uveal Melanoma Based on Unsupervised Clustering , 2020, OMIA@MICCAI.

[7]  M. Ghassemi,et al.  Do as AI say: susceptibility in deployment of clinical decision-aids , 2021, npj Digital Medicine.

[8]  K. Pearson On the Criterion that a Given System of Deviations from the Probable in the Case of a Correlated System of Variables is Such that it Can be Reasonably Supposed to have Arisen from Random Sampling , 1900 .

[9]  Yong Jae Lee,et al.  Real-time Instance Segmentation , 2019 .

[10]  Cynthia Rudin,et al.  A Bayesian Framework for Learning Rule Sets for Interpretable Classification , 2017, J. Mach. Learn. Res..

[11]  Philip Chikontwe,et al.  Multiple Instance Learning with Center Embeddings for Histopathology Classification , 2020, MICCAI.

[12]  Leland McInnes,et al.  UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction , 2018, ArXiv.

[13]  Z. Corrêa,et al.  Clinical application of genetic testing for posterior uveal melanoma , 2016, International Journal of Retina and Vitreous.

[14]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[15]  Aleksey Boyko,et al.  Detecting Cancer Metastases on Gigapixel Pathology Images , 2017, ArXiv.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Justis P. Ehlers,et al.  Gene Expression Profiling in Uveal Melanoma Reveals Two Molecular Classes and Predicts Metastatic Death , 2004, Cancer Research.

[18]  Chandan Singh,et al.  Definitions, methods, and applications in interpretable machine learning , 2019, Proceedings of the National Academy of Sciences.

[19]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[20]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[21]  Daniel Smilkov,et al.  Similar image search for histopathology: SMILY , 2019, npj Digital Medicine.

[22]  Arun D. Singh,et al.  Uveal melanoma: trends in incidence, treatment, and survival. , 2011, Ophthalmology.

[23]  Eric D. Ragan,et al.  The Role of Domain Expertise in User Trust and the Impact of First Impressions with Intelligent Systems , 2020, HCOMP.

[24]  AN Kolmogorov-Smirnov,et al.  Sulla determinazione empírica di uma legge di distribuzione , 1933 .

[25]  M. Unberath,et al.  Gene Expression Profile Prediction in Uveal Melanoma Using Deep Learning: a Pilot Study for Development of an Alternative Survival Prediction Tool. , 2020, Ophthalmology. Retina.

[26]  Arie Perry,et al.  Transcriptomic versus Chromosomal Prognostic Markers and Clinical Outcome in Uveal Melanoma , 2007, Clinical Cancer Research.

[27]  Yalin Zheng,et al.  Piloting a Deep Learning Model for Predicting Nuclear BAP1 Immunohistochemical Expression of Uveal Melanoma from Hematoxylin-and-Eosin Sections , 2020, Translational vision science & technology.

[28]  Nassir Navab,et al.  Multi-task learning of a deep k-nearest neighbour network for histopathological image classification and retrieval , 2019, bioRxiv.

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  P. Lambin,et al.  Defining the biological basis of radiomic phenotypes in lung cancer , 2017, eLife.