Quantifying Explainers of Graph Neural Networks in Computational Pathology

Explainability of deep learning methods is imperative to facilitate their clinical adoption in digital pathology. However, popular deep learning methods and explainability techniques (explainers) based on pixel-wise processing disregard biological entities’ notion, thus complicating comprehension by pathologists. In this work, we address this by adopting biological entity-based graph processing and graph explainers enabling explanations accessible to pathologists. In this context, a major challenge becomes to discern meaningful explainers, particularly in a standardized and quantifiable fashion. To this end, we propose herein a set of novel quantitative metrics based on statistics of class separability using pathologically measurable concepts to characterize graph explainers. We employ the proposed metrics to evaluate three types of graph explainers, namely the layer-wise relevance propagation, gradient-based saliency, and graph pruning approaches, to explain Cell-Graph representations for Breast Cancer Subtyping. The proposed metrics are also applicable in other domains by using domain-specific intuitive concepts. We validate the qualitative and quantitative findings on the BRACS dataset, a large cohort of breast cancer RoIs, by expert pathologists. The code, data, and models can be accessed here 1.

[1]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[2]  B O Palsson,et al.  Effective intercellular communication distances are determined by the relative time constants for cyto/chemokine secretion and diffusion. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Cigdem Demir,et al.  The cell graphs of cancer , 2004, ISMB/ECCB.

[4]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[5]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[6]  Lars Schmidt-Thieme,et al.  Cost-sensitive learning methods for imbalanced data , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[7]  W. Marsden I and J , 2012 .

[8]  Yunqian Ma,et al.  Imbalanced Learning: Foundations, Algorithms, and Applications , 2013 .

[9]  Jonathan Krause,et al.  3D Object Representations for Fine-Grained Categorization , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[10]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[11]  Bernt Schiele,et al.  2D Human Pose Estimation: New Benchmark and State of the Art Analysis , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[13]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[14]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[15]  Hod Lipson,et al.  Understanding Neural Networks Through Deep Visualization , 2015, ArXiv.

[16]  Olaf Hellwich,et al.  A review of graph-based methods for image analysis in digital histopathology , 2015 .

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Donald L Weaver,et al.  Histological features associated with diagnostic agreement in atypical ductal hyperplasia of the breast: illustrative cases from the B‐Path study , 2016, Histopathology.

[21]  Olaf Hellwich,et al.  Cell nuclei attributed relational graphs for efficient representation and classification of gastric cancer in digital histopathology , 2016, SPIE Medical Imaging.

[22]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[23]  Gorjan Alagic,et al.  #p , 2019, Quantum information & computation.

[24]  Max Welling,et al.  Visualizing Deep Neural Network Decisions: Prediction Difference Analysis , 2017, ICLR.

[25]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[26]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[27]  Been Kim,et al.  Towards A Rigorous Science of Interpretable Machine Learning , 2017, 1702.08608.

[28]  Amit Dhurandhar,et al.  A Formal Framework to Characterize Interpretability of Procedures , 2017, ArXiv.

[29]  Luong Nguyen,et al.  Architectural patterns for differential diagnosis of proliferative breast lesions from histopathological images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[30]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[31]  Alexander Binder,et al.  Evaluating the Visualization of What a Deep Neural Network Has Learned , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Andreas Holzinger,et al.  Towards the Augmented Pathologist: Challenges of Explainable-AI in Digital Pathology , 2017, ArXiv.

[33]  Saeed Hassanpour,et al.  Looking Under the Hood: Deep Neural Network Visualization to Interpret Whole-Slide Image Analysis Outcomes for Colorectal Polyps , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[34]  Klaus-Robert Müller,et al.  PatternNet and PatternLRP - Improving the interpretability of neural networks , 2017, ArXiv.

[35]  Olaf Hellwich,et al.  A Comparative Study of Cell Nuclei Attributed Relational Graphs for Knowledge Description and Categorization in Histopathological Gastric Cancer Whole Slide Images , 2017, 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS).

[36]  Alexander Binder,et al.  Explaining nonlinear classification decisions with deep Taylor decomposition , 2015, Pattern Recognit..

[37]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[38]  Masaru Ishii,et al.  Towards computational fluorescence microscopy: Machine learning-based integrated prediction of morphological and molecular tumor profiles , 2018, ArXiv.

[39]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[40]  Martin Wattenberg,et al.  Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV) , 2017, ICML.

[41]  Andreea Anghel,et al.  A Fast and Scalable Pipeline for Stain Normalization of Whole-Slide Images in Histopathology , 2018, ECCV Workshops.

[42]  Anamika Kashyap,et al.  Role of Nuclear Morphometry in Breast Cancer and its Correlation with Cytomorphological Grading of Breast Cancer: A Study of 64 Cases , 2018, Journal of cytology.

[43]  Lipi B. Mahanta,et al.  Analysis of Morphological Features of Benign and Malignant Breast Cell Extracted From FNAC Microscopic Image Using the Pearsonian System of Curves , 2018, Journal of cytology.

[44]  Vineeth N. Balasubramanian,et al.  Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[45]  Gary Klein,et al.  Metrics for Explainable AI: Challenges and Prospects , 2018, ArXiv.

[46]  Jure Leskovec,et al.  Hierarchical Graph Representation Learning with Differentiable Pooling , 2018, NeurIPS.

[47]  Liron Pantanowitz,et al.  Artificial Intelligence and Digital Pathology: Challenges and Opportunities , 2018, Journal of pathology informatics.

[48]  J. Leskovec,et al.  GNNExplainer: Generating Explanations for Graph Neural Networks , 2019, NeurIPS.

[49]  Hai Su,et al.  Pathologist-level interpretable whole-slide cancer diagnosis with deep learning , 2019, Nat. Mach. Intell..

[50]  Hammad Qureshi,et al.  Translational AI and Deep Learning in Diagnostic Pathology , 2019, Front. Med..

[51]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[52]  Jin Tae Kwak,et al.  Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images , 2018, Medical Image Anal..

[53]  Jure Leskovec,et al.  How Powerful are Graph Neural Networks? , 2018, ICLR.

[54]  W. Hager,et al.  and s , 2019, Shallow Water Hydraulics.

[55]  A. Madabhushi,et al.  Artificial intelligence in digital pathology — new tools for diagnosis and precision oncology , 2019, Nature Reviews Clinical Oncology.

[56]  Hossein Azizpour,et al.  Explainability Techniques for Graph Convolutional Networks , 2019, ICML 2019.

[57]  Robert Schwarzenberg,et al.  Layerwise Relevance Visualization in Convolutional Text Graph Classifiers , 2019, EMNLP.

[58]  Pheng-Ann Heng,et al.  CGC-Net: Cell Graph Convolutional Network for Grading of Colorectal Cancer Histology Images , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[59]  Heiko Hoffmann,et al.  Explainability Methods for Graph Convolutional Neural Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[60]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[61]  Alex Smola,et al.  Deep Graph Library: Towards Efficient and Scalable Deep Learning on Graphs , 2019, ArXiv.

[62]  Orcun Goksel,et al.  Towards Explainable Graph Representations in Digital Pathology , 2020, ArXiv.

[63]  Deepak Anand,et al.  Visualization for Histopathology Images using Graph Convolutional Neural Networks , 2020, 2020 IEEE 20th International Conference on Bioinformatics and Bioengineering (BIBE).

[64]  Hamid R. Tizhoosh,et al.  Representation Learning of Histopathology Images using Graph Neural Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[65]  Selim Aksoy,et al.  Graph convolutional networks for region of interest classification in breast histopathology , 2020, Medical Imaging: Digital Pathology.

[66]  Fan Yang,et al.  Predicting Lymph Node Metastasis Using Histopathological Images Based on Multiple Instance Learning With Deep Graph Convolution , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[67]  Klaus-Robert Müller,et al.  Resolving challenges in deep learning-based analyses of histopathological images using explanation methods , 2019, Scientific Reports.

[68]  David B. A. Epstein,et al.  Cellular community detection for tissue phenotyping in colorectal cancer histology images , 2020, Medical Image Anal..

[69]  An-phi Nguyen,et al.  On quantitative aspects of model interpretability , 2020, ArXiv.

[70]  Shrey Gadiya,et al.  Histographs: Graphs in Histopathology , 2019, Medical Imaging: Digital Pathology.

[71]  Orcun Goksel,et al.  HACT-Net: A Hierarchical Cell-to-Tissue Graph Neural Network for Histopathological Image Classification , 2020, UNSURE/GRAIL@MICCAI.

[72]  Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI , 2019, Inf. Fusion.

[73]  Graziani M,et al.  Concept attribution: Explaining CNN decisions to physicians. , 2020, Computers in biology and medicine.

[74]  Ming Y. Lu,et al.  Data-efficient and weakly supervised computational pathology on whole-slide images , 2020, Nature Biomedical Engineering.

[75]  Jean-Philippe Thiran,et al.  Hierarchical graph representations in digital pathology , 2021, Medical Image Anal..

[76]  Eric D. Ragan,et al.  A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems , 2018, ACM Trans. Interact. Intell. Syst..

[77]  Ming Y. Lu,et al.  Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosis , 2019, IEEE Transactions on Medical Imaging.