Cellular community detection for tissue phenotyping in colorectal cancer histology images

Classification of various types of tissue in cancer histology images based on the cellular compositions is an important step towards the development of computational pathology tools for systematic digital profiling of the spatial tumor microenvironment. Most existing methods for tissue phenotyping are limited to the classification of tumor and stroma and require large amount of annotated histology images which are often not available. In the current work, we pose the problem of identifying distinct tissue phenotypes as finding communities in cellular graphs or networks. First, we train a deep neural network for cell detection and classification into five distinct cellular components. Considering the detected nuclei as nodes, potential cell-cell connections are assigned using Delaunay triangulation resulting in a cell-level graph. Based on this cell graph, a feature vector capturing potential cell-cell connection of different types of cells is computed. These feature vectors are used to construct a patch-level graph based on chi-square distance. We map patch-level nodes to the geometric space by representing each node as a vector of geodesic distances from other nodes in the network and iteratively drifting the patch nodes in the direction of positive density gradients towards maximum density regions. The proposed algorithm is evaluated on a publicly available dataset and another new large-scale dataset consisting of 280K patches of seven tissue phenotypes. The estimated communities have significant biological meanings as verified by the expert pathologists. A comparison with current state-of-the-art methods reveals significant performance improvement in tissue phenotyping.

[1]  Anant Madabhushi,et al.  A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images , 2016, Neurocomputing.

[2]  Francesco Bianconi,et al.  Discrimination between tumour epithelium and stroma via perception-based features , 2015, Neurocomputing.

[3]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[4]  Bruce Alberts,et al.  Essential Cell Biology , 1983 .

[5]  Alexis B. Carter,et al.  Computational Pathology: A Path Ahead. , 2016, Archives of pathology & laboratory medicine.

[6]  Vishal Monga,et al.  Simultaneous Sparsity Model for Histopathological Image Representation and Classification , 2014, IEEE Transactions on Medical Imaging.

[7]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[8]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[9]  Shaoting Tang,et al.  A new approach to shortest paths on networks based on the quantum bosonic mechanism , 2011 .

[10]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[11]  Vishal Monga,et al.  Histopathological Image Classification Using Discriminative Feature-Oriented Dictionary Learning , 2015, IEEE Transactions on Medical Imaging.

[12]  Ash A. Alizadeh,et al.  Toward understanding and exploiting tumor heterogeneity , 2015, Nature Medicine.

[13]  Zhipeng Jia,et al.  Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features , 2017, BMC Bioinformatics.

[14]  Cigdem Gunduz-Demir,et al.  Unsupervised Feature Extraction via Deep Learning for Histopathological Classification of Colon Tissue Images , 2019, IEEE Transactions on Medical Imaging.

[15]  Ramakrishnan Mukundan,et al.  HER2 challenge contest: a detailed assessment of automated HER2 scoring algorithms in whole slide images of breast cancer tissues , 2017, Histopathology.

[16]  David B. A. Epstein,et al.  Cellular Community Detection for Tissue Phenotyping in Histology Images , 2018, COMPAY/OMIA@MICCAI.

[17]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[18]  Jean Ponce,et al.  Task-Driven Dictionary Learning , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  S. N. Dorogovtsev,et al.  Evolution of networks , 2001, cond-mat/0106144.

[22]  Francesco Bianconi,et al.  Multi-class texture analysis in colorectal cancer histology , 2016, Scientific Reports.

[23]  Steve Harenberg,et al.  Community detection in large‐scale networks: a survey and empirical evaluation , 2014 .

[24]  Sanghoon Lee,et al.  Interactive phenotyping of large-scale histology imaging data with HistomicsML , 2017, bioRxiv.

[25]  B F Warren,et al.  The proportion of tumor-stroma as a strong prognosticator for stage II and III colon cancer patients: validation in the VICTOR trial. , 2013, Annals of oncology : official journal of the European Society for Medical Oncology.

[26]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[27]  Hong Liu,et al.  Classification of Tumor Epithelium and Stroma by Exploiting Image Features Learned by Deep Convolutional Neural Networks , 2018, Annals of Biomedical Engineering.

[28]  Pietro Liò,et al.  Deep Graph Infomax , 2018, ICLR.

[29]  George Karypis,et al.  Empirical and Theoretical Comparisons of Selected Criterion Functions for Document Clustering , 2004, Machine Learning.

[30]  Yee-Wah Tsang,et al.  Validation of digital pathology imaging for primary histopathological diagnosis , 2016, Histopathology.

[31]  Seth Pettie,et al.  A Shortest Path Algorithm for Real-Weighted Undirected Graphs , 2005, SIAM J. Comput..

[32]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[34]  Matti Pietikäinen,et al.  Identification of tumor epithelium and stroma in tissue microarrays using texture analysis , 2012, Diagnostic Pathology.

[35]  Gustavo K. Rohde,et al.  Epithelium-Stroma Classification via Convolutional Neural Networks and Unsupervised Domain Adaptation in Histopathological Images , 2017, IEEE Journal of Biomedical and Health Informatics.

[36]  Lorenzo Livi,et al.  Graph Neural Networks with distributed ARMA filters , 2019 .

[37]  Nico Karssemeijer,et al.  Using deep convolutional neural networks to identify and classify tumor-associated stroma in diagnostic breast biopsies , 2018, Modern Pathology.

[38]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[39]  Arif Mahmood,et al.  Using Geodesic Space Density Gradients for Network Community Detection , 2017, IEEE Transactions on Knowledge and Data Engineering.

[40]  Tanaya Guha,et al.  Image Similarity Using Sparse Representation and Compression Distance , 2012, IEEE Transactions on Multimedia.

[41]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[42]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[43]  K. Polyak,et al.  Intra-tumour heterogeneity: a looking glass for cancer? , 2012, Nature Reviews Cancer.

[44]  Ruoyu Li,et al.  Graph CNN for Survival Analysis on Whole Slide Pathological Images , 2018, MICCAI.

[45]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  David B. A. Epstein,et al.  Novel digital signatures of tissue phenotypes for predicting distant metastasis in colorectal cancer , 2018, Scientific Reports.

[47]  Daisuke Komura,et al.  Machine Learning Methods for Histopathological Image Analysis , 2017, Computational and structural biotechnology journal.

[48]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[49]  Scott T. Acton,et al.  SDL: Saliency-Based Dictionary Learning Framework for Image Similarity , 2018, IEEE Transactions on Image Processing.

[50]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[51]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[52]  Vishal Monga,et al.  Prior Information Guided Regularized Deep Learning for Cell Nucleus Detection , 2019, IEEE Transactions on Medical Imaging.

[53]  May D. Wang,et al.  Histological image classification using biologically interpretable shape-based features , 2013, BMC Medical Imaging.

[54]  Constantino Carlos Reyes-Aldasoro,et al.  Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter study , 2019, PLoS medicine.

[55]  Max A. Viergever,et al.  Breast Cancer Histopathology Image Analysis: A Review , 2014, IEEE Transactions on Biomedical Engineering.