Cells are Actors: Social Network Analysis with Classical ML for SOTA Histology Image Classification

Digitization of histology images and the advent of new computational methods, like deep learning, have helped the automatic grading of colorectal adenocarcinoma cancer (CRA). Present automated CRA grading methods, however, usually use tiny image patches and thus fail to integrate the entire tissue micro-architecture for grading purposes. To tackle these challenges, we propose to use a statistical network analysis method to describe the complex structure of the tissue micro-environment by modelling nuclei and their connections as a network. We show that by analyzing only the interactions between the cells in a network, we can extract highly discriminative statistical features for CRA grading. Unlike other deep learning or convolutional graph-based approaches, our method is highly scalable (can be used for cell networks consist of millions of nodes), completely explainable, and computationally inexpensive. We create cell networks on a broad CRC histology image dataset, experiment with our method, and report state-of-the-art performance for the prediction of three-class CRA grading.

[1]  David B. A. Epstein,et al.  Glandular Morphometrics for Objective Grading of Colorectal Adenocarcinoma Histology Images , 2017, Scientific Reports.

[2]  Pheng-Ann Heng,et al.  CIA-Net: Robust Nuclei Instance Segmentation with Contour-aware Information Aggregation , 2019, IPMI.

[3]  David B. A. Epstein,et al.  Novel digital signatures of tissue phenotypes for predicting distant metastasis in colorectal cancer , 2018, Scientific Reports.

[4]  Anne L. Martel,et al.  Deep neural network models for computational histopathology: A survey , 2019, Medical Image Anal..

[5]  E. Sahai,et al.  Topological Tumor Graphs: a graph-based spatial model to infer stromal recruitment for immunosuppression in melanoma histology. , 2019, Cancer research.

[6]  E. Todeva Networks , 2007 .

[7]  Shan-e-Ahmed Raza,et al.  Deconvolving Convolutional Neural Network for Cell Detection , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[8]  Pheng-Ann Heng,et al.  CGC-Net: Cell Graph Convolutional Network for Grading of Colorectal Cancer Histology Images , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Cigdem Demir,et al.  Augmented cell-graphs for automated cancer diagnosis , 2005, ECCB/JBI.

[11]  John Scott What is social network analysis , 2010 .

[12]  Leo Katz,et al.  A new status index derived from sociometric analysis , 1953 .

[13]  Naoufel Werghi,et al.  Multiplex Cellular Communities in Multi-Gigapixel Colorectal Cancer Histology Images for Tissue Phenotyping , 2020, IEEE Transactions on Image Processing.

[14]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[15]  Bülent Yener,et al.  ECM-aware cell-graph mining for bone tissue modeling and classification , 2010, Data Mining and Knowledge Discovery.

[16]  Nasullah Khalid Alham,et al.  Improving Whole Slide Segmentation Through Visual Context - A Systematic Study , 2018, MICCAI.

[17]  Nasir Rajpoot,et al.  NuClick: A Deep Learning Framework for Interactive Segmentation of Microscopy Images , 2020, Medical Image Anal..

[18]  Nasir M. Rajpoot,et al.  Context-Aware Convolutional Neural Network for Grading of Colorectal Cancer Histology Images , 2019, IEEE Transactions on Medical Imaging.

[19]  Tom A. B. Snijders,et al.  Social Network Analysis , 2011, International Encyclopedia of Statistical Science.

[20]  G. Pazour,et al.  Ror2 signaling regulates Golgi structure and transport through IFT20 for tumor invasiveness , 2017, Scientific Reports.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  Mostafa Jahanifar,et al.  Automatic zone identification in blood smear images using optimal set of features , 2016, 2016 23rd Iranian Conference on Biomedical Engineering and 2016 1st International Iranian Conference on Biomedical Engineering (ICBME).

[24]  Pavitra Krishnaswamy,et al.  Self-Path: Self-Supervision for Classification of Pathology Images With Limited Annotations , 2020, IEEE Transactions on Medical Imaging.

[25]  N. Rajpoot,et al.  Novel deep learning algorithm predicts the status of molecular pathways and key mutations in colorectal cancer from routine histology images , 2021, medRxiv.

[26]  Nasir Rajpoot,et al.  Deep Learning With Sampling in Colon Cancer Histology , 2019, Front. Bioeng. Biotechnol..

[27]  David B. A. Epstein,et al.  Cellular community detection for tissue phenotyping in colorectal cancer histology images , 2020, Medical Image Anal..