Deep Learning Models for Gastric Signet Ring Cell Carcinoma Classification in Whole Slide Images

Signet ring cell carcinoma (SRCC) of the stomach is a rare type of cancer with a slowly rising incidence. It tends to be more difficult to detect by pathologists mainly due to its cellular morphology and diffuse invasion manner, and it has poor prognosis when detected at an advanced stage. Computational pathology tools that can assist pathologists in detecting SRCC would be of a massive benefit. In this paper, we trained deep learning models using transfer learning, fully-supervised learning, and weakly-supervised learning to predict SRCC in Whole Slide Images (WSIs) using a training set of 1,765 WSIs. We evaluated the models on four different test sets of about 500 images each. The best model achieved a Receiver Operator Curve (ROC) area under the curve (AUC) of at least 0.99 on all four test sets, setting a top baseline performance for SRCC WSI classification.

[1]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[2]  Tomasz Markiewicz,et al.  Convolutional neural networks can accurately distinguish four histologic growth patterns of lung adenocarcinoma in digital slides , 2019, Scientific Reports.

[3]  Rajarsi R. Gupta,et al.  Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images. , 2018, Cell reports.

[4]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[5]  Zhiqiang Hu,et al.  Signet Ring Cell Detection with a Semi-supervised Learning Framework , 2019, IPMI.

[6]  Hong Nguyen,et al.  Differential trends in the intestinal and diffuse types of gastric carcinoma in the United States, 1973-2000: increase in the signet ring cell type. , 2004, Archives of pathology & laboratory medicine.

[7]  Jin Tae Kwak,et al.  Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images , 2018, Medical Image Anal..

[8]  Luiz Eduardo Soares de Oliveira,et al.  Multiple instance learning for histopathological breast cancer image classification , 2019, Expert Syst. Appl..

[9]  Bo Wang,et al.  Weakly supervised mitosis detection in breast histopathology images using concentric loss , 2019, Medical Image Anal..

[10]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[11]  Lin Yu,et al.  Clinicopathological Characteristics and Survival Outcomes of Primary Signet Ring Cell Carcinoma in the Stomach: Retrospective Analysis of Single Center Database , 2015, PloS one.

[12]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[13]  Pheng-Ann Heng,et al.  RMDL: Recalibrated multi-instance deep learning for whole slide gastric image classification , 2019, Medical Image Anal..

[14]  Aleksey Boyko,et al.  Detecting Cancer Metastases on Gigapixel Pathology Images , 2017, ArXiv.

[15]  Seema A Khan,et al.  Society of Surgical Oncology–American Society for Radiation Oncology Consensus Guideline on Margins for Breast-Conserving Surgery With Whole-Breast Irradiation in Stages I and II Invasive Breast Cancer , 2014, Annals of Surgical Oncology.

[16]  Josien P. W. Pluim,et al.  Not‐so‐supervised: A survey of semi‐supervised, multi‐instance, and transfer learning in medical image analysis , 2018, Medical Image Anal..

[17]  N Ito,et al.  Gastric and intestinal phenotypic expressions of human signet ring cell carcinomas revealed by their biochemistry, mucin histochemistry, and ultrastructure. , 1986, Cancer research.

[18]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  T. Arai,et al.  Where does signet-ring cell carcinoma come from and where does it go? , 2019, Gastric Cancer.

[20]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[21]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[22]  Junzhou Huang,et al.  Comprehensive Computational Pathological Image Analysis Predicts Lung Cancer Prognosis , 2017, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[23]  Tomás Lozano-Pérez,et al.  A Framework for Multiple-Instance Learning , 1997, NIPS.

[24]  T. Saito,et al.  Signet ring cell carcinoma of the stomach: a clinicopathological comparison with the other histological types. , 1998, The Tohoku journal of experimental medicine.

[25]  Brendan J. Frey,et al.  Classifying and segmenting microscopy images with deep multiple instance learning , 2015, Bioinform..

[26]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[27]  Max Welling,et al.  Attention-based Deep Multiple Instance Learning , 2018, ICML.

[28]  A. Davey,et al.  Prognostic significance of signet ring gastric cancer. , 2012, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[29]  Seema A Khan,et al.  Society of Surgical Oncology-American Society for Radiation Oncology consensus guideline on margins for breast-conserving surgery with whole-breast irradiation in stages I and II invasive breast cancer. , 2014, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[30]  Takanori Hattori,et al.  Time-dependent expression of intestinal phenotype in signet ring cell carcinomas of the human stomach , 2000, Virchows Archiv.

[31]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[32]  M Yamashina,et al.  A variant of early gastric carcinoma. Histologic and histochemical studies of early signet ring cell carcinomas discovered beneath preserved surface epithelium , 1986, Cancer.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Angelo Sidoni Differential trends in the intestinal and diffuse types of gastric carcinoma. , 2005, Archives of pathology & laboratory medicine.

[35]  Yi Xu,et al.  Decoupled Gradient Harmonized Detector for Partial Annotation: Application to Signet Ring Cell Detection , 2020, ArXiv.

[36]  H. R. Tizhoosh,et al.  Yottixel - An Image Search Engine for Large Archives of Histopathology Whole Slide Images , 2019, ArXiv.

[37]  Mahadev Satyanarayanan,et al.  OpenSlide: A vendor-neutral software foundation for digital pathology , 2013, Journal of pathology informatics.

[38]  Peter Schirmacher,et al.  The 2019 WHO classification of tumours of the digestive system , 2019, Histopathology.

[39]  Noriko Yamamoto,et al.  Histopathologic Analysis of Signet-ring Cell Carcinoma In Situ in Patients With Hereditary Diffuse Gastric Cancer , 2020, The American journal of surgical pathology.

[40]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[42]  Ryszard Maciejewski,et al.  State of the art for gastric signet ring cell carcinoma: from classification, prognosis, and genomic characteristics to specified treatments , 2019, Cancer management and research.

[43]  Daisuke Komura,et al.  Machine Learning Methods for Histopathological Image Analysis , 2017, Computational and structural biotechnology journal.

[44]  Koji Yamazaki,et al.  Weakly-supervised learning for lung carcinoma classification using deep learning , 2020, Scientific Reports.

[45]  Anne Berger,et al.  Signet-ring cell carcinoma of the stomach: Impact on prognosis and specific therapeutic challenge. , 2015, World journal of gastroenterology.

[46]  Zhi-Hua Zhou,et al.  A brief introduction to weakly supervised learning , 2018 .

[47]  T W Burns,et al.  Gastric Xanthoma: Histologic Similarity to Signet Ring Cell Carcinoma , 1982, Journal of clinical gastroenterology.

[48]  Saeed Hassanpour,et al.  Deep Learning for Classification of Colorectal Polyps on Whole-slide Images , 2017, Journal of pathology informatics.

[49]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[50]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[51]  Hai Su,et al.  Graph temporal ensembling based semi-supervised convolutional neural network with noisy labels for histopathology image analysis , 2019, Medical Image Anal..

[52]  P. Brousset,et al.  Accurate diagnosis of lymphoma on whole-slide histopathology images using deep learning , 2020, npj Digital Medicine.

[53]  Mithat Gonen,et al.  Stage-Stratified Prognosis of Signet Ring Cell Histology in Patients Undergoing Curative Resection for Gastric Adenocarcinoma , 2014, Annals of Surgical Oncology.

[54]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[55]  K. Arihiro,et al.  Deep Learning Models for Histopathological Classification of Gastric and Colonic Epithelial Tumours , 2020, Scientific Reports.

[56]  Zhuowen Tu,et al.  Weakly supervised histopathology cancer image segmentation and classification , 2014, Medical Image Anal..

[57]  F. Bosman,et al.  WHO Classification of Tumours of the Digestive System , 2010 .

[58]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[59]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[60]  Saeed Hassanpour,et al.  Pathologist-level classification of histologic patterns on resected lung adenocarcinoma slides with deep neural networks , 2019, Scientific Reports.

[61]  Elizabeth A. Montgomery,et al.  Atlas of Gastrointestinal Pathology: A Pattern Based Approach to Non-Neoplastic Biopsies , 2014 .