Large-scale Gastric Cancer Screening and Localization Using Multi-task Deep Neural Network

Gastric cancer is one of the most common cancers, which ranks third among the leading causes of cancer death. Biopsy of gastric mucosa is a standard procedure in gastric cancer screening test. However, manual pathological inspection is labor-intensive and time-consuming. Besides, it is challenging for an automated algorithm to locate the small lesion regions in the gigapixel whole-slide image and make the decision this http URL tackle these issues, we collected large-scale whole-slide image dataset with detailed lesion region annotation and designed a whole-slide image analyzing framework consisting of 3 networks which could not only determine the screening result but also present the suspicious areas to the pathologist for reference. Experiments demonstrated that our proposed framework achieves sensitivity of 97.05% and specificity of 92.72% in screening task and Dice coefficient of 0.8331 in segmentation task. Furthermore, we tested our best model in real-world scenario on 10,315 whole-slide images collected from 4 medical centers.

[1]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[3]  Kai Zhao,et al.  Res2Net: A New Multi-Scale Backbone Architecture , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Adrien Depeursinge,et al.  Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles , 2016, Medical Image Anal..

[6]  Wei Liu,et al.  Towards Large-Scale Histopathological Image Analysis: Hashing-Based Image Retrieval , 2015, IEEE Transactions on Medical Imaging.

[7]  Shadi Albarqouni,et al.  AggNet : Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images , 2016 .

[8]  David B. A. Epstein,et al.  Fast and Accurate Tumor Segmentation of Histology Images using Persistent Homology and Deep Convolutional Features , 2018, Medical Image Anal..

[9]  Jun Xu,et al.  Fusing Heterogeneous Features From Stacked Sparse Autoencoder for Histopathological Image Analysis , 2016, IEEE Journal of Biomedical and Health Informatics.

[10]  Zhiqiang Hu,et al.  Signet Ring Cell Detection with a Semi-supervised Learning Framework , 2019, IPMI.

[11]  Tomoharu Kiyuna,et al.  Automated histological classification of whole-slide images of gastric biopsy specimens , 2018, Gastric Cancer.

[12]  Hai Su,et al.  Region segmentation in histopathological breast cancer images using deep convolutional neural network , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[13]  Hao Chen,et al.  ScanNet: A Fast and Dense Scanning Framework for Metastastic Breast Cancer Detection from Whole-Slide Image , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[14]  Danna Zhou,et al.  d. , 1840, Microbial pathogenesis.

[15]  Nassir Navab,et al.  Multi-task learning of a deep k-nearest neighbour network for histopathological image classification and retrieval , 2019, bioRxiv.

[16]  Zhiqiang Hu,et al.  Accurate Nuclear Segmentation with Center Vector Encoding , 2019, IPMI.

[17]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[18]  Aleksey Boyko,et al.  Detecting Cancer Metastases on Gigapixel Pathology Images , 2017, ArXiv.

[19]  Shaoting Zhang,et al.  SenseCare: A Research Platform for Medical Image Informatics and Interactive 3D Visualization , 2020, ArXiv.

[20]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[21]  Akira Saito,et al.  Automated gastric cancer diagnosis on H&E-stained sections; ltraining a classifier on a large scale with multiple instance machine learning , 2013, Medical Imaging.

[22]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[23]  Lorenzo Porzi,et al.  In-place Activated BatchNorm for Memory-Optimized Training of DNNs , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  J. A. van der Laak,et al.  Hue-saturation-density (HSD) model for stain recognition in digital images from transmitted light microscopy. , 2000, Cytometry.

[27]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[29]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  Hao Chen,et al.  DCAN: Deep contour‐aware networks for object instance segmentation from histology images , 2017, Medical Image Anal..

[32]  Heechan Yang,et al.  Guided Soft Attention Network for Classification of Breast Cancer Histopathology Images , 2020, IEEE Transactions on Medical Imaging.

[33]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[34]  Hai Su,et al.  High-throughput histopathological image analysis via robust cell segmentation and hashing , 2015, Medical Image Anal..

[35]  Wenyuan Li,et al.  Path R-CNN for Prostate Cancer Diagnosis and Gleason Grading of Histological Images , 2019, IEEE Transactions on Medical Imaging.

[36]  Tomoharu Kiyuna,et al.  Pathological Diagnosis of Gastric Cancers with a Novel Computerized Analysis System , 2017, Journal of pathology informatics.

[37]  Hai Su,et al.  Pathologist-level interpretable whole-slide cancer diagnosis with deep learning , 2019, Nat. Mach. Intell..

[38]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[39]  Junzhou Huang,et al.  WSISA: Making Survival Prediction from Whole Slide Histopathological Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Shuiwang Ji,et al.  Residual Deconvolutional Networks for Brain Electron Microscopy Image Segmentation , 2017, IEEE Transactions on Medical Imaging.

[41]  Bo Hu,et al.  Unsupervised Learning for Cell-Level Visual Representation in Histopathology Images With Generative Adversarial Networks , 2017, IEEE Journal of Biomedical and Health Informatics.

[42]  LinLin Shen,et al.  Deep learning based gastric cancer identification , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[43]  Yi Li,et al.  Deformable Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[44]  Trevor Darrell,et al.  Deep Layer Aggregation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[45]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[47]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[48]  Linda G. Shapiro,et al.  Multi-Instance Multi-Label Learning for Multi-Class Classification of Whole Slide Breast Histopathology Images , 2018, IEEE Transactions on Medical Imaging.

[49]  Henning Müller,et al.  Large‐scale retrieval for medical image analytics: A comprehensive review , 2018, Medical Image Anal..

[50]  Michael Kampffmeyer,et al.  Reinforced Auto-Zoom Net: Towards Accurate and Fast Breast Cancer Segmentation in Whole-slide Images , 2018, DLMIA/ML-CDS@MICCAI.