Deep Learning-Based Sparse Whole-Slide Image Analysis for the Diagnosis of Gastric Intestinal Metaplasia

In recent years, deep learning has successfully been applied to automate a wide variety of tasks in diagnostic histopathology. However, fast and reliable localization of small-scale regions-of-interest (ROI) has remained a key challenge, as discriminative morphologic features often occupy only a small fraction of a gigapixelscale whole-slide image (WSI). In this paper, we propose a sparse WSI analysis method for the rapid identification of high-power ROI for WSI-level classification. We develop an evaluation framework inspired by the early classification literature, in order to quantify the tradeoff between diagnostic performance and inference time for sparse analytic approaches. We test our method on a common but timeconsuming task in pathology that of diagnosing gastric intestinal metaplasia (GIM) on hematoxylin and eosin (H&E)-stained slides from endoscopic biopsy specimens. GIM is a well-known precursor lesion along the pathway to development of gastric cancer. We performed a thorough evaluation of the performance and inference time of our approach on a test set of 20 GIM-positive and 86 GIMnegative WSI, finding that our method successfully detects GIM in all positive WSI, with a WSI-level classification area under the receiver operating characteristic curve (AUC) of 0.98 and an average precision (AP) of 0.95. Furthermore, we show that our method can attain these metrics in under one minute on a standard CPU. Our results are applicable toward the goal of developing neural networks that can be easily deployed in clinical settings to support pathologists in quickly localizing and diagnosing small-scale morphologic features in WSI.

[1]  Philip S. Yu,et al.  Early classification on time series , 2012, Knowledge and Information Systems.

[2]  Nicolas Loménie,et al.  Time-efficient sparse analysis of histopathological whole slide images , 2011, Comput. Medical Imaging Graph..

[3]  Hammad Qureshi,et al.  Translational AI and Deep Learning in Diagnostic Pathology , 2019, Front. Med..

[4]  Klaus D. McDonald-Maier,et al.  Integral Images: Efficient Algorithms for Their Computation and Storage in Resource-Constrained Embedded Vision Systems , 2015, Sensors.

[5]  Shuhao Wang,et al.  Emerging role of deep learning‐based artificial intelligence in tumor pathology , 2020, Cancer communications.

[6]  Peter Bankhead,et al.  QuPath: Open source software for digital pathology image analysis , 2017, Scientific Reports.

[7]  Martin Wattenberg,et al.  TensorFlow.js: Machine Learning for the Web and Beyond , 2019, MLSys.

[8]  Andreea Anghel,et al.  A High-Performance System for Robust Stain Normalization of Whole-Slide Images in Histopathology , 2019, Front. Med..

[9]  M. Blanca Piazuelo,et al.  Gastric cáncer: Overview , 2013, Colombia medica.

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Angelo Zullo,et al.  Follow-up of intestinal metaplasia in the stomach: When, how and why. , 2012, World journal of gastrointestinal oncology.

[12]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[13]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[14]  Brendan J. Frey,et al.  Classifying and segmenting microscopy images with deep multiple instance learning , 2015, Bioinform..

[15]  Fernando Nogueira,et al.  Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning , 2016, J. Mach. Learn. Res..

[16]  R. Goyal,et al.  The histologic spectrum of Barrett's esophagus. , 1976, The New England journal of medicine.

[17]  Neofytos Dimitriou,et al.  Deep Learning for Whole Slide Image Analysis: An Overview , 2019, Front. Med..

[18]  Geert J. S. Litjens,et al.  Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology , 2019, Medical Image Anal..

[19]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[20]  David F. Steiner,et al.  Impact of Deep Learning Assistance on the Histopathologic Review of Lymph Nodes for Metastatic Breast Cancer , 2018, The American journal of surgical pathology.

[21]  Jeroen van der Laak,et al.  Automatic Detection of Tumor Budding in Colorectal Carcinoma with Deep Learning , 2018, COMPAY/OMIA@MICCAI.

[22]  Anne L. Martel,et al.  Deep neural network models for computational histopathology: A survey , 2019, Medical Image Anal..

[23]  Pheng-Ann Heng,et al.  Fast ScanNet: Fast and Dense Analysis of Multi-Gigapixel Whole-Slide Images for Cancer Metastasis Detection , 2019, IEEE Transactions on Medical Imaging.

[24]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[25]  Roman Kern,et al.  A Literature Survey of Early Time Series Classification and Deep Learning , 2016, SAMI@iKNOW.

[26]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Saeed Hassanpour,et al.  Finding a Needle in the Haystack: Attention-Based Classification of High Resolution Microscopy Images , 2018, ArXiv.

[29]  D. Doman,et al.  Overview of Current Concepts in Gastric Intestinal Metaplasia and Gastric Cancer. , 2018, Gastroenterology & hepatology.

[30]  Angel Cruz-Roa,et al.  High-throughput adaptive sampling for whole-slide histopathology image analysis (HASHI) via convolutional neural networks: Application to invasive breast cancer detection , 2018, PloS one.

[31]  Prateek Jain,et al.  Multiple Instance Learning for Efficient Sequential Data Classification on Resource-constrained Devices , 2018, NeurIPS.

[32]  M. Banks,et al.  Identifying the pre-malignant stomach: from guidelines to practice. , 2020, Translational gastroenterology and hepatology.