Artificial intelligence and upper gastrointestinal endoscopy: Current status and future perspective

With recent breakthroughs in artificial intelligence, computer‐aided diagnosis (CAD) for upper gastrointestinal endoscopy is gaining increasing attention. Main research focuses in this field include automated identification of dysplasia in Barrett's esophagus and detection of early gastric cancers. By helping endoscopists avoid missing and mischaracterizing neoplastic change in both the esophagus and the stomach, these technologies potentially contribute to solving current limitations of gastroscopy. Currently, optical diagnosis of early‐stage dysplasia related to Barrett's esophagus can be precisely achieved only by endoscopists proficient in advanced endoscopic imaging, and the false‐negative rate for detecting gastric cancer is approximately 10%. Ideally, these novel technologies should work during real‐time gastroscopy to provide on‐site decision support for endoscopists regardless of their skill; however, previous studies of these topics remain ex vivo and experimental in design. Therefore, the feasibility, effectiveness, and safety of CAD for upper gastrointestinal endoscopy in clinical practice remain unknown, although a considerable number of pilot studies have been conducted by both engineers and medical doctors with excellent results. This review summarizes current publications relating to CAD for upper gastrointestinal endoscopy from the perspective of endoscopists and aims to indicate what is required for future research and implementation in clinical practice.

[1]  N. Sasaki,et al.  Helicobacter pylori infection and the development of gastric cancer. , 2001, The New England journal of medicine.

[2]  Miguel A Hernán,et al.  Population-Based Colonoscopy Screening for Colorectal Cancer: A Randomized Clinical Trial. , 2016, JAMA internal medicine.

[3]  S. Nomura,et al.  Application of Convolutional Neural Networks in the Diagnosis of Helicobacter pylori Infection Based on Endoscopic Images , 2017, EBioMedicine.

[4]  Takumi Itoh,et al.  Deep learning analyzes Helicobacter pylori infection by upper gastrointestinal endoscopy images , 2018, Endoscopy International Open.

[5]  Nicolas Chapados,et al.  Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model , 2017, Gut.

[6]  Hsuan-Ting Chang,et al.  Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging. , 2017, Gastrointestinal endoscopy.

[7]  Satoshi Tsukioka,et al.  Impact of endoscopic screening on mortality reduction from gastric cancer. , 2015, World journal of gastroenterology.

[8]  A. Uhl,et al.  Computer-Aided Decision Support Systems for Endoscopy in the Gastrointestinal Tract: A Review , 2011, IEEE Reviews in Biomedical Engineering.

[9]  Hiroyuki Osawa,et al.  Present and future status of flexible spectral imaging color enhancement and blue laser imaging technology , 2014, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[10]  Suet-Peng Yong,et al.  A comparison of deep learning and hand crafted features in medical image modality classification , 2016, 2016 3rd International Conference on Computer and Information Sciences (ICCOINS).

[11]  P. Galle,et al.  Molecular endoscopic imaging: the future is bright , 2019, Therapeutic advances in gastrointestinal endoscopy.

[12]  N. Yagi,et al.  Diagnosis of Helicobacter pylori infection in gastric mucosa by endoscopic features: A multicenter prospective study , 2013, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[13]  Erik Schoon,et al.  Endoscopic trimodal imaging versus standard video endoscopy for detection of early Barrett's neoplasia: a multicenter, randomized, crossover study in general practice. , 2011, Gastrointestinal endoscopy.

[14]  Paul Fockens,et al.  A randomized crossover study comparing light-induced fluorescence endoscopy with standard videoendoscopy for the detection of early neoplasia in Barrett's esophagus. , 2005, Gastrointestinal endoscopy.

[15]  Kenneth K Wang,et al.  The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on imaging in Barrett's Esophagus. , 2012, Gastrointestinal endoscopy.

[16]  S. Zinger,et al.  Computer-aided detection of early neoplastic lesions in Barrett’s esophagus , 2016, Endoscopy.

[17]  Masashi Yoshida,et al.  Medical image analysis: computer-aided diagnosis of gastric cancer invasion on endoscopic images , 2012, Surgical Endoscopy.

[18]  Shoichi Saito,et al.  Computer-aided diagnosis of neoplastic colorectal lesions using ‘real-time’ numerical color analysis during autofluorescence endoscopy , 2013, European journal of gastroenterology & hepatology.

[19]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[20]  M. Kaminishi,et al.  Ex vivo pilot study using computed analysis of endo-cytoscopic images to differentiate normal and malignant squamous cell epithelia in the oesophagus. , 2007, Digestive and liver disease : official journal of the Italian Society of Gastroenterology and the Italian Association for the Study of the Liver.

[21]  K. Chayama,et al.  A Computer System To Be Used With Laser-based Endoscopy for Quantitative Diagnosis of Early Gastric Cancer , 2015, Journal of clinical gastroenterology.

[22]  Alexander D. Weston,et al.  What Does Deep Learning See? Insights From a Classifier Trained to Predict Contrast Enhancement Phase From CT Images. , 2018, AJR. American journal of roentgenology.

[23]  K. Chayama,et al.  Quantitative identification of mucosal gastric cancer under magnifying endoscopy with flexible spectral imaging color enhancement , 2013, Journal of gastroenterology and hepatology.

[24]  S. Dawsey,et al.  Quantitative analysis of high-resolution microendoscopic images for diagnosis of esophageal squamous cell carcinoma. , 2015, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[25]  S. Faraj,et al.  Diagnostic accuracy of probe-based confocal laser endomicroscopy in Lugol-unstained esophageal superficial lesions of patients with head and neck cancer. , 2017, Gastrointestinal endoscopy.

[26]  H. Kawachi,et al.  Artificial intelligence diagnosis of Helicobacter pylori infection using blue laser imaging-bright and linked color imaging: a single-center prospective study , 2018, Annals of gastroenterology.

[27]  K. Sugano,et al.  Diagnosis of extent of early gastric cancer using flexible spectral imaging color enhancement. , 2012, World journal of gastrointestinal endoscopy.

[28]  K. Chayama,et al.  Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. , 2016, Gastrointestinal endoscopy.

[29]  Shinji Tanaka,et al.  Evaluation and validation of computed virtual chromoendoscopy in early gastric cancer. , 2009, Gastrointestinal endoscopy.

[30]  T. Kawano,et al.  Endocytoscopic observation of various esophageal lesions at ×600: can nuclear abnormality be recognized? , 2015, Diseases of the esophagus : official journal of the International Society for Diseases of the Esophagus.

[31]  S. Dawsey,et al.  A tablet-interfaced high-resolution microendoscope with automated image interpretation for real-time evaluation of esophageal squamous cell neoplasia. , 2016, Gastrointestinal endoscopy.

[32]  K. Mori,et al.  Real-Time Use of Artificial Intelligence in Identification of Diminutive Polyps During Colonoscopy , 2018, Annals of Internal Medicine.

[33]  Hisao Tajiri,et al.  Early detection of superficial squamous cell carcinoma in the head and neck region and esophagus by narrow band imaging: a multicenter randomized controlled trial. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[34]  D. Kikuchi,et al.  Diagnostic algorithm of magnifying endoscopy with narrow band imaging for superficial non‐ampullary duodenal epithelial tumors , 2014, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[35]  E. Schoon,et al.  Computer-aided detection of early Barrett's neoplasia using volumetric laser endomicroscopy. , 2017, Gastrointestinal endoscopy.

[36]  Li Fei-Fei,et al.  Bedside Computer Vision - Moving Artificial Intelligence from Driver Assistance to Patient Safety. , 2018, The New England journal of medicine.

[37]  A. Jemal,et al.  Global Cancer Statistics , 2011 .

[38]  M. Fujishiro,et al.  Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images , 2018, Gastric Cancer.

[39]  T. Omori,et al.  Endoscopic diagnosis of early squamous neoplasia of the esophagus with iodine staining: High‐grade intra‐epithelial neoplasia turns pink within a few minutes , 2008 .

[40]  E. Dekker,et al.  Automatic optical diagnosis of small colorectal lesions by laser-induced autofluorescence , 2014, Endoscopy.

[41]  S. Menon,et al.  How commonly is upper gastrointestinal cancer missed at endoscopy? A meta-analysis , 2014, Endoscopy International Open.

[42]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[43]  S. Kudo,et al.  Computer-aided diagnosis for colonoscopy , 2017, Endoscopy.

[44]  Wladyslaw Januszewicz,et al.  Quality indicators in diagnostic upper gastrointestinal endoscopy , 2020, Therapeutic advances in gastroenterology.

[45]  Paul Fockens,et al.  Standard endoscopy with random biopsies versus narrow band imaging targeted biopsies in Barrett's oesophagus: a prospective, international, randomised controlled trial , 2012, Gut.

[46]  K. Yao,et al.  Evaluation of an e-learning system for diagnosis of gastric lesions using magnifying narrow-band imaging: a multicenter randomized controlled study , 2017, Endoscopy.

[47]  M. Fujishiro,et al.  Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. , 2019, Gastrointestinal endoscopy.

[48]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[49]  Hayato Itoh,et al.  Artificial Intelligence-Assisted Polyp Detection for Colonoscopy: Initial Experience. , 2018, Gastroenterology.

[50]  B. Sheu,et al.  Computerized Diagnosis of Helicobacter pylori Infection and Associated Gastric Inflammation from Endoscopic Images by Refined Feature Selection Using a Neural Network , 2004, Endoscopy.

[51]  M. Mizokami,et al.  Accuracy of endoscopic diagnosis of Helicobacter pylori infection according to level of endoscopic experience and the effect of training , 2013, BMC Gastroenterology.

[52]  Y. Naito,et al.  Magnifying Endoscopy with Blue Laser Imaging Improves the Microstructure Visualization in Early Gastric Cancer: Comparison of Magnifying Endoscopy with Narrow-Band Imaging , 2017, Gastroenterology research and practice.

[53]  Jing Cheng,et al.  Application of convolutional neural network in the diagnosis of the invasion depth of gastric cancer based on conventional endoscopy. , 2019, Gastrointestinal endoscopy.

[54]  K. Chayama,et al.  Clinical Usefulness of the VS Classification System Using Magnifying Endoscopy with Blue Laser Imaging for Early Gastric Cancer , 2017, Gastroenterology research and practice.

[55]  K. Ho,et al.  Artificial inelegance in endoscopy: An updated auricle of Delphi! , 2019, Saudi journal of gastroenterology : official journal of the Saudi Gastroenterology Association.

[56]  K. Yao,et al.  Magnifying endoscopy for diagnosing and delineating early gastric cancer. , 2009, Endoscopy.

[57]  Helmut Neumann,et al.  In vivo real-time assessment of colorectal polyp histology using an optical biopsy forceps system based on laser-induced fluorescence spectroscopy , 2016, Endoscopy.