Artificial intelligence in upper GI endoscopy ‐ current status, challenges and future promise

White‐light endoscopy with biopsy is the current gold standard modality for detecting and diagnosing upper gastrointestinal (GI) pathology. However, missed lesions remain a challenge. To overcome interobserver variability and learning curve issues, artificial intelligence (AI) has recently been introduced to assist endoscopists in the detection and diagnosis of upper GI neoplasia. In contrast to AI in colonoscopy, current AI studies for upper GI endoscopy are smaller pilot studies. Researchers currently lack large volume, well‐annotated, high‐quality datasets in gastric cancer, dysplasia in Barrett's esophagus and early esophageal squamous cell cancer. This review will look at the latest studies of AI in upper GI endoscopy, discuss some of the challenges facing researchers, and predict what the future may hold in this rapidly changing field.

[1]  G. Friedman,et al.  Helicobacter pylori infection and the risk of gastric carcinoma. , 1991, The New England journal of medicine.

[2]  S. Paterson-Brown,et al.  Gastric adenocarcinoma missed at endoscopy. , 2002, Journal of the Royal College of Surgeons of Edinburgh.

[3]  M. Juhola,et al.  Evaluation of the diagnostic accuracy of gastroscopy to detect gastric tumours: clinicopathological features and prognosis of patients with gastric cancer missed on endoscopy , 2005, European journal of gastroenterology & hepatology.

[4]  Michael Vieth,et al.  In vivo histology of Barrett's esophagus and associated neoplasia by confocal laser endomicroscopy. , 2006, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[5]  M. Teh,et al.  Diagnostic potential of near-infrared Raman spectroscopy in the stomach: differentiating dysplasia from normal tissue , 2008, British Journal of Cancer.

[6]  M. Piazuelo,et al.  The gastric precancerous cascade , 2012, Journal of digestive diseases.

[7]  Mads S. Bergholt,et al.  Fiberoptic confocal raman spectroscopy for real-time in vivo diagnosis of dysplasia in Barrett's esophagus. , 2014, Gastroenterology.

[8]  K. Chayama,et al.  A Computer System To Be Used With Laser-based Endoscopy for Quantitative Diagnosis of Early Gastric Cancer , 2015, Journal of clinical gastroenterology.

[9]  Michael B Wallace,et al.  Safety and feasibility of volumetric laser endomicroscopy in patients with Barrett's esophagus (with videos). , 2015, Gastrointestinal endoscopy.

[10]  Khek Yu Ho,et al.  Rapid Fiber-optic Raman Spectroscopy for Real-Time In Vivo Detection of Gastric Intestinal Metaplasia during Clinical Gastroscopy , 2016, Cancer Prevention Research.

[11]  M. Teh,et al.  Fiber-optic Raman spectroscopy for in vivo diagnosis of gastric dysplasia. , 2016, Faraday discussions.

[12]  S. Nomura,et al.  Application of Convolutional Neural Networks in the Diagnosis of Helicobacter pylori Infection Based on Endoscopic Images , 2017, EBioMedicine.

[13]  E. Schoon,et al.  Computer-aided detection of early Barrett's neoplasia using volumetric laser endomicroscopy. , 2017, Gastrointestinal endoscopy.

[14]  Hsuan-Ting Chang,et al.  Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging. , 2017, Gastrointestinal endoscopy.

[15]  M. Fujishiro,et al.  Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images , 2018, Gastric Cancer.

[16]  E. Vazquez-Sequeiros,et al.  Rate of missed oesophageal cancer at routine endoscopy and survival outcomes: A multicentric cohort study , 2019, United European gastroenterology journal.

[17]  A. Meining,et al.  Deep-Learning System Detects Neoplasia in Patients With Barrett's Esophagus With Higher Accuracy Than Endoscopists in a Multi-Step Training and Validation Study with Benchmarking. , 2019, Gastroenterology.

[18]  Bin Sun,et al.  Computer-assisted diagnosis of early esophageal squamous cell carcinoma using narrow-band imaging magnifying endoscopy , 2018, Endoscopy.

[19]  Peng Li,et al.  A deep neural network improves endoscopic detection of early gastric cancer without blind spots , 2019, Endoscopy.

[20]  Robert Mendel,et al.  Real-time use of artificial intelligence in the evaluation of cancer in Barrett’s oesophagus , 2019, Gut.

[21]  R. Ishihara,et al.  Endoscopic detection and differentiation of esophageal lesions using a deep neural network. , 2020, Gastrointestinal endoscopy.

[22]  Xu Zhang,et al.  High Accuracy of Convolutional Neural Network for Evaluation of Helicobacter pylori Infection Based on Endoscopic Images: Preliminary Experience , 2019, Clinical and translational gastroenterology.

[23]  Wei Zhou,et al.  Randomised controlled trial of WISENSE, a real-time quality improving system for monitoring blind spots during esophagogastroduodenoscopy , 2019, Gut.

[24]  D. Pleskow,et al.  Endoscopic surveillance of Barrett's esophagus using volumetric laser endomicroscopy with artificial intelligence image enhancement. , 2019, Gastroenterology.

[25]  Y. Zhong,et al.  Using deep learning system in endoscopy for screening of early esophageal squamous cell carcinoma (with video). , 2019, Gastrointestinal endoscopy.

[26]  Takuya Yamada,et al.  Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. , 2019, Gastrointestinal endoscopy.

[27]  Bing Hu,et al.  Real-time automated diagnosis of precancerous lesion and early esophageal squamous cell carcinoma using a deep learning model (with videos). , 2019, Gastrointestinal endoscopy.

[28]  Chaohui Yu,et al.  Convolutional neural network for the diagnosis of early gastric cancer based on magnifying narrow band imaging , 2019, Gastric Cancer.

[29]  M. Fujishiro,et al.  Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. , 2019, Gastrointestinal endoscopy.

[30]  Jing Cheng,et al.  Application of convolutional neural network in the diagnosis of the invasion depth of gastric cancer based on conventional endoscopy. , 2019, Gastrointestinal endoscopy.

[31]  Tomohiro Tada,et al.  Detecting gastric cancer from video images using convolutional neural networks , 2018, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[32]  Kai Zhang,et al.  Diagnosing chronic atrophic gastritis by gastroscopy using artificial intelligence. , 2020, Digestive and liver disease : official journal of the Italian Society of Gastroenterology and the Italian Association for the Study of the Liver.

[33]  Takuya Yamada,et al.  Comparison of performances of artificial intelligence versus expert endoscopists for real-time assisted diagnosis of esophageal squamous cell carcinoma (with video). , 2020, Gastrointestinal endoscopy.

[34]  R. Ishihara,et al.  Real-time assessment of video images for esophageal squamous cell carcinoma invasion depth using artificial intelligence , 2020, Journal of Gastroenterology.

[35]  Andrew Q. Ninh,et al.  Artificial intelligence using convolutional neural networks for real-time detection of early esophageal neoplasia in Barrett's esophagus (with video). , 2020, Gastrointestinal endoscopy.

[36]  Zhan Wu,et al.  Automatic classification of esophageal lesions in endoscopic images using a convolutional neural network , 2020, Annals of translational medicine.