Implementation of artificial intelligence in upper gastrointestinal endoscopy

Abstract The application of artificial intelligence (AI) using deep learning has significantly expanded in the field of esophagogastric endoscopy. Recent studies have shown promising results in detecting and differentiating early gastric cancer using AI tools built using white light, magnified, or image‐enhanced endoscopic images. Some studies have reported the use of AI tools to predict the depth of early gastric cancer based on endoscopic images. Similarly, studies based on using AI for detecting early esophageal cancer have also been reported, with an accuracy comparable to that of endoscopy specialists. Moreover, an AI system, developed to diagnose pharyngeal cancer, has shown promising performance with high sensitivity. These reports suggest that, if introduced for regular use in clinical settings, AI systems can significantly reduce the burden on physicians. This review summarizes the current status of AI applications in the upper gastrointestinal tract and presents directions for clinical practice implementation and future research.

[1]  Prateek Sharma,et al.  Effect of a deep learning-based system on the miss rate of gastric neoplasms during upper gastrointestinal endoscopy: a single-centre, tandem, randomised controlled trial. , 2021, The lancet. Gastroenterology & hepatology.

[2]  Shria Kumar,et al.  Eastern European and Asian-born populations are prone to gastric cancer: an epidemiologic analysis of foreign-born populations and gastric cancer , 2021, Annals of gastroenterology.

[3]  Jie Zhou,et al.  A Novel Model Based on Deep Convolutional Neural Network Improves Diagnostic Accuracy of Intramucosal Gastric Cancer (With Video) , 2021, Frontiers in Oncology.

[4]  Lian-lian Wu,et al.  Artificial intelligence in diagnosis of gastric precancerous conditions by image-enhanced endoscopy: a multicenter, diagnostic study (with video). , 2021, Gastrointestinal endoscopy.

[5]  K. Yao,et al.  Usefulness of an artificial intelligence system for the detection of esophageal squamous cell carcinoma evaluated with videos simulating overlooking situation , 2021, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[6]  Y. Zhong,et al.  Comparative study on artificial intelligence systems for detecting early esophageal squamous cell carcinoma between narrow-band and white-light imaging , 2021, World journal of gastroenterology.

[7]  Huaping Xie,et al.  Evaluation of the effects of an artificial intelligence system on endoscopy quality and preliminary testing of its performance in detecting early gastric cancer: a randomized controlled trial , 2021, Endoscopy.

[8]  Hao-Yi Syu,et al.  Endoscopic Images by a Single-Shot Multibox Detector for the Identification of Early Cancerous Lesions in the Esophagus: A Pilot Study , 2021, Cancers.

[9]  X. Zuo,et al.  Real‐time artificial intelligence for endoscopic diagnosis of early esophageal squamous cell cancer (with video) , 2020, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[10]  Wei Zhang,et al.  Development and validation of a real-time artificial intelligence-assisted system for detecting early gastric cancer: A multicentre retrospective diagnostic study , 2020, EBioMedicine.

[11]  I. Oda,et al.  Real‐time pharyngeal cancer detection utilizing artificial intelligence: Journey from the proof of concept to the clinical use , 2020, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[12]  Aimin Li,et al.  Artificial Intelligence-Assisted Colonoscopy for Detection of Colon Polyps: a Prospective, Randomized Cohort Study , 2020, Journal of Gastrointestinal Surgery.

[13]  R. Ishihara,et al.  Real-time assessment of video images for esophageal squamous cell carcinoma invasion depth using artificial intelligence , 2020, Journal of Gastroenterology.

[14]  R. Ishihara,et al.  Diagnosis of pharyngeal cancer on endoscopic video images by Mask region‐based convolutional neural network , 2020, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[15]  N. Yamamichi,et al.  Highly accurate artificial intelligence systems to predict the invasion depth of gastric cancer: efficacy of conventional white-light imaging, nonmagnifying narrow-band imaging, and indigo-carmine dye contrast imaging. , 2020, Gastrointestinal endoscopy.

[16]  R. Ishihara,et al.  Artificial intelligence for the detection of esophageal and esophagogastric junctional adenocarcinoma , 2020, Journal of gastroenterology and hepatology.

[17]  Takuya Yamada,et al.  Comparison of performances of artificial intelligence versus expert endoscopists for real-time assisted diagnosis of esophageal squamous cell carcinoma (with video). , 2020, Gastrointestinal endoscopy.

[18]  Ju Han Kim,et al.  Prediction of Submucosal Invasion for Gastric Neoplasms in Endoscopic Images Using Deep-Learning , 2020, Journal of clinical medicine.

[19]  H. Kawachi,et al.  Endoscopic three-categorical diagnosis of Helicobacter pylori infection using linked color imaging and deep learning: a single-center prospective study (with video) , 2020, Gastric Cancer.

[20]  M. Wallace,et al.  Efficacy of Real-Time Computer-Aided Detection of Colorectal Neoplasia in a Randomized Trial. , 2020, Gastroenterology.

[21]  S. Shichijo,et al.  Detecting early gastric cancer: Comparison between the diagnostic ability of convolutional neural networks and endoscopists , 2020, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[22]  T. Hiroyasu,et al.  Potential of automatic diagnosis system with linked color imaging for diagnosis of Helicobacter pylori infection , 2020, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[23]  Masahiro Yoshida,et al.  Endoscopic submucosal dissection/endoscopic mucosal resection guidelines for esophageal cancer , 2020, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[24]  T. Tada,et al.  Artificial intelligence‐based detection of pharyngeal cancer using convolutional neural networks , 2020, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[25]  Japanese Gastric Cancer Association.  Japanese gastric cancer treatment guidelines 2018 (5th edition) , 2020, Gastric Cancer.

[26]  Kai Zhang,et al.  Diagnosing chronic atrophic gastritis by gastroscopy using artificial intelligence. , 2020, Digestive and liver disease : official journal of the Italian Society of Gastroenterology and the Italian Association for the Study of the Liver.

[27]  Xiu-Li Zuo,et al.  Impact of real-time automatic quality control system on colorectal polyp and adenoma detection: a prospective randomized controlled study (with video). , 2020, Gastrointestinal endoscopy.

[28]  R. Ishihara,et al.  Endoscopic detection and differentiation of esophageal lesions using a deep neural network. , 2020, Gastrointestinal endoscopy.

[29]  Takuya Yamada,et al.  Application of artificial intelligence using convolutional neural networks in determining the invasion depth of esophageal squamous cell carcinoma , 2020, Esophagus.

[30]  W. Zhou,et al.  Detection of colorectal adenomas with a real-time computer-aided system (ENDOANGEL): a randomised controlled study. , 2020, The lancet. Gastroenterology & hepatology.

[31]  Andrew Q. Ninh,et al.  Artificial intelligence using convolutional neural networks for real-time detection of early esophageal neoplasia in Barrett's esophagus (with video). , 2020, Gastrointestinal endoscopy.

[32]  E. Schoon,et al.  Deep learning algorithm detection of Barrett's neoplasia with high accuracy during live endoscopic procedures: a pilot study (with video). , 2020, Gastrointestinal endoscopy.

[33]  Xu Zhang,et al.  High Accuracy of Convolutional Neural Network for Evaluation of Helicobacter pylori Infection Based on Endoscopic Images: Preliminary Experience , 2019, Clinical and translational gastroenterology.

[34]  Ying Jin,et al.  Real-time artificial intelligence for detection of upper gastrointestinal cancer by endoscopy: a multicentre, case-control, diagnostic study. , 2019, The Lancet. Oncology.

[35]  A. Meining,et al.  Deep-Learning System Detects Neoplasia in Patients With Barrett's Esophagus With Higher Accuracy Than Endoscopists in a Multi-Step Training and Validation Study with Benchmarking. , 2019, Gastroenterology.

[36]  Y. Zhong,et al.  Using deep learning system in endoscopy for screening of early esophageal squamous cell carcinoma (with video). , 2019, Gastrointestinal endoscopy.

[37]  Robert Mendel,et al.  Real-time use of artificial intelligence in the evaluation of cancer in Barrett’s oesophagus , 2019, Gut.

[38]  Takuya Yamada,et al.  Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. , 2019, Gastrointestinal endoscopy.

[39]  S. Choi,et al.  A Lesion-Based Convolutional Neural Network Improves Endoscopic Detection and Depth Prediction of Early Gastric Cancer , 2019, Journal of clinical medicine.

[40]  Andreas Keller,et al.  Deep-learning based detection of gastric precancerous conditions , 2019, Gut.

[41]  R. Ishihara,et al.  Long-term outcomes of endoscopic resection and metachronous cancer after endoscopic resection for adenocarcinoma of the esophagogastric junction in Japan. , 2019, Gastrointestinal endoscopy.

[42]  Jing Cheng,et al.  Application of convolutional neural network in the diagnosis of the invasion depth of gastric cancer based on conventional endoscopy. , 2019, Gastrointestinal endoscopy.

[43]  Peng Li,et al.  A deep neural network improves endoscopic detection of early gastric cancer without blind spots , 2019, Endoscopy.

[44]  T. Wittenberg,et al.  Automated polyp detection in the colorectum: a prospective study (with videos). , 2019, Gastrointestinal endoscopy.

[45]  T. Berzin,et al.  Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study , 2019, Gut.

[46]  Xuqiang Bian,et al.  Study on detection rate of polyps and adenomas in artificial-intelligence-aided colonoscopy , 2019, Saudi journal of gastroenterology : official journal of the Saudi Gastroenterology Association.

[47]  R. Ishihara,et al.  Application of convolutional neural networks for evaluating Helicobacter pylori infection status on the basis of endoscopic images , 2019, Scandinavian journal of gastroenterology.

[48]  Tomohiro Tada,et al.  Detecting gastric cancer from video images using convolutional neural networks , 2018, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[49]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[50]  Masahiro Yoshida,et al.  Esophageal cancer practice guidelines 2017 edited by the Japan esophageal society: part 2 , 2018, Esophagus.

[51]  Masahiro Yoshida,et al.  Esophageal cancer practice guidelines 2017 edited by the Japan Esophageal Society: part 1 , 2018, Esophagus.

[52]  K. Mori,et al.  Real-Time Use of Artificial Intelligence in Identification of Diminutive Polyps During Colonoscopy , 2018, Annals of Internal Medicine.

[53]  Keisuke Hori,et al.  Automatic detection of early gastric cancer in endoscopic images using a transferring convolutional neural network , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[54]  S. Motoyama,et al.  Is the incidence of esophageal adenocarcinoma increasing in Japan? Trends from the data of a hospital-based registration system in Akita Prefecture, Japan , 2018, Journal of Gastroenterology.

[55]  H. Kawachi,et al.  Artificial intelligence diagnosis of Helicobacter pylori infection using blue laser imaging-bright and linked color imaging: a single-center prospective study , 2018, Annals of gastroenterology.

[56]  M. Fujishiro,et al.  Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images , 2018, Gastric Cancer.

[57]  S. Nomura,et al.  Application of Convolutional Neural Networks in the Diagnosis of Helicobacter pylori Infection Based on Endoscopic Images , 2017, EBioMedicine.

[58]  T. Oyama,et al.  A Scoring System to Stratify Curability after Endoscopic Submucosal Dissection for Early Gastric Cancer: “eCura system” , 2017, The American Journal of Gastroenterology.

[59]  N. Uedo,et al.  Endoscopic imaging modalities for diagnosing invasion depth of superficial esophageal squamous cell carcinoma: a systematic review and meta-analysis , 2017, BMC Gastroenterology.

[60]  C. Hassan,et al.  Endoscopic management of Barrett’s esophagus: European Society of Gastrointestinal Endoscopy (ESGE) Position Statement , 2017, Endoscopy.

[61]  W. Bernardo,et al.  Narrow band imaging versus lugol chromoendoscopy to diagnose squamous cell carcinoma of the esophagus: a systematic review and meta-analysis , 2017, BMC Cancer.

[62]  B. Weusten,et al.  Detection of lesions in dysplastic Barrett’s esophagus by community and expert endoscopists , 2016, Endoscopy.

[63]  I. Choi,et al.  Quality of Life after Endoscopic Submucosal Dissection for Early Gastric Cancer: A Prospective Multicenter Cohort Study , 2016, Gut and liver.

[64]  M. Rugge,et al.  Endoscopic submucosal dissection: European Society of Gastrointestinal Endoscopy (ESGE) Guideline , 2015, Endoscopy.

[65]  S. Menon,et al.  How commonly is upper gastrointestinal cancer missed at endoscopy? A meta-analysis , 2014, Endoscopy International Open.

[66]  L. Gossner,et al.  Long-term efficacy and safety of endoscopic resection for patients with mucosal adenocarcinoma of the esophagus. , 2014, Gastroenterology.

[67]  N. Uedo,et al.  Long-Term Outcome and Metastatic Risk After Endoscopic Resection of Superficial Esophageal Squamous Cell Carcinoma , 2013, The American Journal of Gastroenterology.

[68]  Masashi Yoshida,et al.  Medical image analysis: computer-aided diagnosis of gastric cancer invasion on endoscopic images , 2012, Surgical Endoscopy.

[69]  N. Uedo,et al.  Prospective evaluation of narrow-band imaging endoscopy for screening of esophageal squamous mucosal high-grade neoplasia in experienced and less experienced endoscopists. , 2010, Diseases of the esophagus : official journal of the International Society for Diseases of the Esophagus.

[70]  H. Tajiri,et al.  Early detection of superficial squamous cell carcinoma in the head and neck region and esophagus by narrow band imaging: a multicenter randomized controlled trial. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[71]  E. Fukuda,et al.  Endoscopic submucosal dissection for early gastric cancer: a large-scale feasibility study , 2008, Gut.

[72]  O. Hosokawa,et al.  Difference in accuracy between gastroscopy and colonoscopy for detection of cancer. , 2007, Hepato-gastroenterology.

[73]  B. Sheu,et al.  Computerized Diagnosis of Helicobacter pylori Infection and Associated Gastric Inflammation from Endoscopic Images by Refined Feature Selection Using a Neural Network , 2004, Endoscopy.

[74]  Y. Nakanishi,et al.  Incidence of lymph node metastasis from early gastric cancer: estimation with a large number of cases at two large centers , 2000, Gastric Cancer.

[75]  H. Ono,et al.  A new endoscopic mucosal resection procedure using an insulation-tipped electrosurgical knife for rectal flat lesions: report of two cases. , 1999, Gastrointestinal endoscopy.

[76]  T. Tsuchida,et al.  Ability of arti�cial intelligence to detect T1 esophageal squamous cell carcinoma from endoscopic videos: supportive effects of real-time assistance , 2020 .

[77]  Bing Hu,et al.  Real-time automated diagnosis of precancerous lesion and early esophageal squamous cell carcinoma using a deep learning model (with videos). , 2019, Gastrointestinal endoscopy.

[78]  T. Oyama,et al.  Long-term oncological outcomes of submucosal manipulation during non-curative endoscopic submucosal dissection for submucosal invasive gastric cancer: a multicenter retrospective study in Japan , 2017, Surgical Endoscopy.

[79]  Y. Kakeji,et al.  Five-year survival analysis of surgically resected gastric cancer cases in Japan: a retrospective analysis of more than 100,000 patients from the nationwide registry of the Japanese Gastric Cancer Association (2001–2007) , 2017, Gastric Cancer.

[80]  E. McArthur,et al.  Esophageal carcinoma. , 2014, The New England journal of medicine.

[81]  M. Azuma,et al.  Long-term outcomes of endoscopic submucosal dissection for early gastric cancer: a retrospective comparison with conventional endoscopic resection in a single center , 2013, Gastric Cancer.

[82]  T. Yoshikawa,et al.  Is Adenocarcinoma of the Esophagogastric Junction Different between Japan and Western Countries? The Incidence and Clinicopathological Features at a Japanese High-Volume Cancer Center , 2008, World Journal of Surgery.