Review of computational methods for the detection and classification of polyps in colonoscopy imaging

Abstract Computer-aided diagnosis (CAD) is a tool with great potential to help endoscopists in the tasks of detecting and histologically classifying colorectal polyps. In recent years, different technologies have been described and their potential utility has been increasingly evidenced, which has generated great expectations among scientific societies. However, most of these works are retrospective and use images of different quality and characteristics which are analysed off line. This review aims to familiarise gastroenterologists with computational methods and the particularities of endoscopic imaging, which have an impact on image processing analysis. Finally, the publicly available image databases, needed to compare and confirm the results obtained with different methods, are presented.

[1]  G. Fernández-Esparrach,et al.  Exploring the clinical potential of an automatic colonic polyp detection method based on the creation of energy maps , 2016, Endoscopy.

[2]  K. Chayama,et al.  Quantitative analysis and development of a computer-aided system for identification of regular pit patterns of colorectal lesions. , 2010, Gastrointestinal endoscopy.

[3]  Aymeric Histace,et al.  GTCreator: a flexible annotation tool for image-based datasets , 2018, International Journal of Computer Assisted Radiology and Surgery.

[4]  Henry Horng-Shing Lu,et al.  Accurate Classification of Diminutive Colorectal Polyps Using Computer-Aided Analysis. , 2017, Gastroenterology.

[5]  R. Doraiswami,et al.  Real-time image processing system for endoscopic applications , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[6]  Aymeric Histace,et al.  Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer , 2014, International Journal of Computer Assisted Radiology and Surgery.

[7]  Helen Close,et al.  Narrow band imaging optical diagnosis of small colorectal polyps in routine clinical practice: the Detect Inspect Characterise Resect and Discard 2 (DISCARD 2) study , 2016, Gut.

[8]  S. Kudo,et al.  Novel computer-aided diagnostic system for colorectal lesions by using endocytoscopy (with videos). , 2015, Gastrointestinal endoscopy.

[9]  K. Chayama,et al.  Computer-aided system for predicting the histology of colorectal tumors by using narrow-band imaging magnifying colonoscopy (with video). , 2012, Gastrointestinal endoscopy.

[10]  K. Mori,et al.  Characterization of Colorectal Lesions Using a Computer-Aided Diagnostic System for Narrow-Band Imaging Endocytoscopy. , 2016, Gastroenterology.

[11]  Nicholas Ayache,et al.  Semi-automated Query Construction for Content-Based Endomicroscopy Video Retrieval , 2014, MICCAI.

[12]  Subhas Banerjee,et al.  Adenoma miss rates associated with a 3-minute versus 6-minute colonoscopy withdrawal time: a prospective, randomized trial. , 2017, Gastrointestinal endoscopy.

[13]  Shoichi Saito,et al.  Computer-aided diagnosis of neoplastic colorectal lesions using ‘real-time’ numerical color analysis during autofluorescence endoscopy , 2013, European journal of gastroenterology & hepatology.

[14]  J. Llach,et al.  Computer-aided prediction of polyp histology on white light colonoscopy using surface pattern analysis , 2018, Endoscopy.

[15]  Fernando Vilariño,et al.  Towards automatic polyp detection with a polyp appearance model , 2012, Pattern Recognit..

[16]  Jorge Bernal,et al.  Bright spot regions segmentation and classification for specular highlights detection in colonoscopy videos , 2017, Machine Vision and Applications.

[17]  Dimitris A. Karras,et al.  Computer-aided tumor detection in endoscopic video using color wavelet features , 2003, IEEE Transactions on Information Technology in Biomedicine.

[18]  K. Mori,et al.  Artificial intelligence and colonoscopy: Current status and future perspectives , 2019, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[19]  Nicolas Chapados,et al.  Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model , 2017, Gut.

[20]  Fernando Vilariño,et al.  Texture-Based Polyp Detection in Colonoscopy , 2009, Bildverarbeitung für die Medizin.

[21]  Masahiro Oda,et al.  Impact of an automated system for endocytoscopic diagnosis of small colorectal lesions: an international web-based study , 2016, Endoscopy.

[22]  Ming Liu,et al.  Colonic Polyp Detection in Endoscopic Videos With Single Shot Detection Based Deep Convolutional Neural Network , 2019, IEEE Access.

[23]  Kazuki Sumiyama,et al.  Effectiveness of computer-aided diagnosis of colorectal lesions using novel software for magnifying narrow-band imaging: a pilot study , 2017, Endoscopy International Open.

[24]  K. Chayama,et al.  Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. , 2016, Gastrointestinal endoscopy.

[25]  K. Mori,et al.  Real-Time Use of Artificial Intelligence in Identification of Diminutive Polyps During Colonoscopy , 2018, Annals of Internal Medicine.

[26]  Andreas Uhl,et al.  Color treatment in endoscopic image classification using multi-scale local color vector patterns , 2012, Medical Image Anal..

[27]  Junzhou Huang,et al.  Polyp Tracking in Video Colonoscopy Using Optical Flow With an On-The-Fly Trained CNN , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[28]  Shoichi Saito,et al.  Efficacy of a novel auto-fluorescence imaging system with computer-assisted color analysis for assessment of colorectal lesions. , 2013, World journal of gastroenterology.

[29]  C. Trautwein,et al.  Computer-aided classification of colorectal polyps based on vascular patterns: a pilot study , 2010, Endoscopy.

[30]  K. Mori,et al.  Simultaneous detection and characterization of diminutive polyps with the use of artificial intelligence during colonoscopy , 2019, VideoGIE : an official video journal of the American Society for Gastrointestinal Endoscopy.

[31]  Helmut Neumann,et al.  In vivo real-time assessment of colorectal polyp histology using an optical biopsy forceps system based on laser-induced fluorescence spectroscopy , 2016, Endoscopy.

[32]  Noriko Suzuki,et al.  Optical diagnosis of small colorectal polyps at routine colonoscopy (Detect InSpect ChAracterise Resect and Discard; DISCARD trial): a prospective cohort study. , 2009, The Lancet. Oncology.

[33]  Til Aach,et al.  A comparison of blood vessel features and local binary patterns for colorectal polyp classification , 2009, Medical Imaging.

[34]  Fernando Vilariño,et al.  WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians , 2015, Comput. Medical Imaging Graph..

[35]  C. Trautwein,et al.  Computer-based classification of small colorectal polyps by using narrow-band imaging with optical magnification. , 2011, Gastrointestinal endoscopy.

[36]  K. Mori,et al.  Potential of artificial intelligence‐assisted colonoscopy using an endocytoscope (with video) , 2018, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[37]  Charles J. Kahi,et al.  The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on real-time endoscopic assessment of the histology of diminutive colorectal polyps. , 2011, Gastrointestinal endoscopy.

[38]  Jorge Bernal,et al.  Building up the Future of Colonoscopy – A Synergy between Clinicians and Computer Scientists , 2015 .

[39]  Paul Fockens,et al.  Colorectal polypectomy and endoscopic mucosal resection (EMR): European Society of Gastrointestinal Endoscopy (ESGE) Clinical Guideline , 2017, Endoscopy.

[40]  Yuji Iwahori,et al.  Automatic Polyp Detection in Endoscope Images Using a Hessian Filter , 2013, MVA.

[41]  Aymeric Histace,et al.  Comparative Validation of Polyp Detection Methods in Video Colonoscopy: Results From the MICCAI 2015 Endoscopic Vision Challenge , 2017, IEEE Transactions on Medical Imaging.

[42]  Zhengrong Liang,et al.  Improved curvature estimation for computer-aided detection of colonic polyps in CT colonography. , 2011, Academic radiology.

[43]  Ilangko Balasingham,et al.  Improving Automatic Polyp Detection Using CNN by Exploiting Temporal Dependency in Colonoscopy Video , 2020, IEEE Journal of Biomedical and Health Informatics.

[44]  Danail Stoyanov,et al.  Artificial intelligence and computer-aided diagnosis in colonoscopy: current evidence and future directions. , 2019, The lancet. Gastroenterology & hepatology.

[45]  Marcin Polkowski,et al.  Quality indicators for colonoscopy and the risk of interval cancer. , 2010, The New England journal of medicine.

[46]  M. Kudo,et al.  Computer-Aided Diagnosis Based on Convolutional Neural Network System for Colorectal Polyp Classification: Preliminary Experience , 2017, Oncology.

[47]  Nicholas Ayache,et al.  Software for automated classification of probe-based confocal laser endomicroscopy videos of colorectal polyps. , 2012, World journal of gastroenterology.

[48]  Aymeric Histace,et al.  Active Learning for Real Time Detection of Polyps in Videocolonoscopy , 2016, Annual Conference on Medical Image Understanding and Analysis.

[49]  K. Mori,et al.  Accuracy of diagnosing invasive colorectal cancer using computer-aided endocytoscopy , 2017, Endoscopy.