Development of a Real-time Colorectal Tumor Classification System for Narrow-band Imaging zoom-videoendoscopy

Colorectal endoscopy is important for the early detection and treatment of colorectal cancer and is used worldwide. A computer-aided diagnosis (CAD) system that provides an objective measure to endoscopists during colorectal endoscopic examinations would be of great value. In this study, we describe a newly developed CAD system that provides real-time objective measures. Our system captures the video stream from an endoscopic system and transfers it to a desktop computer. The captured video stream is then classified by a pretrained classifier and the results are displayed on a monitor. The experimental results show that our developed system works efficiently in actual endoscopic examinations and is medically significant.

[1]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[2]  R. Kiesslich,et al.  Inter- and Intra-Observer Variability of Magnification Chromoendoscopy for Detecting Specialized Intestinal Metaplasia at the Gastroesophageal Junction , 2004, Endoscopy.

[3]  Shinji Tanaka,et al.  Smoothing posterior probabilities with a particle filter of dirichlet distribution for stabilizing colorectal NBI endoscopy recognition , 2013, 2013 IEEE International Conference on Image Processing.

[4]  M. Desai,et al.  Real-time optical biopsy of colon polyps with narrow band imaging in community practice does not yet meet key thresholds for clinical decisions. , 2013, Gastroenterology.

[5]  Frédéric Jurie,et al.  Sampling Strategies for Bag-of-Features Image Classification , 2006, ECCV.

[6]  Anh-Tuan Hoang,et al.  FPGA implementation of type identifier for colorectal endoscopie images with NBI magnification , 2014, 2014 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS).

[7]  Prateek Sharma,et al.  Impact of a computer-based teaching module on characterization of diminutive colon polyps by using narrow-band imaging by non-experts in academic and community practice: a video-based study. , 2012, Gastrointestinal endoscopy.

[8]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[9]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[10]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[11]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Shinji Tanaka,et al.  Narrow-band imaging magnification predicts the histology and invasion depth of colorectal tumors. , 2009, Gastrointestinal endoscopy.

[15]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  Endoscopic Innovations,et al.  The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on real-time endoscopic assessment of the histology of diminutive colorectal polyps , 2011 .

[17]  Tanaka Shinji,et al.  Transfer Learning for Endoscopic Image Classification , 2016 .

[18]  Kazufumi Kaneda,et al.  Computer-Aided Colorectal Tumor Classification in NBI Endoscopy Using CNN Features , 2016, ArXiv.

[19]  Swati G. Patel,et al.  Real-Time Characterization of Diminutive Colorectal Polyp Histology Using Narrow-Band Imaging: Implications for the Resect and Discard Strategy. , 2016, Gastroenterology.

[20]  Shinji Tanaka,et al.  Defocus-aware Dirichlet particle filter for stable endoscopic video frame recognition , 2016, Artif. Intell. Medicine.

[21]  Nicolas Hervé,et al.  Document description: what works for images should also work for text? , 2009, Electronic Imaging.

[22]  Masahiro Yamaguchi,et al.  Appearance of enhanced tissue features in narrow-band endoscopic imaging. , 2004, Journal of biomedical optics.

[23]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[24]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[25]  Yasushi Sano,et al.  MAGNIFYING OBSERVATION OF MICROVASCULAR ARCHITECTURE OF COLORECTAL LESIONS USING A NARROW‐BAND IMAGING SYSTEM , 2006 .

[26]  Brigitte Mayinger,et al.  Evaluation of sensitivity and inter- and intra-observer variability in the detection of intestinal metaplasia and dysplasia in Barrett's esophagus with enhanced magnification endoscopy , 2006, Scandinavian journal of gastroenterology.

[27]  Shinji Tanaka,et al.  Transfer learning for Bag-of-Visual words approach to NBI endoscopic image classification , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  Shinji Tanaka,et al.  Labeling colorectal NBI zoom-videoendoscope image sequences with MRF and SVM , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[29]  K. Chayama,et al.  Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. , 2016, Gastrointestinal endoscopy.

[30]  Shinji Tanaka,et al.  Characterization of colorectal tumors using narrow-band imaging magnification: combined diagnosis with both pit pattern and microvessel features , 2010, Scandinavian journal of gastroenterology.

[31]  H. Tajiri,et al.  Narrow-band imaging in the diagnosis of colorectal mucosal lesions: a pilot study. , 2004, Endoscopy.

[32]  Frédéric Jurie,et al.  Creating efficient codebooks for visual recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[33]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[34]  K. Chayama,et al.  Computer-aided system for predicting the histology of colorectal tumors by using narrow-band imaging magnifying colonoscopy (with video). , 2012, Gastrointestinal endoscopy.