Automatic normal-abnormal video frame classification for colonoscopy

Two novel schemes are proposed to represent intermediate-scale features for normal-abnormal classification of colonoscopy images. The first scheme works on the full-resolution image, the second on a multi-scale pyramid space. Both schemes support any feature descriptor; here we use multi-resolution local binary patterns which outperformed other features reported in the literature in our comparative experiments. We also compared experimentally two types of features not previously used in colonoscopy image classification, bag of features and sparse coding, each with and without spatial pyramid matching (SPM). We find that SPM improves performance, therefore supporting the importance of intermediate-scale features as in the proposed schemes for classification. Within normal-abnormal frame classification, we show that our representational schemes outperforms other features reported in the literature in leave-N-out tests with a database of 2100 colonoscopy images.

[1]  Gregory D. Hager,et al.  Assessment of Crohn’s Disease Lesions in Wireless Capsule Endoscopy Images , 2012, IEEE Transactions on Biomedical Engineering.

[2]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[3]  Dietrich Paulus,et al.  Features for Classification of Polyps in Colonoscopy , 2010, Bildverarbeitung für die Medizin.

[4]  Dimitris A. Karras,et al.  Computer-aided tumor detection in endoscopic video using color wavelet features , 2003, IEEE Transactions on Information Technology in Biomedicine.

[5]  Zhang Zhuo,et al.  Feature selection and classification for Wireless Capsule Endoscopic frames , 2009, 2009 International Conference on Biomedical and Pharmaceutical Engineering.

[6]  E. Wilkinson.  Cancer Research UK , 2002 .

[7]  Jung-Hwan Oh,et al.  Polyp Detection in Colonoscopy Video using Elliptical Shape Feature , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[9]  Michael B Wallace,et al.  Improving colorectal adenoma detection: technology or technique? , 2007, Gastroenterology.

[10]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Peng Li,et al.  Learning a multi-size patch-based hybrid kernel machine ensemble for abnormal region detection in colonoscopic images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Yong-Gyu Lee,et al.  Bleeding Detection Algorithm for Capsule Endoscopy , 2011 .

[13]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Dimitris A. Karras,et al.  Computer Methods and Programs in Biomedicine , 2022 .

[15]  T. Lindeberg,et al.  Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[16]  C. S. Lima,et al.  Classification of endoscopic capsule images by using color wavelet features, higher order statistics and radial basis functions , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  M. P. Tjoa,et al.  Feature extraction for the analysis of colon status from the endoscopic images , 2003, Biomedical engineering online.

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Samantha Sharpe,et al.  Cancer Research UK , 2002, Nature Cell Biology.

[20]  Chih-Jen Lin,et al.  Combining SVMs with Various Feature Selection Strategies , 2006, Feature Extraction.

[21]  Max Q.-H. Meng,et al.  Polyp detection in wireless capsule endoscopy images using novel color texture features , 2011, 2011 9th World Congress on Intelligent Control and Automation.

[22]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[23]  Max Q.-H. Meng,et al.  Computer-Aided Detection of Bleeding Regions for Capsule Endoscopy Images , 2009, IEEE Transactions on Biomedical Engineering.

[24]  Topi Mäenpää,et al.  The local binary pattern approach to texture analysis - extensions and applications , 2003 .

[25]  V.S. Kodogiannis,et al.  Neural network-based approach for the classification of wireless-capsule endoscopic images , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..