WCE Abnormality Detection Based on Saliency and Adaptive Locality-Constrained Linear Coding

Wireless capsule endoscopy (WCE) has become a widely used diagnostic technique for the digestive tract, at the price of a large volume of data that needs to be analyzed. To tackle this problem, a new computer-aided system using novel features is proposed in this paper to classify WCE images automatically. In the feature learning stage, to obtain the representative visual words, we first calculate the color scale invariant feature transform from the bleeding, polyp, ulcer, and normal WCE image samples separately and then apply $K$ -means clustering on these features to obtain visual words. These four types of visual words are combined together to composite the representative visual words for classifying the WCE images. In the feature coding stage, we propose a novel saliency and adaptive locality-constrained linear coding (SALLC) algorithm to encode the images. The SALLC encodes patch features based on adaptive coding bases, which are calculated by the distance differences among the features and the visual words. Moreover, it imposes the patch saliency constraint on the feature coding process to emphasize the important information in the images. The experimental results exhibit a promising overall recognition accuracy of 88.61%, validating the effectiveness of the proposed method.

[1]  Yihong Gong,et al.  Nonlinear Learning using Local Coordinate Coding , 2009, NIPS.

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Hongyu Li,et al.  SDSP: A novel saliency detection method by combining simple priors , 2013, 2013 IEEE International Conference on Image Processing.

[4]  Max Q.-H. Meng,et al.  Tumor Recognition in Wireless Capsule Endoscopy Images Using Textural Features and SVM-Based Feature Selection , 2012, IEEE Transactions on Information Technology in Biomedicine.

[5]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.

[6]  Marios Anthimopoulos,et al.  A Food Recognition System for Diabetic Patients Based on an Optimized Bag-of-Features Model , 2014, IEEE Journal of Biomedical and Health Informatics.

[7]  Max Q.-H. Meng,et al.  A novel feature for polyp detection in wireless capsule endoscopy images , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Gregory D. Hager,et al.  Assessment of Crohn’s Disease Lesions in Wireless Capsule Endoscopy Images , 2012, IEEE Transactions on Biomedical Engineering.

[9]  Tieniu Tan,et al.  Salient coding for image classification , 2011, CVPR 2011.

[10]  Laurens van der Maaten,et al.  Learning Discriminative Fisher Kernels , 2011, ICML.

[11]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[13]  Tieniu Tan,et al.  Group encoding of local features in image classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[14]  Xueming Qian,et al.  Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised Learning , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[15]  D. Iakovidis,et al.  Software for enhanced video capsule endoscopy: challenges for essential progress , 2015, Nature Reviews Gastroenterology &Hepatology.

[16]  Mohammad Reza Zare,et al.  Automatic classification of medical X-ray images using a bag of visual words , 2013, IET Comput. Vis..

[17]  G. Eisen,et al.  10 years of capsule endoscopy: an update , 2010, Expert review of gastroenterology & hepatology.

[18]  Max Q.-H. Meng,et al.  Saliency Based Ulcer Detection for Wireless Capsule Endoscopy Diagnosis , 2015, IEEE Transactions on Medical Imaging.

[19]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[20]  Weiren Shi,et al.  Feature coding for image classification combining global saliency and local difference , 2015, Pattern Recognit. Lett..

[21]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[22]  Max Q.-H. Meng,et al.  Polyp classification based on Bag of Features and saliency in wireless capsule endoscopy , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Max Q.-H. Meng,et al.  Improved Bag of Feature for Automatic Polyp Detection in Wireless Capsule Endoscopy Images , 2016, IEEE Transactions on Automation Science and Engineering.

[24]  Sae Hwang Bag-of-Visual-Words Approach to Abnormal Image Detection in Wireless Capsule Endoscopy Videos , 2011, ISVC.

[25]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[26]  Changsheng Xu,et al.  Saliency Aware Locality-preserving Coding for Image Classification , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[27]  Jung-Hwan Oh,et al.  Abnormal image detection in endoscopy videos using a filter bank and local binary patterns , 2014, Neurocomputing.

[28]  Philipp Lenz,et al.  Single-Balloon Enteroscopy. , 2017, Gastrointestinal endoscopy clinics of North America.

[29]  Miguel Tavares Coimbra,et al.  MPEG-7 Visual Descriptors—Contributions for Automated Feature Extraction in Capsule Endoscopy , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Azzedine Boukerche,et al.  Real-Time Vehicle Make and Model Recognition Based on a Bag of SURF Features , 2016, IEEE Transactions on Intelligent Transportation Systems.

[31]  Chong-Wah Ngo,et al.  Automatic Hookworm Detection in Wireless Capsule Endoscopy Images , 2016, IEEE Transactions on Medical Imaging.

[32]  Jun Li,et al.  Boosting dense SIFT descriptors and shape contexts of face images for gender recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[33]  Leontios J. Hadjileontiadis,et al.  A curvelet-based lacunarity approach for ulcer detection from Wireless Capsule Endoscopy images , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[34]  R. Webster,et al.  Swallowable medical devices for diagnosis and surgery: The state of the art , 2010 .

[35]  Mohamed Abdel-Mottaleb,et al.  Exploiting color SIFT features for 2D ear recognition , 2011, 2011 18th IEEE International Conference on Image Processing.

[36]  Tieniu Tan,et al.  Feature Coding in Image Classification: A Comprehensive Study , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  M. Yu M2A™ Capsule Endoscopy: A Breakthrough Diagnostic Tool for Small Intestine Imaging , 2002, Gastroenterology nursing : the official journal of the Society of Gastroenterology Nurses and Associates.

[39]  Wei Zhang,et al.  Computer-Aided Bleeding Detection in WCE Video , 2014, IEEE Journal of Biomedical and Health Informatics.

[40]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Jayanthi Sivaswamy,et al.  A Bag of Words approach for discriminating between retinal images containing exudates or drusen , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[42]  Jean Ponce,et al.  Learning mid-level features for recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  L. Gerson,et al.  Small-bowel enteroscopy , 2013, Endoscopy.

[44]  Sabine Süsstrunk,et al.  Saliency detection using maximum symmetric surround , 2010, 2010 IEEE International Conference on Image Processing.