Saliency Based Ulcer Detection for Wireless Capsule Endoscopy Diagnosis

Ulcer is one of the most common symptoms of many serious diseases in the human digestive tract. Especially for the ulcers in the small bowel where other procedures cannot adequately visualize, wireless capsule endoscopy (WCE) is increasingly being used in the diagnosis and clinical management. Because WCE generates large amount of images from the whole process of inspection, computer-aided detection of ulcer is considered an indispensable relief to clinicians. In this paper, a two-staged fully automated computer-aided detection system is proposed to detect ulcer from WCE images. In the first stage, we propose an effective saliency detection method based on multi-level superpixel representation to outline the ulcer candidates. To find the perceptually and semantically meaningful salient regions, we first segment the image into multi-level superpixel segmentations. Each level corresponds to different initial region sizes of the superpixels. Then we evaluate the corresponding saliency according to the color and texture features in superpixel region of each level. In the end, we fuse the saliency maps from all levels together to obtain the final saliency map. In the second stage, we apply the obtained saliency map to better encode the image features for the ulcer image recognition tasks. Because the ulcer mainly corresponds to the saliency region, we propose a saliency max-pooling method integrated with the Locality-constrained Linear Coding (LLC) method to characterize the images. Experiment results achieve promising 92.65% accuracy and 94.12% sensitivity, validating the effectiveness of the proposed method. Moreover, the comparison results show that our detection system outperforms the state-of-the-art methods on the ulcer classification task.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[3]  Max Q.-H. Meng,et al.  Polyp classification based on Bag of Features and saliency in wireless capsule endoscopy , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[5]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Leontios J. Hadjileontiadis,et al.  Computer-aided capsule endoscopy images evaluation based on color rotation and texture features: An educational tool to physicians , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[7]  Ying Zhang,et al.  Notice of Violation of IEEE Publication PrinciplesBag-of-Features Based Medical Image Retrieval via Multiple Assignment and Visual Words Weighting , 2011, IEEE Transactions on Medical Imaging.

[8]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[9]  Jun Li,et al.  Boosting dense SIFT descriptors and shape contexts of face images for gender recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[10]  Leontios J. Hadjileontiadis,et al.  A curvelet-based lacunarity approach for ulcer detection from Wireless Capsule Endoscopy images , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[11]  Nikolaos G. Bourbakis,et al.  Detection of Small Bowel Polyps and Ulcers in Wireless Capsule Endoscopy Videos , 2011, IEEE Transactions on Biomedical Engineering.

[12]  P. Swain,et al.  A randomized trial comparing wireless capsule endoscopy with push enteroscopy for the detection of small-bowel lesions. , 2000, Gastroenterology.

[13]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  G. Eisen,et al.  10 years of capsule endoscopy: an update , 2010, Expert review of gastroenterology & hepatology.

[15]  Sabine Süsstrunk,et al.  Saliency detection using maximum symmetric surround , 2010, 2010 IEEE International Conference on Image Processing.

[16]  Rama Chellappa,et al.  Automatic head pose estimation using randomly projected dense SIFT descriptors , 2012, 2012 19th IEEE International Conference on Image Processing.

[17]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[18]  Jian-Huang Lai,et al.  Ulcer detection in wireless capsule endoscopy images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[19]  G. Sergiadis,et al.  Enhanced Ulcer Recognition from Capsule Endoscopic Images Using Texture Analysis , 2012 .

[20]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[22]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Yi Li,et al.  Wireless capsule endoscopy image classification based on vector sparse coding , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[26]  L. Gerson,et al.  Small-bowel enteroscopy , 2013, Endoscopy.

[27]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[28]  Philipp Lenz,et al.  Single-Balloon Enteroscopy. , 2017, Gastrointestinal endoscopy clinics of North America.

[29]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[31]  João Barroso,et al.  Intrinsic higher-order correlation and lacunarity analysis for WCE-based ulcer classification , 2012, 2012 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS).

[32]  Umar Mohammed,et al.  Superpixel lattices , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Max Q.-H. Meng,et al.  Texture analysis for ulcer detection in capsule endoscopy images , 2009, Image Vis. Comput..

[34]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[35]  Hayit Greenspan,et al.  Image patch-based method for automated classification and detection of focal liver lesions on CT , 2013, Medical Imaging.

[36]  Armin B. Cremers,et al.  Multi-scale region-based saliency detection using W2 distance on N-dimensional normal distributions , 2013, 2013 IEEE International Conference on Image Processing.

[37]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Hongyu Li,et al.  SDSP: A novel saliency detection method by combining simple priors , 2013, 2013 IEEE International Conference on Image Processing.

[39]  Paul Scheunders,et al.  Statistical texture characterization from discrete wavelet representations , 1999, IEEE Trans. Image Process..

[40]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[41]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[42]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.