Detecting Informative Frames from Wireless Capsule Endoscopic Video Using Color and Texture Features

Despite emerging technology, wireless capsule endoscopy needs high amount of diagnosis-time due to the presence of many useless frames, created by turbid fluids, foods, and faecal materials. These materials and fluids present a wide range of colors and/or bubble-like texture patterns. We, therefore, propose a cascade method for informative frame detection, which uses local color histogram to isolate highly contaminated non-bubbled (HCN) frames, and Gauss Laguerre Transform (GLT) based multiresolution norm-1 energy feature to isolate significantly bubbled (SB) frames. Supervised support vector machine is used to classify HCN frames (Stage-1), while automatic bubble segmentation followed by threshold operation (Stage-2) is adopted to detect informative frames by isolating SB frames. An experiment with 20,558 frames from the three videos shows 97.48% average detection accuracy by the proposed method, when compared with methods adopting Gabor based-(75.52%) and discrete wavelet based features (63.15%) with the same color feature.

[1]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[2]  Fernando Vilariño,et al.  ROC curves and video analysis optimization in intestinal capsule endoscopy , 2006, Pattern Recognit. Lett..

[3]  G. Mercier,et al.  Support vector machines for hyperspectral image classification with spectral-based kernels , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[4]  Giovanni Jacovitti,et al.  Multiresolution circular harmonic decomposition , 2000, IEEE Trans. Signal Process..

[5]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Fernando Vilariño,et al.  Automatic Detection of Intestinal Juices in Wireless Capsule Video Endoscopy , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[8]  Alessandro Neri,et al.  Keypoints Selection in the Gauss Laguerre Transformed Domain , 2006, BMVC.

[9]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[10]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[11]  Michael J. Swain,et al.  Indexing via color histograms , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[12]  Oscar Nestares,et al.  Efficient spatial-domain implementation of a multiscale image representation based on Gabor functions , 1998, J. Electronic Imaging.