Evaluation of cross-validation protocols for the classification of endoscopic images of colonic polyps

We evaluate different cross-validation (CV) protocols for an automated classification of colonic polyps. For this purpose we select six previously developed methods which achieved promising results already in the past. We then evaluate the methods using the cross-validation protocols leave-one-image-out (LOO-CV), leave-one-parent-image-out (LOPIO-CV), leave-one-lesion-out (LOLO-CV), and leave-one-patient-out (LOPO-CV). We show that, in general, the more restrictive cross-validation protocols lead to high results drops. While in case of LOO-CV the accuracies are rather high across all methods evaluated, the picture changes the more strictness a cross-validation mode imposes on the set of training images.

[1]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[2]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[3]  Andreas Uhl,et al.  Color treatment in endoscopic image classification using multi-scale local color vector patterns , 2012, Medical Image Anal..

[4]  M J Bruno,et al.  Magnification endoscopy, high resolution endoscopy, and chromoscopy; towards a better optical diagnosis , 2003, Gut.

[5]  A. Uhl,et al.  Computer-Aided Decision Support Systems for Endoscopy in the Gastrointestinal Tract: A Review , 2011, IEEE Reviews in Biomedical Engineering.

[6]  F. Wrba,et al.  Pit pattern classification using extended Local Binary Patterns , 2009, 2009 9th International Conference on Information Technology and Applications in Biomedicine.

[7]  Richard Baraniuk,et al.  The dual-tree complex wavelet transform , 2005, IEEE Signal Processing Magazine.

[8]  Andreas Uhl,et al.  Endoscopic Image Classification Using Edge-Based Features , 2010, 2010 20th International Conference on Pattern Recognition.

[9]  Andreas Uhl,et al.  One-against-one classification for zoom-endoscopy images , 2008 .

[10]  Andreas Uhl,et al.  Systematic Assessment of Performance Prediction Techniques in Medical Image Classification A Case Study on Celiac Disease , 2011, IPMI.

[11]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[12]  S. Kudo,et al.  Colorectal tumours and pit pattern. , 1994, Journal of clinical pathology.

[13]  Andreas Uhl,et al.  Statistical and structural wavelet packet features for pit pattern classification in zoom-endoscopic colon images , 2007 .

[14]  Yasushi Sano,et al.  Magnifying colonoscopy as a non-biopsy technique for differential diagnosis of non-neoplastic and neoplastic lesions. , 2006, World journal of gastroenterology.