An automatic annotation method for early esophageal cancers based on saliency guided superpixel segmentation

The annotation of Early Esophageal Cancer (EEC) in gastroscopic images is mainly performed by clinicians in clinic, In order to reduce subjective and fatigue manual annotation works, computer-aided annotation is needed for accurate diagnosis. This study develops an automatic annotation method to annotate EEC in gastroscopic images. We initially designed a new segmentation method named "Saliency Guided Superpixel Segmentation", to rapidly find the salient regions and their surrounding regions. Then, a two-step annotation strategy of EEC, which is based on the "relationships between the salient regions and EEC regions", was proposed. The first step is to detect the salient EEC regions and the second step is the left unsalient EEC regions. Finally, the two kinds of lesion regions are combined together to obtain the annotation results. 267 EEC images and 285 normal images were used to validate the proposed method. The experimental results show that, the detection rate and Dice similarity coefficients of our method were 97.14% and 74.53%, respectively. Compared with other patch-based or superpixel-based state-of-the-art methods, our method showed better performance. Thus, it has a good prospect for clinical application.

[1]  Dimitris K. Iakovidis,et al.  Automatic lesion detection in capsule endoscopy based on color saliency: closer to an essential adjunct for reviewing software. , 2014, Gastrointestinal endoscopy.

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Jeongkyu Lee,et al.  A Review of Machine-Vision-Based Analysis of Wireless Capsule Endoscopy Video , 2012, Diagnostic and therapeutic endoscopy.

[4]  Fons van der Sommen,et al.  Supportive automatic annotation of early esophageal cancer using local gabor and color features , 2014, Neurocomputing.

[5]  Wei Zhang,et al.  Computer-Aided Bleeding Detection in WCE Video , 2014, IEEE Journal of Biomedical and Health Informatics.

[6]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jiebo Luo,et al.  Deep sparse feature selection for computer aided endoscopy diagnosis , 2015, Pattern Recognit..

[8]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  A. Uhl,et al.  Computer-Aided Decision Support Systems for Endoscopy in the Gastrointestinal Tract: A Review , 2011, IEEE Reviews in Biomedical Engineering.

[10]  Max Q.-H. Meng,et al.  Polyp classification based on Bag of Features and saliency in wireless capsule endoscopy , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Fu Dan-dan SVM classifier for unbalanced data based on combination of ODR and BSMOTE , 2011 .

[12]  S. Zinger,et al.  Computer-aided detection of early neoplastic lesions in Barrett’s esophagus , 2016, Endoscopy.

[13]  Bing Zeng,et al.  Automatic Detection of Early Gastrointestinal Cancer Lesions Based on Optimal Feature Extraction from Gastroscopic Images , 2015 .

[14]  Dimitrios K. Iakovidis,et al.  An intelligent system for automatic detection of gastrointestinal adenomas in video endoscopy , 2006, Comput. Biol. Medicine.

[15]  Fons van der Sommen,et al.  Computer-aided detection of early cancer in the esophagus using HD endoscopy images , 2013, Medical Imaging.

[16]  Jung-Hwan Oh,et al.  Abnormal image detection in endoscopy videos using a filter bank and local binary patterns , 2014, Neurocomputing.

[17]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[18]  Mohamed Medhat Gaber,et al.  An efficient Self-Organizing Active Contour model for image segmentation , 2015, Neurocomputing.

[19]  D. Iakovidis,et al.  Software for enhanced video capsule endoscopy: challenges for essential progress , 2015, Nature Reviews Gastroenterology &Hepatology.

[20]  GaberMohamed Medhat,et al.  An efficient Self-Organizing Active Contour model for image segmentation , 2015 .

[21]  Jie Zheng,et al.  Identification of lesion images from gastrointestinal endoscope based on feature extraction of combinational methods with and without learning process , 2016, Medical Image Anal..

[22]  R. Zheng,et al.  [Mortality and survival analysis of esophageal cancer in China]. , 2016, Zhonghua zhong liu za zhi [Chinese journal of oncology].

[23]  D. Whiteman,et al.  Esophageal Cancer: Priorities for Prevention , 2014, Current Epidemiology Reports.