Computer-aided polyp detection based on image enhancement and saliency-based selection

Abstract This paper presents a computer-aided polyp detection algorithm applicable to both colonoscopy and wireless capsule endoscopy (WCE). The proposed system has three integral parts: image enhancement, saliency map formation and Histogram of gradients (HOG) feature extraction for final classification. We propose a novel and efficient image enhancement algorithm, which enhances the saliency of clinically important features in endoscopic images. A saliency detection method is applied to the enhanced images to highlight the initial polyp candidates. In the classification stage, polyp candidates are selected after performing an image enhancement step and a saliency detection step. Exhaustive experiments have been performed on three publicly available databases: CVC ColonDB, CVC ClinicDB, and ETIS Larib to evaluate the performance of the proposed polyp detection algorithm. Comparison with the state-of-the-art methods shows that the proposed method outperforms the existing ones in terms of recall (=86.33%) and F2 score (=75.51%) for CVC ColonDB and in terms of recall (=74.04%) for the ETIS Larib dataset. With a significantly reduced number of search windows resulting from the saliency-based selection, the proposed scheme ensures a cost-effective and efficient polyp detection algorithm.

[1]  David F Ransohoff,et al.  Variation in polyp detection rates at screening colonoscopy. , 2009, Gastrointestinal endoscopy.

[2]  D. Park,et al.  Gastric polyps: classification and management. , 2008, Archives of pathology & laboratory medicine.

[3]  Ahmed S. Gado,et al.  Gastric cancer missed at endoscopy , 2013 .

[4]  Fernando Vilariño,et al.  Texture-Based Polyp Detection in Colonoscopy , 2009, Bildverarbeitung für die Medizin.

[5]  Max Q.-H. Meng,et al.  Polyp classification based on Bag of Features and saliency in wireless capsule endoscopy , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Sae Hwang Bag-of-Visual-Words Approach to Abnormal Image Detection in Wireless Capsule Endoscopy Videos , 2011, ISVC.

[7]  Isabel N. Figueiredo,et al.  Automated Polyp Detection in Colon Capsule Endoscopy , 2013, IEEE Transactions on Medical Imaging.

[8]  G. Kandel,et al.  Seeing better--Evidence based recommendations on optimizing colonoscopy adenoma detection rate. , 2016, World journal of gastroenterology.

[9]  M. Muñoz-Navas,et al.  Colon capsule endoscopy. , 2008, World journal of gastroenterology.

[10]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Dimitrios K. Iakovidis,et al.  An intelligent system for automatic detection of gastrointestinal adenomas in video endoscopy , 2006, Comput. Biol. Medicine.

[12]  E Altobelli,et al.  Colorectal cancer prevention in Europe: burden of disease and status of screening programs. , 2014, Preventive medicine.

[13]  Mark D. Fairchild,et al.  Image lightness rescaling using sigmoidal contrast enhancement functions , 1999, J. Electronic Imaging.

[14]  Khan A. Wahid,et al.  Unsupervised abnormality detection using saliency and Retinex based color enhancement , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  Taghi M. Khoshgoftaar,et al.  RUSBoost: A Hybrid Approach to Alleviating Class Imbalance , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[16]  Max Q.-H. Meng,et al.  Automatic polyp detection for wireless capsule endoscopy images , 2012, Expert Syst. Appl..

[17]  Nima Tajbakhsh,et al.  Automatic polyp detection from learned boundaries , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[18]  Luís A. Alexandre,et al.  Color and Position versus Texture Features for Endoscopic Polyp Detection , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[19]  Max Q.-H. Meng,et al.  Polyp detection in wireless capsule endoscopy images using novel color texture features , 2011, 2011 9th World Congress on Intelligent Control and Automation.

[20]  Aymeric Histace,et al.  Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer , 2014, International Journal of Computer Assisted Radiology and Surgery.

[21]  H. Tajiri,et al.  Colon capsule endoscopy: European Society of Gastrointestinal Endoscopy (ESGE) Guideline , 2012, Endoscopy.

[22]  Dimitris A. Karras,et al.  Computer-aided tumor detection in endoscopic video using color wavelet features , 2003, IEEE Transactions on Information Technology in Biomedicine.

[23]  Nikolaos G. Bourbakis,et al.  Detection of Small Bowel Polyps and Ulcers in Wireless Capsule Endoscopy Videos , 2011, IEEE Transactions on Biomedical Engineering.

[24]  Yuji Iwahori,et al.  Automatic Polyp Detection in Endoscope Images Using a Hessian Filter , 2013, MVA.

[25]  Raluca Boia,et al.  Automatic colon polyp detection in endoscopic capsule images , 2013, International Symposium on Signals, Circuits and Systems ISSCS2013.

[26]  Steven D. Wexner,et al.  Colorectal polyps and polyposis syndromes , 2014, Gastroenterology report.

[27]  Max Q.-H. Meng,et al.  Automatic Polyp Detection via a Novel Unified Bottom-Up and Top-Down Saliency Approach , 2018, IEEE Journal of Biomedical and Health Informatics.

[28]  Max Q.-H. Meng,et al.  Comparison of Several Texture Features for Tumor Detection in CE Images , 2012, Journal of Medical Systems.

[29]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Alexandros Karargyris,et al.  Identification of polyps in Wireless Capsule Endoscopy videos using Log Gabor filters , 2009, 2009 IEEE/NIH Life Science Systems and Applications Workshop.

[31]  A. Karargyris,et al.  Small-bowel capsule endoscopy: a ten-point contemporary review. , 2013, World journal of gastroenterology.

[32]  Esa Rahtu,et al.  A Simple and efficient saliency detector for background subtraction , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[33]  J. Bond,et al.  Polyp Guideline: Diagnosis, Treatment, and Surveillance for Patients with Nonfamilial Colorectal Polyps* , 1993, Annals of Internal Medicine.

[34]  Fernando Vilariño,et al.  Impact of image preprocessing methods on polyp localization in colonoscopy frames , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[35]  Max Q.-H. Meng,et al.  Tumor Recognition in Wireless Capsule Endoscopy Images Using Textural Features and SVM-Based Feature Selection , 2012, IEEE Transactions on Information Technology in Biomedicine.

[36]  Fernando Vilariño,et al.  Towards automatic polyp detection with a polyp appearance model , 2012, Pattern Recognit..

[37]  Kuk-Jin Yoon,et al.  Polyp Detection via Imbalanced Learning and Discriminative Feature Learning , 2015, IEEE Transactions on Medical Imaging.

[38]  Nima Tajbakhsh,et al.  A Classification-Enhanced Vote Accumulation Scheme for Detecting Colonic Polyps , 2013, Abdominal Imaging.

[39]  Kristin Wallace,et al.  Race and Prevalence of Large Bowel Polyps Among the Low-Income and Uninsured in South Carolina , 2015, Digestive Diseases and Sciences.

[40]  A. Uhl,et al.  Computer-Aided Decision Support Systems for Endoscopy in the Gastrointestinal Tract: A Review , 2011, IEEE Reviews in Biomedical Engineering.

[41]  J. Jang,et al.  The Usefulness of Magnifying Endoscopy and Narrow-Band Imaging in Measuring the Depth of Invasion before Endoscopic Submucosal Dissection , 2012, Clinical endoscopy.

[42]  Jung-Hwan Oh,et al.  Part-Based Multiderivative Edge Cross-Sectional Profiles for Polyp Detection in Colonoscopy , 2014, IEEE Journal of Biomedical and Health Informatics.

[43]  Nima Tajbakhsh,et al.  Automatic Polyp Detection Using Global Geometric Constraints and Local Intensity Variation Patterns , 2014, MICCAI.

[44]  Nima Tajbakhsh,et al.  Automated Polyp Detection in Colonoscopy Videos Using Shape and Context Information , 2016, IEEE Transactions on Medical Imaging.

[45]  Kilian Friedrich,et al.  Is PillCam COLON Capsule Endoscopy Ready for Colorectal Cancer Screening? A Prospective Feasibility Study in a Community Gastroenterology Practice , 2009, The American Journal of Gastroenterology.

[46]  Sun Young Park,et al.  A Colon Video Analysis Framework for Polyp Detection , 2012, IEEE Transactions on Biomedical Engineering.

[47]  Fernando Vilariño,et al.  WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians , 2015, Comput. Medical Imaging Graph..