Toward real-time polyp detection using fully CNNs for 2D Gaussian shapes prediction

To decrease colon polyp miss-rate during colonoscopy, a real-time detection system with high accuracy is needed. Recently, there have been many efforts to develop models for real-time polyp detection, but work is still required to develop real-time detection algorithms with reliable results. We use single-shot feed-forward fully convolutional neural networks (F-CNN) to develop an accurate real-time polyp detection system. F-CNNs are usually trained on binary masks for object segmentation. We propose the use of 2D Gaussian masks instead of binary masks to enable these models to detect different types of polyps more effectively and efficiently and reduce the number of false positives. The experimental results showed that the proposed 2D Gaussian masks are efficient for detection of flat and small polyps with unclear boundaries between background and polyp parts. The masks make a better training effect to discriminate polyps from the polyp-like false positives. The proposed method achieved state-of-the-art results on two polyp datasets. On the ETIS-LARIB dataset we achieved 86.54% recall, 86.12% precision, and 86.33% F1-score, and on the CVC-ColonDB we achieved 91% recall, 88.35% precision, and F1-score 89.65%.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Hao Chen,et al.  Integrating Online and Offline Three-Dimensional Deep Learning for Automated Polyp Detection in Colonoscopy Videos , 2017, IEEE Journal of Biomedical and Health Informatics.

[4]  Ahmedin Jemal,et al.  Global patterns and trends in colorectal cancer incidence and mortality , 2016, Gut.

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Evelien Dekker,et al.  Morphological classifications of gastrointestinal lesions. , 2017, Best practice & research. Clinical gastroenterology.

[7]  Huilong Duan,et al.  Real-time gastric polyp detection using convolutional neural networks , 2019, PloS one.

[8]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[9]  Ming Liu,et al.  Colonic Polyp Detection in Endoscopic Videos With Single Shot Detection Based Deep Convolutional Neural Network , 2019, IEEE Access.

[10]  Aymeric Histace,et al.  Towards Real-Time Polyp Detection in Colonoscopy Videos: Adapting Still Frame-Based Methodologies for Video Sequences Analysis , 2017, CARE/CLIP@MICCAI.

[11]  Frank Meng,et al.  Region-Based Automated Localization of Colonoscopy and Wireless Capsule Endoscopy Polyps , 2019, Applied Sciences.

[12]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[13]  Ronan Collobert,et al.  Learning to Refine Object Segments , 2016, ECCV.

[14]  Marius Pedersen,et al.  Y-Net: A deep Convolutional Neural Network for Polyp Detection , 2018, BMVC.

[15]  Carmen C. Y. Poon,et al.  Polyp detection during colonoscopy using a regression-based convolutional neural network with a tracker , 2018, Pattern Recognit..

[16]  Michael Riegler,et al.  Deep Learning and Hand-Crafted Feature Based Approaches for Polyp Detection in Medical Videos , 2018, 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS).

[17]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Alexander Rakhlin,et al.  Angiodysplasia Detection and Localization Using Deep Convolutional Neural Networks , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[19]  Aymeric Histace,et al.  Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer , 2014, International Journal of Computer Assisted Radiology and Surgery.

[20]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[21]  Ilangko Balasingham,et al.  Automatic Colon Polyp Detection Using Region Based Deep CNN and Post Learning Approaches , 2018, IEEE Access.

[22]  Ilangko Balasingham,et al.  Improving Automatic Polyp Detection Using CNN by Exploiting Temporal Dependency in Colonoscopy Video , 2020, IEEE Journal of Biomedical and Health Informatics.

[23]  Hao Chen,et al.  Integrating Online and Offline Three-Dimensional Deep Learning for Automated Polyp Detection in Colonoscopy Videos. , 2017, IEEE journal of biomedical and health informatics.

[24]  Ning Zhang,et al.  AFP-Net: Realtime Anchor-Free Polyp Detection in Colonoscopy , 2019, 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI).

[25]  Fernando Vilariño,et al.  WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians , 2015, Comput. Medical Imaging Graph..

[26]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[27]  Aymeric Histace,et al.  Comparative Validation of Polyp Detection Methods in Video Colonoscopy: Results From the MICCAI 2015 Endoscopic Vision Challenge , 2017, IEEE Transactions on Medical Imaging.

[28]  Trevor Darrell,et al.  Deep Layer Aggregation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Nima Tajbakhsh,et al.  A Classification-Enhanced Vote Accumulation Scheme for Detecting Colonic Polyps , 2013, Abdominal Imaging.

[30]  A. M. Leufkens,et al.  Factors influencing the miss rate of polyps in a back-to-back colonoscopy study , 2012, Endoscopy.

[31]  Fernando Vilariño,et al.  Towards automatic polyp detection with a polyp appearance model , 2012, Pattern Recognit..

[32]  Hei Law,et al.  CornerNet: Detecting Objects as Paired Keypoints , 2018, ECCV.

[33]  Kuk-Jin Yoon,et al.  Polyp Detection via Imbalanced Learning and Discriminative Feature Learning , 2015, IEEE Transactions on Medical Imaging.

[34]  Xingyi Zhou,et al.  Objects as Points , 2019, ArXiv.

[35]  Fernando Vilariño,et al.  Impact of image preprocessing methods on polyp localization in colonoscopy frames , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Jeonghwan Gwak,et al.  Ensemble of Instance Segmentation Models for Polyp Segmentation in Colonoscopy Images , 2019, IEEE Access.

[37]  Khan A. Wahid,et al.  Computer-aided polyp detection based on image enhancement and saliency-based selection , 2020, Biomed. Signal Process. Control..

[38]  T. Berzin,et al.  Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study , 2019, Gut.

[39]  Erratum: Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. , 2020, CA: a cancer journal for clinicians.

[40]  Ilangko Balasingham,et al.  Polyp Detection and Segmentation using Mask R-CNN: Does a Deeper Feature Extractor CNN Always Perform Better? , 2019, 2019 13th International Symposium on Medical Information and Communication Technology (ISMICT).

[41]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.