Automatic Polyp Segmentation Using Convolutional Neural Networks

Colorectal cancer is the third most common cancer-related death after lung cancer and breast cancer worldwide. The risk of developing colorectal cancer could be reduced by early diagnosis of polyps during a colonoscopy. Computer-aided diagnosis systems have the potential to be applied for polyp screening and reduce the number of missing polyps. In this paper, we compare the performance of different deep learning architectures as feature extractors, i.e. ResNet, DenseNet, InceptionV3, InceptionResNetV2 and SE-ResNeXt in the encoder part of a U-Net architecture. We validated the performance of presented ensemble models on the CVC-Clinic (GIANA 2018) dataset. The DenseNet169 feature extractor combined with U-Net architecture outperformed the other counterparts and achieved an accuracy of 99.15\%, Dice similarity coefficient of 90.87%, and Jaccard index of 83.82%.

[1]  Michael Kampffmeyer,et al.  UNCERTAINTY MODELING AND INTERPRETABILITY IN CONVOLUTIONAL NEURAL NETWORKS FOR POLYP SEGMENTATION , 2018, 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP).

[2]  Antonio M. López,et al.  A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images , 2016, Journal of healthcare engineering.

[3]  Fernando Vilariño,et al.  Towards automatic polyp detection with a polyp appearance model , 2012, Pattern Recognit..

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Nader Karimi,et al.  Classification of Informative Frames in Colonoscopy Videos Using Convolutional Neural Networks with Binarized Weights , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[9]  Zhihai Lu,et al.  Pathological brain detection based on AlexNet and transfer learning , 2019, J. Comput. Sci..

[10]  Ilangko Balasingham,et al.  Polyp Detection and Segmentation using Mask R-CNN: Does a Deeper Feature Extractor CNN Always Perform Better? , 2019, 2019 13th International Symposium on Medical Information and Communication Technology (ISMICT).

[11]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Fernando Vilariño,et al.  WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians , 2015, Comput. Medical Imaging Graph..

[13]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[14]  Tianfu Wang,et al.  Colorectal polyp segmentation using a fully convolutional neural network , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[15]  Sang-Woong Lee,et al.  Colorectal Segmentation Using Multiple Encoder-Decoder Network in Colonoscopy Images , 2018, 2018 IEEE First International Conference on Artificial Intelligence and Knowledge Engineering (AIKE).

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Ilangko Balasingham,et al.  Improving Automatic Polyp Detection Using CNN by Exploiting Temporal Dependency in Colonoscopy Video , 2020, IEEE Journal of Biomedical and Health Informatics.

[18]  Chang-Dong Wang,et al.  Ensembling over-segmentations: From weak evidence to strong segmentation , 2016, Neurocomputing.

[19]  Jeonghwan Gwak,et al.  Ensemble of Instance Segmentation Models for Polyp Segmentation in Colonoscopy Images , 2019, IEEE Access.

[20]  Ebrahim Nasr-Esfahani,et al.  Polyp Segmentation in Colonoscopy Images Using Fully Convolutional Network , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Wei-Min Liu,et al.  Automatic tissue segmentation by deep learning: from colorectal polyps in colonoscopy to abdominal organs in CT exam , 2018, 2018 IEEE Visual Communications and Image Processing (VCIP).

[23]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).