Colorectal Polyp Segmentation by U-Net with Dilation Convolution

Colorectal cancer (CRC) is one of the most commonly diagnosed cancers and a leading cause of cancer deaths in the United States. Colorectal polyps that grow on the intima of the colon or rectum is an important precursor for CRC. Currently, the most common way for colorectal polyp detection and precancerous pathology is the colonoscopy. Therefore, accurate colorectal polyp segmentation during the colonoscopy procedure has great clinical significance in CRC early detection and prevention. In this paper, we propose a novel end-to-end deep learning framework for the colorectal polyp segmentation. The model we design consists of an encoder to extract multi-scale semantic features and a decoder to expand the feature maps to a polyp segmentation map. We improve the feature representation ability of the encoder by introducing the dilated convolution to learn high-level semantic features without resolution reduction. We further design a simplified decoder which combines multi-scale semantic features with fewer parameters than the traditional architecture. Furthermore, we apply three post processing techniques on the output segmentation map to improve colorectal polyp detection performance. Our method achieves state-of-the-art results on CVC-ClinicDB and ETIS-Larib Polyp DB.

[1]  Hao Chen,et al.  Deep Contextual Networks for Neuronal Structure Segmentation , 2016, AAAI.

[2]  Frank Meng,et al.  Region-Based Automated Localization of Colonoscopy and Wireless Capsule Endoscopy Polyps , 2019, Applied Sciences.

[3]  A. M. Leufkens,et al.  Factors influencing the miss rate of polyps in a back-to-back colonoscopy study , 2012, Endoscopy.

[4]  Paolo Dario,et al.  Fully convolutional neural networks for polyp segmentation in colonoscopy , 2017, Medical Imaging.

[5]  F. Kolligs,et al.  Diagnostics and Epidemiology of Colorectal Cancer , 2016, Visceral Medicine.

[6]  Fernando Vilariño,et al.  Towards automatic polyp detection with a polyp appearance model , 2012, Pattern Recognit..

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Isabel N. Figueiredo,et al.  Automated Polyp Detection in Colon Capsule Endoscopy , 2013, IEEE Transactions on Medical Imaging.

[9]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Aymeric Histace,et al.  Towards embedded detection of polyps in WCE images for early diagnosis of colorectal cancer , 2016 .

[11]  T. Berzin,et al.  Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy , 2018, Nature Biomedical Engineering.

[12]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[13]  Tianfu Wang,et al.  Colorectal polyp segmentation using a fully convolutional neural network , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[14]  Ebrahim Nasr-Esfahani,et al.  Polyp Segmentation in Colonoscopy Images Using Fully Convolutional Network , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  Bogdan J. Matuszewski,et al.  GIANA Polyp Segmentation with Fully Convolutional Dilation Neural Networks , 2019, VISIGRAPP.

[16]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  Nima Tajbakhsh,et al.  Automated Polyp Detection in Colonoscopy Videos Using Shape and Context Information , 2016, IEEE Transactions on Medical Imaging.

[19]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[20]  Aymeric Histace,et al.  Comparative Validation of Polyp Detection Methods in Video Colonoscopy: Results From the MICCAI 2015 Endoscopic Vision Challenge , 2017, IEEE Transactions on Medical Imaging.

[21]  Martha Larson,et al.  How 'How' Reflects What's What: Content-based Exploitation of How Users Frame Social Images , 2014, ACM Multimedia.

[22]  Gregory G. Slabaugh,et al.  Automatic Segmentation of Polyps in Colonoscopic Narrow-Band Imaging Data , 2012, IEEE Transactions on Biomedical Engineering.

[23]  Andreas Holzinger,et al.  Biomedical image augmentation using Augmentor , 2019, Bioinform..

[24]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Aymeric Histace,et al.  Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer , 2014, International Journal of Computer Assisted Radiology and Surgery.

[26]  Kazufumi Kaneda,et al.  Computer-Aided Colorectal Tumor Classification in NBI Endoscopy Using CNN Features , 2016, ArXiv.

[27]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Quan Wang,et al.  An Efficient Approach for Polyps Detection in Endoscopic Videos Based on Faster R-CNN , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[29]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[30]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Fernando Vilariño,et al.  WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians , 2015, Comput. Medical Imaging Graph..

[32]  Til Aach,et al.  Polyp Segmentation in NBI Colonoscopy , 2009, Bildverarbeitung für die Medizin.

[33]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Andreas Uhl,et al.  Colonic Polyp Classification with Convolutional Neural Networks , 2016, 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS).

[35]  Marius Pedersen,et al.  Y-Net: A deep Convolutional Neural Network for Polyp Detection , 2018, BMVC.