RIIS-DenseNet: Rotation-Invariant and Image Similarity Constrained Densely Connected Convolutional Network for Polyp Detection

Colorectal cancer is the leading cause of cancer-related deaths. Most colorectal cancers are believed to arise from benign adenomatous polyps. Automatic methods for polyp detection with Wireless Capsule Endoscopy (WCE) images are desirable, but the results of current approaches are limited due to the problems of object rotation and high intra-class variability. To address these problems, we propose a rotation invariant and image similarity constrained Densely Connected Convolutional Network (RIIS-DenseNet) model. We first introduce Densely Connected Convolutional Network (DenseNet), which enables the maximum information flow among layers by a densely connected mechanism, to provide end-to-end polyp detection workflow. The rotation-invariant regularization constraint is then introduced to explicitly enforce learned features of the training samples and the corresponding rotation versions to be mapped close to each other. The image similarity constraint is further proposed by imposing the image category information on the features to maintain small intra-class scatter. Our method achieves an inspiring accuracy 95.62% for polyp detection. Extensive experiments on the WCE dataset show that our method has superior performance compared with state-of-the-art methods.

[1]  G. Iddan,et al.  Wireless capsule endoscopy , 2003, Gut.

[2]  Jordi Vitrià,et al.  Generic Feature Learning for Wireless Capsule Endoscopy Analysis , 2016, Comput. Biol. Medicine.

[3]  Hao Chen,et al.  Integrating Online and Offline Three-Dimensional Deep Learning for Automated Polyp Detection in Colonoscopy Videos , 2017, IEEE Journal of Biomedical and Health Informatics.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Nima Tajbakhsh,et al.  Automatic polyp detection in colonoscopy videos using an ensemble of convolutional neural networks , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[7]  Yixuan Yuan,et al.  Deep learning for polyp recognition in wireless capsule endoscopy images , 2017, Medical physics.

[8]  Ilangko Balasingham,et al.  Automatic detection of colonoscopic anomalies using capsule endoscopy , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Ilangko Balasingham,et al.  Comparison of hand-craft feature based SVM and CNN based deep learning framework for automatic polyp classification , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Carmen C. Y. Poon,et al.  Automatic Detection and Classification of Colorectal Polyps by Transferring Low-Level CNN Features From Nonmedical Domain , 2017, IEEE Journal of Biomedical and Health Informatics.