Dynamic Learning Convolutional Network with Skip Layers for Image Segmentation

Training deeper networks make an active research topic, but the appropriate is the best for specific tasks. In this paper, we proposed to design a good and stable convolutional neural network to solve many image segmentation tasks. We designed an optional skip connection module, which contains three convolutional holes. We use different sizes of convolution kernels to obtain different size of views. This module connects up sampling and down sampling layers of the same size, and dynamically adjust the parameters of the model through the skip gate unit on each convolution kernel. Our experiments on retinal and lung segmentation tasks to confirm the usability of the module, and the model automatically selects the appropriate convolutional layer and achieves a specific segmentation effect after training. The experiments prove the feasibility of the scheme and provide help for further optimization of the segmentation model with a suitable convolutional layers and parameters.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Patrick van der Smagt,et al.  CNN-based Segmentation of Medical Imaging Data , 2017, ArXiv.

[3]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Venkatesh Saligrama,et al.  Adaptive Neural Networks for Efficient Inference , 2017, ICML.

[6]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[8]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yee Whye Teh,et al.  The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables , 2016, ICLR.

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.