Multi-path connected network for medical image segmentation

Abstract In recent years, deep learning has been successfully applied to medical image segmentation. However, as the network extends deeper, the consecutive downsampling operations will lead to more loss of spatial information. In addition, the limited data and diverse targets increase the difficulty for medical image segmentation. To address these issues, we propose a multi-path connected network (MCNet) for medical segmentation problems. It integrates multiple paths generated by pyramid pooling into the encoding phase to preserve semantic information and spatial details. We utilize multi-scale feature extractor block (MFE block) in the encoder to obtain large and multi-scale receptive fields. We evaluated MCNet on three medical datasets with different image modalities. The experimental results show that our method achieves better performance than the state-of-the-art approaches. Our model has strong feature learning ability and is robust to capture different scale targets. It can achieve satisfactory results while using only 0.98 million (M) parameters.

[1]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[2]  Xin Wang,et al.  Salient Object Detection in the Distributed Cloud-Edge Intelligent Network , 2020, IEEE Network.

[3]  Jia Liu,et al.  A Cascaded Deep Convolutional Neural Network for Joint Segmentation and Genotype Prediction of Brainstem Gliomas , 2018, IEEE Transactions on Biomedical Engineering.

[4]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Keshab K. Parhi,et al.  Blood Vessel Segmentation of Fundus Images by Major Vessel Extraction and Subimage Classification , 2015, IEEE Journal of Biomedical and Health Informatics.

[6]  Yuan Zhang,et al.  Retinal vessel segmentation of color fundus images using multiscale convolutional neural network with an improved cross-entropy loss function , 2018, Neurocomputing.

[7]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Hao Li,et al.  A multiscale dilated dense convolutional network for saliency prediction with instance-level attention competition , 2019, J. Vis. Commun. Image Represent..

[9]  Maria Wimmer,et al.  Fully Convolutional Architectures for Multiclass Segmentation in Chest Radiographs , 2017, IEEE Transactions on Medical Imaging.

[10]  Lucas J. van Vliet,et al.  An Automated System for the Detection and Classification of Retinal Changes Due to Red Lesions in Longitudinal Fundus Images , 2018, IEEE Transactions on Biomedical Engineering.

[11]  Santi P. Maity,et al.  Automatic Detection of Retinal Lesions for Screening of Diabetic Retinopathy , 2018, IEEE Transactions on Biomedical Engineering.

[12]  Chaoyi Zhang,et al.  Vessel-Net: Retinal Vessel Segmentation Under Multi-path Supervision , 2019, MICCAI.

[13]  Xin Yang,et al.  Joint Segment-Level and Pixel-Wise Losses for Deep Learning Based Retinal Vessel Segmentation , 2018, IEEE Transactions on Biomedical Engineering.

[14]  Yang Song,et al.  3D APA-Net: 3D Adversarial Pyramid Anisotropic Convolutional Network for Prostate Segmentation in MR Images , 2020, IEEE Transactions on Medical Imaging.

[15]  Eduardo Romera,et al.  ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[16]  Luming Zhang,et al.  A mix-pooling CNN architecture with FCRF for brain tumor segmentation , 2019, J. Vis. Commun. Image Represent..

[17]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Mun-Taek Choi,et al.  Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks , 2018, Comput. Methods Programs Biomed..

[19]  Kun Yu,et al.  DenseASPP for Semantic Segmentation in Street Scenes , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Zhiming Luo,et al.  Attention guided U-Net for accurate iris segmentation , 2018, J. Vis. Commun. Image Represent..

[21]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[22]  Qionghai Dai,et al.  Cross-Modality Bridging and Knowledge Transferring for Image Understanding , 2019, IEEE Transactions on Multimedia.

[23]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.