MSN-Net: a multi-scale context nested U-Net for liver segmentation

Liver segmentation is critical for the location and diagnosis of liver cancer. The variant of U-Net network with skip connections has become popular in the medical image segmentation field. However, these variant networks tend to fuse semantically dissimilar feature maps via simple skip connections between encoder and decoder path. We argue that the network learning task would be handled easily when the feature maps from the encoder-decoder path are semantically similar. The fusion of semantically dissimilar feature maps can cause gaps between feature maps. Hence, the proposed method in this paper is to obtain semantically similar feature maps, alleviate the semantic gaps caused by simple skip connections, and improve segmentation accuracy. In this paper, we proposed a new U-Net architecture named Multi-Scale Nested U-Net (MSN-Net). The MSN-Net consists of Res-block and MSCF-block. The Res-block with the bottleneck layer is used to make the network deeper and avoid gradient disappearance. To alleviate the semantic gaps, we redesign a novel skip connection. The novel skip connection consists of MSCF-block and dense connections. The MSCF-block combines High-level and Low-level features and Multi-scale semantic information to obtain more representative features. The densely connections are adopted between MSCF-blocks. In addition, we use a weighted loss function which consists of cross-entropy loss and Dice loss. The proposed method is evaluated on the dataset of MICCAI 2017 LiTS Challenge. The results of experiment demonstrate that, MSN-Net can effectively alleviate the semantic gaps and outperform other state-of-the-art methods. The method proposed with the novel skip connections can effectively alleviate the semantic gaps between encoder and decoder path and improve segmentation accuracy of the network.

[1]  Xin Yang,et al.  Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound , 2019, IEEE Transactions on Medical Imaging.

[2]  Pheng-Ann Heng,et al.  Channel-Unet: A Spatial Channel-Wise Convolutional Neural Network for Liver and Tumors Segmentation , 2019, Front. Genet..

[3]  Nima Tajbakhsh,et al.  UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation , 2020, IEEE Transactions on Medical Imaging.

[4]  Mohammad Sohel Rahman,et al.  MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation , 2019, Neural Networks.

[5]  Dinggang Shen,et al.  High-Resolution Encoder–Decoder Networks for Low-Contrast Medical Image Segmentation , 2020, IEEE Transactions on Image Processing.

[6]  Oscar Camara,et al.  Generalized Overlap Measures for Evaluation and Validation in Medical Image Analysis , 2006, IEEE Transactions on Medical Imaging.

[7]  Fan Meng,et al.  U-Next: A Novel Convolution Neural Network With an Aggregation U-Net Architecture for Gallstone Segmentation in CT Images , 2019, IEEE Access.

[8]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[9]  Junping Zhao,et al.  GC-Net: Global context network for medical image segmentation , 2020, Comput. Methods Programs Biomed..

[10]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[12]  Liang Chen,et al.  DRINet for Medical Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[13]  Sonya Coleman,et al.  DENSE-INception U-net for medical image segmentation , 2020, Comput. Methods Programs Biomed..

[14]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Kang Ryoung Park,et al.  FRED-Net: Fully residual encoder-decoder network for accurate iris segmentation , 2019, Expert Syst. Appl..