3D Patchwise U-Net with Transition Layers for MR Brain Segmentation

We propose a new patch based 3D convolutional neural network to automatically segment multiple brain structures on Magnetic Resonance (MR) images. The proposed network consists of encoding layers to extract informative features and decoding layers to reconstruct the segmentation labels. Unlike the conventional U-net model, we use transition layers between the encoding layers and the decoding layers to emphasize the impact of feature maps in the decoding layers. Moreover, we use batch normalization on every convolution layer to make a well generalized model. Finally, we utilize a new loss function which can normalize the categorical cross entropy to accurately segment the relatively small interest regions which are opt to be misclassified. The proposed method ranked 1\(^{st}\) over 22 participants at the MRBrainS18 segmentation challenge at MICCAI 2018.

[1]  Anton van den Hengel,et al.  High-performance Semantic Segmentation Using Very Deep Fully Convolutional Networks , 2016, ArXiv.

[2]  Chang Liu,et al.  Automatic Semantic Segmentation of Brain Gliomas from MRI Images Using a Deep Cascaded Neural Network , 2018, Journal of healthcare engineering.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[5]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[6]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[7]  Vinod Pankajakshan,et al.  A deep learning architecture for brain tumor segmentation in MRI images , 2017, 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP).

[8]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[9]  Wilfried Philips,et al.  MRI Segmentation of the Human Brain: Challenges, Methods, and Applications , 2015, Comput. Math. Methods Medicine.

[10]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[11]  Hao Chen,et al.  VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain Segmentation , 2016, ArXiv.