Semi-supervised Segmentation of Liver Using Adversarial Learning with Deep Atlas Prior

Medical image segmentation is one of the most important steps in computer-aided intervention and diagnosis. Although deep learning-based segmentation methods have achieved great success in computer vision domain, there are still several challenges in medical image domain. In comparison with natural images, medical image databases are usually small because the annotation is extremely time-consuming and requires expert knowledge. Thus, effective use of unannotated data is essential for medical image segmentation. On the other hand, medical images have many anatomical priors in comparison to non-medical images such as the shape and position of organs. Incorporating the anatomical prior knowledge in deep learning is a vital issue for accurate medical image segmentation. To address these two problems, in this paper we proposed a semi-supervised adversarial learning model with Deep Atlas Prior (DAP) to improve the accuracy of liver segmentation in CT images. We trained the semi-supervised adversarial learning model using both annotated and unannotated images. The DAP, which is based on the probability atlas of organ (liver) and contains prior information such as the shape and position, is combined with the conventional focal loss to aid segmentation. We call the combined loss as Bayesian loss and the conventional focal loss that utilizes the predicted probabilities of training data in the previous learning epoch as a likelihood loss. Experiments on ISBI LiTS 2017 challenge dataset showed that the performance of the semi-supervised network was significantly improved by incorporating with DAP.

[1]  Fang Lu,et al.  Automatic 3D liver location and segmentation via convolutional neural network and graph cut , 2016, International Journal of Computer Assisted Radiology and Surgery.

[2]  Concetto Spampinato,et al.  Semi Supervised Semantic Segmentation Using Generative Adversarial Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Yen-Wei Chen,et al.  Segmentation of liver and spleen based on computational anatomy models , 2015, Comput. Biol. Medicine.

[4]  Nikos Paragios,et al.  AtlasNet: Multi-atlas Non-linear Deep Networks for Medical Image Segmentation , 2018, MICCAI.

[5]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[6]  Xiaoming Liu,et al.  Semi-Supervised Automatic Segmentation of Layer and Fluid Region in Retinal Optical Coherence Tomography Images Using Adversarial Learning , 2019, IEEE Access.

[7]  Yaozong Gao,et al.  ASDNet: Attention Based Semi-supervised Deep Networks for Medical Image Segmentation , 2018, MICCAI.

[8]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Daniel Rueckert,et al.  Discriminative dictionary learning for abdominal multi-organ segmentation , 2015, Medical Image Anal..

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.