Entropy Guided Unsupervised Domain Adaptation for Cross-Center Hip Cartilage Segmentation from MRI

Hip cartilage damage is a major predictor of the clinical outcome of surgical correction for femoroacetabular impingement (FAI) and hip dysplasia. Automatic segmentation for hip cartilage is an essential prior step in assessing cartilage damage status. Deep Convolutional Neural Networks have shown great success in various automated medical image segmentations, but testing on domain-shifted datasets (e.g. images obtained from different centers) can lead to severe performance losses. Creating annotations for each center is particularly expensive. Unsupervised Domain Adaptation (UDA) addresses this challenge by transferring knowledge from a domain with labels (source domain) to a domain without labels (target domain). In this paper, we propose an entropy-guided domain adaptation method to address this challenge. Specifically, we first trained our model with supervised loss on the source domain, which enables low-entropy predictions on source-like images. Two discriminators were then used to minimize the gap between source and target domain with respect to the alignment of feature and entropy distribution: the feature map discriminator \(D_F\) and the entropy map discriminator \(D_E\). \(D_F\) aligns the feature map of different domains, while \(D_E\) matches the target segmentation to low-entropy predictions like those from the source domain. The results of comprehensive experiments on cross-center MRI hip cartilage segmentation show the effectiveness of this method.

[1]  Yoshua Bengio,et al.  Semi-supervised Learning by Entropy Minimization , 2004, CAP.

[2]  Moritz Tannast,et al.  What Are the Risk Factors for Revision Surgery After Hip Arthroscopy for Femoroacetabular Impingement at 7-year Followup? , 2017, Clinical orthopaedics and related research.

[3]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[4]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Hao Chen,et al.  Semantic-Aware Generative Adversarial Nets for Unsupervised Domain Adaptation in Chest X-ray Segmentation , 2018, MLMI@MICCAI.

[6]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[8]  Moritz Tannast,et al.  Automatic MRI-based Three-dimensional Models of Hip Cartilage Provide Improved Morphologic and Biochemical Analysis , 2019, Clinical orthopaedics and related research.

[9]  Tatsuya Harada,et al.  Maximum Classifier Discrepancy for Unsupervised Domain Adaptation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Hao Chen,et al.  Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation , 2020, IEEE Transactions on Medical Imaging.

[11]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  Konstantinos Kamnitsas,et al.  Unsupervised domain adaptation in brain lesion segmentation with adversarial networks , 2016, IPMI.

[13]  Hao Chen,et al.  Unsupervised Cross-Modality Domain Adaptation of ConvNets for Biomedical Image Segmentations with Adversarial Loss , 2018, IJCAI.

[14]  Jost Tobias Springenberg,et al.  Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks , 2015, ICLR.