Domain and Content Adaptive Convolution for Domain Generalization in Medical Image Segmentation

The domain gap caused mainly by variable medical image quality renders a major obstacle on the path between training a segmentation model in the lab and applying the trained model to unseen clinical data. To address this issue, domain generalization methods have been proposed, which however usually use static convolutions and are less flexible. In this paper, we propose a multi-source domain generalization model, namely domain and content adaptive convolution (DCAC), for medical image segmentation. Specifically, we design the domain adaptive convolution (DAC) module and content adaptive convolution (CAC) module and incorporate both into an encoder-decoder backbone. In the DAC module, a dynamic convolutional head is conditioned on the predicted domain code of the input to make our model adapt to the unseen target domain. In the CAC module, a dynamic convolutional head is conditioned on the global image features to make our model adapt to the test image. We evaluated the DCAC model against the baseline and four state-of-the-art domain generalization methods on the prostate segmentation, COVID-19 lesion segmentation, and optic cup/optic disc segmentation tasks. Our results indicate that the proposed DCAC model outperforms all competing methods on each segmentation task, and also demonstrate the effectiveness of the DAC

[1]  Jens Petersen,et al.  nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation , 2020, Nature Methods.

[2]  Sotirios A. Tsaftaris,et al.  Semi-supervised Meta-learning with Disentanglement for Domain-generalised Medical Image Segmentation , 2021, MICCAI.

[3]  Qiang Zhou,et al.  Duplex adversarial networks for multiple-source domain adaptation , 2021, Knowl. Based Syst..

[4]  Nima Tajbakhsh,et al.  UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation , 2020, IEEE Transactions on Medical Imaging.

[5]  Shiqi Wang,et al.  Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularization , 2020, NeurIPS.

[6]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[7]  Chunhua Shen,et al.  DoDNet: Learning to Segment Multi-Organ and Tumors from Multiple Partially Labeled Datasets , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Seong Jae Hwang,et al.  Robust White Matter Hyperintensity Segmentation On Unseen Domain , 2021, 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI).

[9]  Dana I. Casetti-Dinescu,et al.  Generalizable Multi-Site Training and Testing Of Deep Neural Networks Using Image Normalization , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[10]  Huchuan Lu,et al.  Hierarchical Dynamic Filtering Network for RGB-D Salient Object Detection , 2020, ECCV.

[11]  Stefano Soatto,et al.  FDA: Fourier Domain Adaptation for Semantic Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Chi-Wing Fu,et al.  Boundary and Entropy-driven Adversarial Learning for Fundus Image Segmentation , 2019, MICCAI.

[13]  Thomas Brox,et al.  U-Net: deep learning for cell counting, detection, and morphometry , 2018, Nature Methods.

[14]  Aaron Carass,et al.  Autoencoder based self-supervised test-time adaptation for medical image analysis , 2021, Medical Image Anal..

[15]  Varun Jampani,et al.  Decoupled Dynamic Filter Networks , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Lior Wolf,et al.  A Dynamic Convolutional Layer for short rangeweather prediction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Yongxin Yang,et al.  Episodic Training for Domain Generalization , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[18]  Yizhou Yu,et al.  Domain Generalization on Medical Imaging Classification using Episodic Training with Task Augmentation , 2021, Comput. Biol. Medicine.

[19]  Jing Qin,et al.  Domain-invariant interpretable fundus image quality assessment , 2020, Medical Image Anal..

[20]  Krishna Chaitanya,et al.  Test-Time Adaptable Neural Networks for Robust Medical Image Segmentation , 2020, Medical image analysis.

[21]  Yu Qiao,et al.  Dynamic Multi-Scale Filters for Semantic Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[22]  Klaus H. Maier-Hein,et al.  Rapid Artificial Intelligence Solutions in a Pandemic - The COVID-19-20 Lung CT Lesion Segmentation Challenge , 2021, Research square.

[23]  Ling Shao,et al.  MetaNorm: Learning to Normalize Few-Shot Batches Across Domains , 2021, ICLR.

[24]  Shaojie Tang,et al.  A survey on incorporating domain knowledge into deep learning for medical image analysis , 2020, Medical Image Anal..

[25]  Lequan Yu,et al.  MS-Net: Multi-Site Network for Improving Prostate Segmentation With Heterogeneous MRI Data , 2020, IEEE Transactions on Medical Imaging.

[26]  Qifei Wang,et al.  Adversarially Adaptive Normalization for Single Domain Generalization , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Lequan Yu,et al.  DoFE: Domain-Oriented Feature Embedding for Generalizable Fundus Image Segmentation on Unseen Datasets , 2020, IEEE Transactions on Medical Imaging.

[28]  Gao Huang,et al.  Dynamic Neural Networks: A Survey , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Pheng-Ann Heng,et al.  Shape-aware Meta-learning for Generalizing Prostate MRI Segmentation to Unseen Domains , 2020, MICCAI.

[30]  Daguang Xu,et al.  Generalizing Deep Learning for Medical Image Segmentation to Unseen Domains via Deep Stacked Transformation , 2020, IEEE Transactions on Medical Imaging.

[31]  Pheng-Ann Heng,et al.  FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Space , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Chunhua Shen,et al.  Conditional Convolutions for Instance Segmentation , 2020, ECCV.