Fan-Net: Fourier-Based Adaptive Normalization for Cross-Domain Stroke Lesion Segmentation

Since stroke is the main cause of various cerebrovascular diseases, deep learning-based stroke lesion segmentation on magnetic resonance (MR) images has attracted considerable attention. However, the existing methods often neglect the domain shift among MR images collected from different sites, which has limited performance improvement. To address this problem, we intend to change style information without affecting high-level semantics via adaptively changing the low-frequency amplitude components of the Fourier transform so as to enhance model robustness to varying domains. Thus, we propose a novel FAN-Net, a U-Net–based segmentation network incorporated with a Fourier-based adaptive normalization (FAN) and a domain classifier with a gradient reversal layer. The FAN module is tailored for learning adaptive affine parameters for the amplitude components of different domains, which can dynamically normalize the style information of source images. Then, the domain classifier provides domain-agnostic knowledge to endow FAN with strong domain generalizability. The experimental results on the ATLAS dataset, which consists of MR images from 9 sites, show the superior performance of the proposed FAN-Net compared with baseline methods.

[1]  Junping Zhang,et al.  SAN-Net: Learning generalization to unseen sites for stroke lesion segmentation with self-adaptive normalization , 2022, Comput. Biol. Medicine.

[2]  D. Koundal,et al.  Deep Neural Networks for Medical Image Segmentation , 2022, Journal of healthcare engineering.

[3]  Zirui Wang,et al.  HarmoFL: Harmonizing Local and Global Drifts in Federated Learning on Heterogeneous Medical Images , 2021, AAAI.

[4]  Qi Tian,et al.  A Fourier-based Framework for Domain Generalization , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Hritam Basak,et al.  DFENet: A Novel Dimension Fusion Edge Guided Network for Brain MRI Segmentation , 2021, SN Computer Science.

[6]  Francesca N. Delling,et al.  Heart Disease and Stroke Statistics-2021 Update: A Report From the American Heart Association. , 2021, Circulation.

[7]  Jens Petersen,et al.  nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation , 2020, Nature Methods.

[8]  Nicola K. Dinsdale,et al.  Deep learning-based unlearning of dataset bias for MRI harmonisation and confound removal , 2020, NeuroImage.

[9]  Yifan Chen,et al.  A 3D+2D CNN Approach Incorporating Boundary Loss for Stroke Lesion Segmentation , 2020, MLMI@MICCAI.

[10]  Dinggang Shen,et al.  Multi-Site Infant Brain Segmentation Algorithms: The iSeg-2019 Challenge , 2020, IEEE Transactions on Medical Imaging.

[11]  Yue Zhang,et al.  MI-UNet: Multi-Inputs UNet Incorporating Brain Parcellation for Stroke Lesion Segmentation From T1-Weighted Magnetic Resonance Images , 2020, IEEE Journal of Biomedical and Health Informatics.

[12]  Lanfen Lin,et al.  UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Stefano Soatto,et al.  FDA: Fourier Domain Adaptation for Semantic Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Kehan Qi,et al.  MSDF-Net: Multi-Scale Deep Fusion Network for Stroke Lesion Segmentation , 2019, IEEE Access.

[15]  Yong Xia,et al.  D-UNet: A Dimension-Fusion U Shape Network for Chronic Stroke Lesion Segmentation , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[16]  Qiegen Liu,et al.  X-Net: Brain Stroke Lesion Segmentation Based on Depthwise Separable Convolution and Long-range Dependencies , 2019, MICCAI.

[17]  Jeffrey R. Binder,et al.  A multi-path 2.5 dimensional convolutional neural network system for segmenting stroke lesions in brain MRI images , 2019, NeuroImage: Clinical.

[18]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[19]  Lei Ai,et al.  A large, open source dataset of stroke anatomical brain images and manual lesion segmentations , 2017, Scientific Data.

[20]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[23]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[24]  Peter D. Welch,et al.  Fast Fourier Transform , 2011, Starting Digital Signal Processing in Telecommunication Engineering.

[25]  L N Piotrowski,et al.  A Demonstration of the Visual Importance and Flexibility of Spatial-Frequency Amplitude and Phase , 1982, Perception.

[26]  Jae S. Lim,et al.  Phase in speech and pictures , 1979, ICASSP.