Harmonization of Infant Cortical Thickness Using Surface-to-Surface Cycle-Consistent Adversarial Networks

Increasing multi-site infant neuroimaging datasets are facilitating the research on understanding early brain development with larger sample size and bigger statistical power. However, a joint analysis of cortical properties (e.g., cortical thickness) is unavoidably facing the problem of non-biological variance introduced by differences in MRI scanners. To address this issue, in this paper, we propose cycle-consistent adversarial networks based on spherical cortical surface to harmonize cortical thickness maps between different scanners. We combine the spherical U-Net and CycleGAN to construct a surface-to-surface CycleGAN (S2SGAN). Specifically, we model the harmonization from scanner X to scanner Y as a surface-to-surface translation task. The first goal of harmonization is to learn a mapping G X : X → Y such that the distribution of surface thickness maps from G X (X) is indistinguishable from Y. Since this mapping is highly under-constrained, with the second goal of harmonization to preserve individual differences, we utilize the inverse mapping G Y : Y → X and the cycle consistency loss to enforce G Y (G X (X)) ≈ X (and vice versa). Furthermore, we incorporate the correlation coefficient loss to guarantee the structure consistency between the original and the generated surface thickness maps. Quantitative evaluation on both synthesized and real infant cortical data demonstrates the superior ability of our method in removing unwanted scanner effects and preserving individual differences simultaneously, compared to the state-of-the-art methods.

[1]  Dinggang Shen,et al.  The UNC/UMN Baby Connectome Project (BCP): An overview of the study design and protocol development , 2019, NeuroImage.

[2]  Dinggang Shen,et al.  Spherical U-Net For Infant Cortical Surface Parcellation , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[3]  Yogesh Rathi,et al.  Retrospective harmonization of multi-site diffusion MRI data acquired with different acquisition parameters , 2019, NeuroImage.

[4]  Peter Savadjiev,et al.  Harmonizing Diffusion MRI Data Across Multiple Sites and Scanners , 2015, MICCAI.

[5]  Pew-Thian Yap,et al.  Multi-Site Harmonization of Diffusion MRI Data via Method of Moments , 2019, IEEE Transactions on Medical Imaging.

[6]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[7]  Dinggang Shen,et al.  Computational neuroanatomy of baby brains: A review , 2019, NeuroImage.

[8]  Dinggang Shen,et al.  Construction of 4D high-definition cortical surface atlases of infants: Methods and applications , 2015, Medical Image Anal..

[9]  Anders M. Dale,et al.  Reliability of MRI-derived measurements of human cerebral cortical thickness: The effects of field strength, scanner upgrade and manufacturer , 2006, NeuroImage.

[10]  K. Ohtomo,et al.  Effect of scanner in longitudinal studies of brain volume changes , 2011, Journal of magnetic resonance imaging : JMRI.

[11]  Dinggang Shen,et al.  Spherical U-Net on Cortical Surfaces: Methods and Applications , 2019, IPMI.

[12]  Russell T. Shinohara,et al.  Harmonization of cortical thickness measurements across scanners and sites , 2017, NeuroImage.