Cross-scanner reproducibility and harmonization of a diffusion MRI structural brain network: A traveling subject study of multi-b acquisition

Characterization of brain networks by diffusion MRI (dMRI) has rapidly evolved, and there are ongoing movements toward data sharing and multi-center studies. To extract meaningful information from multi-center data, methods to correct for the bias caused by scanner differences, that is, harmonization, are urgently needed. In this work, we report the cross-scanner differences in structural network analyses using data from nine traveling subjects (four males and five females, 21-49 years-old) who underwent scanning using four 3T scanners (public database available from the Brain/MINDS Beyond Human Brain MRI project (http://mriportal.umin.jp/)). The reliability and reproducibility were compared to those of data from another set of four subjects (all males, 29-42 years-old) who underwent scan-rescan (interval, 105-147 days) with the same scanner as well as scan-rescan data from the Human Connectome Project database. The results demonstrated that the reliability of the edge weights and graph theory metrics was lower for data including different scanners, compared to the scan-rescan with the same scanner. Besides, systematic differences between scanners were observed, indicating the risk of bias in comparing networks obtained from different scanners directly. We further demonstrate that it is feasible to reduce inter-scanner variabilities while preserving the inter-subject differences among healthy individuals by modeling the scanner effects at the level of network matrices, when traveling-subject data are available for calibration between scanners. The present data and results are expected to serve as a basis for developing and evaluating novel harmonization methods.

[1]  Derek K. Jones,et al.  Optimization of graph construction can significantly increase the power of structural brain network studies , 2019, NeuroImage.

[2]  Jan Sijbers,et al.  Harmonization of Brain Diffusion MRI: Concepts and Methods , 2020, Frontiers in Neuroscience.

[3]  Steen Moeller,et al.  Advances in diffusion MRI acquisition and processing in the Human Connectome Project , 2013, NeuroImage.

[4]  Chun-Hung Yeh,et al.  Correction for diffusion MRI fibre tracking biases: The consequences for structural connectomic metrics , 2016, NeuroImage.

[5]  Joseph A. Helpern,et al.  White matter characterization with diffusional kurtosis imaging , 2011, NeuroImage.

[6]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[7]  Derek K. Jones,et al.  Optimization of graph construction can significantly increase the power of structural brain network studies , 2019 .

[8]  O. Sporns,et al.  Rich-Club Organization of the Human Connectome , 2011, The Journal of Neuroscience.

[9]  Kei Yamada,et al.  Variability in absolute apparent diffusion coefficient values across different platforms may be substantial: a multivendor, multi-institutional comparison study. , 2008, Radiology.

[10]  Thomas L Chenevert,et al.  Analysis and correction of gradient nonlinearity bias in apparent diffusion coefficient measurements , 2014, Magnetic resonance in medicine.

[11]  Saori C. Tanaka,et al.  Harmonization of resting-state functional MRI data across multiple imaging sites via the separation of site differences into sampling bias and measurement bias , 2018, bioRxiv.

[12]  Athanasia M. Mowinckel,et al.  Visualisation of Brain Statistics with R-packages ggseg and ggseg3d , 2019, 1912.08200.

[13]  Arthur W. Toga,et al.  The informatics core of the Alzheimer's Disease Neuroimaging Initiative , 2010, Alzheimer's & Dementia.

[14]  Chun-Hung Yeh,et al.  Is removal of weak connections necessary for graph-theoretical analysis of dense weighted structural connectomes from diffusion MRI? , 2019, NeuroImage.

[15]  J. Helpern,et al.  Diffusional kurtosis imaging: The quantification of non‐gaussian water diffusion by means of magnetic resonance imaging , 2005, Magnetic resonance in medicine.

[16]  Jelle Veraart,et al.  Cross-scanner and cross-protocol diffusion MRI data harmonisation: A benchmark database and evaluation of algorithms , 2019, NeuroImage.

[17]  Jacobus F. A. Jansen,et al.  The effect and reproducibility of different clinical DTI gradient sets on small world brain connectivity measures , 2010, NeuroImage.

[18]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[19]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[20]  Paul M. Thompson,et al.  White matter microstructural alterations across four major psychiatric disorders: mega-analysis study in 2937 individuals , 2019, Molecular Psychiatry.

[21]  I. Rezek,et al.  Understanding Heterogeneity in Clinical Cohorts Using Normative Models: Beyond Case-Control Studies , 2016, Biological Psychiatry.

[22]  Derek K. Jones,et al.  Improving the Reliability of Network Metrics in Structural Brain Networks by Integrating Different Network Weighting Strategies into a Single Graph , 2017, Front. Neurosci..

[23]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[24]  The efficacy of different preprocessing steps in reducing motion-related confounds in diffusion MRI connectomics , 2020, NeuroImage.

[25]  Alan Connelly,et al.  Robust determination of the fibre orientation distribution in diffusion MRI: Non-negativity constrained super-resolved spherical deconvolution , 2007, NeuroImage.

[26]  P. Thiran,et al.  Mapping Human Whole-Brain Structural Networks with Diffusion MRI , 2007, PloS one.

[27]  Bruce Fischl,et al.  Accurate and robust brain image alignment using boundary-based registration , 2009, NeuroImage.

[28]  S. Aoki,et al.  MR g-ratio-weighted connectome analysis in patients with multiple sclerosis , 2019, Scientific Reports.

[29]  Nancy Kanwisher,et al.  Structural Connectivity Fingerprints Predict Cortical Selectivity for Multiple Visual Categories across Cortex. , 2016, Cerebral cortex.

[30]  A. Connelly,et al.  Quantitative streamlines tractography: methods and inter-subject normalisation , 2020 .

[31]  Peter Savadjiev,et al.  Multi-site harmonization of diffusion MRI data in a registration framework , 2017, Brain Imaging and Behavior.

[32]  Sharlene D. Newman,et al.  The sensitivity of diffusion MRI to microstructural properties and experimental factors , 2020, Journal of Neuroscience Methods.

[33]  Jean-Philippe Thiran,et al.  Connectivity and tissue microstructural alterations in right and left temporal lobe epilepsy revealed by diffusion spectrum imaging , 2014, NeuroImage: Clinical.

[34]  Andreas Daffertshofer,et al.  Comparing Brain Networks of Different Size and Connectivity Density Using Graph Theory , 2010, PloS one.

[35]  Mark E. Bastin,et al.  The effect of network thresholding and weighting on structural brain networks in the UK Biobank , 2019, NeuroImage.

[36]  Alan Connelly,et al.  SIFT2: Enabling dense quantitative assessment of brain white matter connectivity using streamlines tractography , 2015, NeuroImage.

[37]  Yogesh Rathi,et al.  Retrospective harmonization of multi-site diffusion MRI data acquired with different acquisition parameters , 2019, NeuroImage.

[38]  Andrew Zalesky,et al.  Building connectomes using diffusion MRI: why, how and but , 2017, NMR in biomedicine.

[39]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[40]  Martha Elizabeth Shenton,et al.  Advances in microstructural diffusion neuroimaging for psychiatric disorders , 2018, NeuroImage.

[41]  O. Sporns,et al.  Network hubs in the human brain , 2013, Trends in Cognitive Sciences.

[42]  Hiroshi Imamizu,et al.  Harmonization of resting-state functional MRI data across multiple imaging sites via the separation of site differences into sampling bias and measurement bias , 2018 .

[43]  Ting Gong,et al.  Reproducibility of multi-shell diffusion tractography on traveling subjects: A multicenter study prospective. , 2019, Magnetic resonance imaging.

[44]  Peter Savadjiev,et al.  Harmonizing Diffusion MRI Data Across Multiple Sites and Scanners , 2015, MICCAI.

[45]  Chun-Hung Yeh,et al.  Mapping Structural Connectivity Using Diffusion MRI: Challenges and Opportunities , 2020, Journal of magnetic resonance imaging : JMRI.

[46]  Thomas Dierks,et al.  Validation of Network Communicability Metrics for the Analysis of Brain Structural Networks , 2014, PloS one.

[47]  Lars T. Westlye,et al.  Hierarchical Bayesian Regression for Multi-Site Normative Modeling of Neuroimaging Data , 2020, MICCAI.

[48]  Ian J. Deary,et al.  The effect of network thresholding and weighting on structural brain networks in the UK Biobank , 2020, NeuroImage.

[49]  Jelle Veraart,et al.  Evaluation of the accuracy and precision of the diffusion parameter EStImation with Gibbs and NoisE removal pipeline , 2018, NeuroImage.

[50]  Alan Connelly,et al.  The effects of SIFT on the reproducibility and biological accuracy of the structural connectome , 2015, NeuroImage.

[51]  Chun-Hung Yeh,et al.  MRtrix3: A fast, flexible and open software framework for medical image processing and visualisation , 2019, NeuroImage.

[52]  Ragini Verma,et al.  Harmonization of multi-site diffusion tensor imaging data , 2017, NeuroImage.

[53]  Alan Connelly,et al.  Anatomically-constrained tractography: Improved diffusion MRI streamlines tractography through effective use of anatomical information , 2012, NeuroImage.

[54]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[55]  A. Singleton,et al.  The Parkinson Progression Marker Initiative (PPMI) , 2011, Progress in Neurobiology.

[56]  Stamatios N. Sotiropoulos,et al.  An integrated approach to correction for off-resonance effects and subject movement in diffusion MR imaging , 2016, NeuroImage.

[57]  F. Sepehrband,et al.  Cross-scanner and cross-protocol multi-shell diffusion MRI data harmonization: Algorithms and results , 2020, NeuroImage.

[58]  M. Chun,et al.  Functional connectome fingerprinting: Identifying individuals based on patterns of brain connectivity , 2015, Nature Neuroscience.

[59]  Alan Connelly,et al.  Direct estimation of the fiber orientation density function from diffusion-weighted MRI data using spherical deconvolution , 2004, NeuroImage.

[60]  D. Selkoe Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[61]  On stability of Canonical Correlation Analysis and Partial Least Squares with application to brain-behavior associations , 2020 .

[62]  Yogesh Rathi,et al.  White matter abnormalities across the lifespan of schizophrenia: a harmonized multi-site diffusion MRI study , 2019, Molecular Psychiatry.

[63]  P. Matthews,et al.  Multimodal population brain imaging in the UK Biobank prospective epidemiological study , 2016, Nature Neuroscience.

[64]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[65]  O. Sporns,et al.  A cross-disorder connectome landscape of brain dysconnectivity , 2019, Nature Reviews Neuroscience.

[66]  A. Saykin,et al.  Stability of MRI metrics in the advanced research core of the NCAA-DoD concussion assessment, research and education (CARE) consortium , 2017, Brain Imaging and Behavior.

[67]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[68]  Daniel C. Alexander,et al.  NODDI: Practical in vivo neurite orientation dispersion and density imaging of the human brain , 2012, NeuroImage.

[69]  Peter F. Neher,et al.  The challenge of mapping the human connectome based on diffusion tractography , 2017, Nature Communications.

[70]  Sebastien Ourselin,et al.  The importance of correcting for signal drift in diffusion MRI , 2017, Magnetic resonance in medicine.

[71]  Drew Parker,et al.  Connectomic consistency: a systematic stability analysis of structural and functional connectivity , 2019, bioRxiv.

[72]  Emily L. Dennis,et al.  ENIGMA and global neuroscience: A decade of large-scale studies of the brain in health and disease across more than 40 countries , 2019, Biological Psychiatry.

[73]  K. Kaski,et al.  Intensity and coherence of motifs in weighted complex networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[74]  Cheng Guan Koay,et al.  Analytically exact correction scheme for signal extraction from noisy magnitude MR signals. , 2006, Journal of magnetic resonance.

[75]  F. Dell’Acqua,et al.  Reproducibility, reliability and variability of FA and MD in the older healthy population: A test-retest multiparametric analysis , 2020, NeuroImage: Clinical.

[76]  Olaf Sporns,et al.  Weight-conserving characterization of complex functional brain networks , 2011, NeuroImage.

[77]  A. Connelly,et al.  Determination of the appropriate b value and number of gradient directions for high‐angular‐resolution diffusion‐weighted imaging , 2013, NMR in biomedicine.

[78]  Joseph V. Hajnal,et al.  Complex diffusion-weighted image estimation via matrix recovery under general noise models , 2018, NeuroImage.

[79]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[80]  D. Leopold,et al.  Anatomical accuracy of brain connections derived from diffusion MRI tractography is inherently limited , 2014, Proceedings of the National Academy of Sciences.

[81]  Jean-Philippe Thiran,et al.  Structural connectomics in brain diseases , 2013, NeuroImage.

[82]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[83]  Bibek Dhital,et al.  Gibbs‐ringing artifact removal based on local subvoxel‐shifts , 2015, Magnetic resonance in medicine.

[84]  Alan Connelly,et al.  MRtrix3: A fast, flexible and open software framework for medical image processing and visualisation , 2019, NeuroImage.

[85]  Gregor Körzdörfer,et al.  Toward Quantification: Microstructure and Magnetic Resonance Fingerprinting. , 2020, Investigative radiology.

[86]  Alex Fornito,et al.  The efficacy of different preprocessing steps in reducing motion-related confounds in diffusion MRI connectomics , 2020, NeuroImage.

[87]  Ragini Verma,et al.  Connectomic consistency: a systematic stability analysis of structural and functional connectivity. , 2020, Journal of neural engineering.

[88]  J. Helpern,et al.  Mapping the Orientation of White Matter Fiber Bundles: A Comparative Study of Diffusion Tensor Imaging, Diffusional Kurtosis Imaging, and Diffusion Spectrum Imaging , 2016, American Journal of Neuroradiology.

[89]  Ivan I Maximov,et al.  Towards an optimised processing pipeline for diffusion magnetic resonance imaging data: Effects of artefact corrections on diffusion metrics and their age associations in UK Biobank , 2019, Human brain mapping.

[90]  K. Burnham,et al.  Model selection: An integral part of inference , 1997 .

[91]  Klaas E. Stephan,et al.  The anatomical basis of functional localization in the cortex , 2002, Nature Reviews Neuroscience.

[92]  Cheng Li,et al.  Adjusting batch effects in microarray expression data using empirical Bayes methods. , 2007, Biostatistics.

[93]  O. Coulon,et al.  Diffusion tensor imaging in Parkinson's disease: Review and meta-analysis , 2017, NeuroImage: Clinical.

[94]  Chris Rorden,et al.  Reproducibility of the Structural Brain Connectome Derived from Diffusion Tensor Imaging , 2015, PloS one.

[95]  Wilfried Philips,et al.  Reproducibility and intercorrelation of graph theoretical measures in structural brain connectivity networks , 2019, Medical Image Anal..

[96]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[97]  Jan Sijbers,et al.  Multi-tissue constrained spherical deconvolution for improved analysis of multi-shell diffusion MRI data , 2014, NeuroImage.

[98]  Jan Sijbers,et al.  Denoising of diffusion MRI using random matrix theory , 2016, NeuroImage.

[99]  Joseph V. Hajnal,et al.  Learning Compact ${q}$ -Space Representations for Multi-Shell Diffusion-Weighted MRI , 2018, IEEE Transactions on Medical Imaging.

[100]  N. Toschi,et al.  Diffusion-MRI in neurodegenerative disorders. , 2015, Magnetic Resonance Imaging.

[101]  S. Horvath,et al.  Statistical Applications in Genetics and Molecular Biology , 2011 .

[102]  Brian B. Avants,et al.  The optimal template effect in hippocampus studies of diseased populations , 2010, NeuroImage.