A longitudinal human phantom reliability study of multi-center T1-weighted, DTI, and resting state fMRI data

Multi-center MRI studies can enhance power, generalizability, and discovery for clinical neuroimaging research in brain disorders. Here, we sought to establish the utility of a clustering algorithm as an alternative to more traditional intra-class correlation coefficient approaches in a longitudinal multi-center human phantom study. We completed annual reliability scans on 'travelling human phantoms'. Acquisitions across sites were harmonized prospectively. Twenty-seven MRI sessions were available across four participants, scanned on five scanners, across three years. For each scan, three metrics were extracted: cortical thickness (CT), white matter fractional anisotropy (FA), and resting state functional connectivity (FC). For each metric, hierarchical clustering (Ward's method) was performed. The cluster solutions were compared to participant and scanner using the adjusted Rand index (ARI). For all metrics, data clustered by participant rather than by scanner (ARI > 0.8 comparing clusters to participants, ARI < 0.2 comparing clusters to scanners). These results demonstrate that hierarchical clustering can reliably identify structural and functional scans from different participants imaged on different scanners across time. With increasing interest in data-driven approaches in psychiatric and neurologic brain imaging studies, our findings provide a framework for multi-center analytic approaches aiming to identify subgroups of participants based on brain structure or function.

[1]  Peter Savadjiev,et al.  Inter-site and inter-scanner diffusion MRI data harmonization , 2016, NeuroImage.

[2]  Mary E. Meyerand,et al.  The effect of scan length on the reliability of resting-state fMRI connectivity estimates , 2013, NeuroImage.

[3]  Giovanni B. Frisoni,et al.  Brain morphometry reproducibility in multi-center 3T MRI studies: A comparison of cross-sectional and longitudinal segmentations , 2013, NeuroImage.

[4]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[5]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[6]  Ludovico Minati,et al.  Longitudinal reproducibility of default-mode network connectivity in healthy elderly participants: A multicentric resting-state fMRI study , 2016, NeuroImage.

[7]  M. Fox,et al.  Individual Variability in Functional Connectivity Architecture of the Human Brain , 2013, Neuron.

[8]  Christian Gaser,et al.  Reduced cortical thickness in first episode schizophrenia , 2010, Schizophrenia Research.

[9]  Jessica A. Turner,et al.  Exploration of scanning effects in multi-site structural MRI studies , 2014, Journal of Neuroscience Methods.

[10]  Magda Tsolaki,et al.  Multisite longitudinal reliability of tract-based spatial statistics in diffusion tensor imaging of healthy elderly subjects , 2014, NeuroImage.

[11]  Daniel Rueckert,et al.  Tract-based spatial statistics: Voxelwise analysis of multi-subject diffusion data , 2006, NeuroImage.

[12]  Peter Kochunov,et al.  A novel DTI-QA tool: Automated metric extraction exploiting the sphericity of an agar filled phantom. , 2018, Magnetic resonance imaging.

[13]  M. Baker 1,500 scientists lift the lid on reproducibility , 2016, Nature.

[14]  Yuan Zhou,et al.  Functional dysconnectivity of the dorsolateral prefrontal cortex in first-episode schizophrenia using resting-state fMRI , 2007, Neuroscience Letters.

[15]  Mathijs Raemaekers,et al.  Task and task‐free FMRI reproducibility comparison for motor network identification , 2014, Human brain mapping.

[16]  Vivek Prabhakaran,et al.  The effect of resting condition on resting-state fMRI reliability and consistency: A comparison between resting with eyes open, closed, and fixated , 2013, NeuroImage.

[17]  Dustin Scheinost,et al.  Using connectome-based predictive modeling to predict individual behavior from brain connectivity , 2017, Nature Protocols.

[18]  D. Yurgelun-Todd,et al.  Reproducibility of Single-Subject Functional Connectivity Measurements , 2011, American Journal of Neuroradiology.

[19]  S. Wakana,et al.  MRI Atlas of Human White Matter , 2005 .

[20]  P. DeRosse,et al.  Further neuroimaging evidence for the deficit subtype of schizophrenia: a cortical connectomics analysis. , 2015, JAMA psychiatry.

[21]  Theo G. M. van Erp,et al.  Reliability of functional magnetic resonance imaging activation during working memory in a multi-site study: Analysis from the North American Prodrome Longitudinal Study , 2014, NeuroImage.

[22]  Paul M. Thompson,et al.  Multi-site genetic analysis of diffusion images and voxelwise heritability analysis: A pilot project of the ENIGMA–DTI working group , 2013, NeuroImage.

[23]  Feng Gao,et al.  Retrospective motion correction protocol for high‐resolution anatomical MRI , 2006, Human brain mapping.

[24]  Ragini Verma,et al.  Harmonization of multi-site diffusion tensor imaging data , 2017, NeuroImage.

[25]  Aysenil Belger,et al.  Reliability of an fMRI paradigm for emotional processing in a multisite longitudinal study , 2015, Human brain mapping.

[26]  Xue Wang,et al.  Reproducibility of Structural, Resting-State BOLD and DTI Data between Identical Scanners , 2012, PloS one.

[27]  Michele T. Diaz,et al.  Function biomedical informatics research network recommendations for prospective multicenter functional MRI studies , 2012, Journal of magnetic resonance imaging : JMRI.

[28]  Xenophon Papademetris,et al.  Groupwise whole-brain parcellation from resting-state fMRI data for network node identification , 2013, NeuroImage.

[29]  Abraham Z. Snyder,et al.  Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion , 2012, NeuroImage.

[30]  Evan M. Gordon,et al.  Precision Functional Mapping of Individual Human Brains , 2017, Neuron.

[31]  A. Pfefferbaum,et al.  Replicability of diffusion tensor imaging measurements of fractional anisotropy and trace in brain , 2003, Journal of magnetic resonance imaging : JMRI.

[32]  M. B. Nebel,et al.  Quantifying the reliability of image replication studies: The image intraclass correlation coefficient (I2C2) , 2013, Cognitive, affective & behavioral neuroscience.

[33]  Ann S. Choe,et al.  Reproducibility and Temporal Structure in Weekly Resting-State fMRI over a Period of 3.5 Years , 2015, PloS one.

[34]  Mary Beth Nebel,et al.  Reduction of motion-related artifacts in resting state fMRI using aCompCor , 2014, NeuroImage.

[35]  R. Peeters,et al.  Multi-center reproducibility of structural, diffusion tensor, and resting state functional magnetic resonance imaging measures , 2018, Neuroradiology.

[36]  T. Insel,et al.  Wesleyan University From the SelectedWorks of Charles A . Sanislow , Ph . D . 2010 Research Domain Criteria ( RDoC ) : Toward a New Classification Framework for Research on Mental Disorders , 2018 .

[37]  Lauren E. Ethridge,et al.  Identification of Distinct Psychosis Biotypes Using Brain-Based Biomarkers. , 2016, The American journal of psychiatry.

[38]  Paul M. Thompson,et al.  Heritability and reliability of automatically segmented human hippocampal formation subregions , 2015, NeuroImage.

[39]  Magda Tsolaki,et al.  The AddNeuroMed framework for multi‐centre MRI assessment of Alzheimer's disease : experience from the first 24 months , 2011, International journal of geriatric psychiatry.

[40]  Evan M. Gordon,et al.  Functional System and Areal Organization of a Highly Sampled Individual Human Brain , 2015, Neuron.

[41]  Simon B. Eickhoff,et al.  An improved framework for confound regression and filtering for control of motion artifact in the preprocessing of resting-state functional connectivity data , 2013, NeuroImage.

[42]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[43]  Jessica A. Turner,et al.  Multi-site study of diffusion metric variability: effects of site, vendor, field strength, and echo time on regions-of-interest and histogram-bin analyses , 2016, SPIE Medical Imaging.

[44]  Jessica A. Turner,et al.  Multisite reliability of cognitive BOLD data , 2011, NeuroImage.

[45]  K. Vogeley,et al.  Resting-state functional network correlates of psychotic symptoms in schizophrenia , 2010, Schizophrenia Research.

[46]  Timothy Edward John Behrens,et al.  Task-free MRI predicts individual differences in brain activity during task performance , 2016, Science.

[47]  B. Pollock,et al.  Diffusion tensor tractography findings in schizophrenia across the adult lifespan. , 2010, Brain : a journal of neurology.

[48]  Dustin Scheinost,et al.  Influences on the Test–Retest Reliability of Functional Connectivity MRI and its Relationship with Behavioral Utility , 2017, Cerebral cortex.

[49]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[50]  M. Chun,et al.  Functional connectome fingerprinting: Identifying individuals based on patterns of brain connectivity , 2015, Nature Neuroscience.

[51]  Daniel H. Mathalon,et al.  Reliability of functional magnetic resonance imaging activation during working memory in a multisite study: Clarification and implications for statistical power , 2017, NeuroImage.

[52]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[53]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[54]  Richard Frayne,et al.  Reliability of neuroanatomical measurements in a multisite longitudinal study of youth at risk for psychosis , 2014, Human brain mapping.

[55]  André J. W. van der Kouwe,et al.  Reliability of MRI-derived cortical and subcortical morphometric measures: Effects of pulse sequence, voxel geometry, and parallel imaging , 2009, NeuroImage.

[56]  Andrew T. Drysdale,et al.  Resting-state connectivity biomarkers define neurophysiological subtypes of depression , 2016, Nature Medicine.

[57]  Joshua Carp,et al.  Optimizing the order of operations for movement scrubbing: Comment on Power et al. , 2013, NeuroImage.

[58]  David M. Groppe,et al.  Neurophysiological Investigation of Spontaneous Correlated and Anticorrelated Fluctuations of the BOLD Signal , 2013, The Journal of Neuroscience.