Comparing test-retest reliability of dynamic functional connectivity methods

Due to the dynamic, condition-dependent nature of brain activity, interest in estimating rapid functional connectivity (FC) changes that occur during resting-state functional magnetic resonance imaging (rs-fMRI) has recently soared. However, studying dynamic FC is methodologically challenging, due to the low signal-to-noise ratio of the blood oxygen level dependent (BOLD) signal in fMRI and the massive number of data points generated during the analysis. Thus, it is important to establish methods and summary measures that maximize reliability and the utility of dynamic FC to provide insight into brain function. In this study, we investigated the reliability of dynamic FC summary measures derived using three commonly used estimation methods - sliding window (SW), tapered sliding window (TSW), and dynamic conditional correlations (DCC) methods. We applied each of these techniques to two publicly available rs-fMRI test-retest data sets - the Multi-Modal MRI Reproducibility Resource (Kirby Data) and the Human Connectome Project (HCP Data). The reliability of two categories of dynamic FC summary measures were assessed, specifically basic summary statistics of the dynamic correlations and summary measures derived from recurring whole-brain patterns of FC ("brain states"). The results provide evidence that dynamic correlations are reliably detected in both test-retest data sets, and the DCC method outperforms SW methods in terms of the reliability of summary statistics. However, across all estimation methods, reliability of the brain state-derived measures was low. Notably, the results also show that the DCC-derived dynamic correlation variances are significantly more reliable than those derived using the non-parametric estimation methods. This is important, as the fluctuations of dynamic FC (i.e., its variance) has a strong potential to provide summary measures that can be used to find meaningful individual differences in dynamic FC. We therefore conclude that utilizing the variance of the dynamic connectivity is an important component in any dynamic FC-derived summary measure.

[1]  Dimitri Van De Ville,et al.  On spurious and real fluctuations of dynamic functional connectivity during rest , 2015, NeuroImage.

[2]  V. Calhoun,et al.  The Chronnectome: Time-Varying Connectivity Networks as the Next Frontier in fMRI Data Discovery , 2014, Neuron.

[3]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[4]  J. Maldjian,et al.  Effect of resting-state functional MR imaging duration on stability of graph theory metrics of brain network connectivity. , 2011, Radiology.

[5]  Danielle S Bassett,et al.  Learning-induced autonomy of sensorimotor systems , 2014, Nature Neuroscience.

[6]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[7]  Jessica A. Turner,et al.  Higher Dimensional Meta-State Analysis Reveals Reduced Resting fMRI Connectivity Dynamism in Schizophrenia Patients , 2016, PloS one.

[8]  Leonardo L. Gollo,et al.  Time-resolved resting-state brain networks , 2014, Proceedings of the National Academy of Sciences.

[9]  Martin A. Lindquist,et al.  Dynamic connectivity detection: an algorithm for determining functional connectivity change points in fMRI data , 2015, Front. Neurosci..

[10]  Catie Chang,et al.  Time–frequency dynamics of resting-state brain connectivity measured with fMRI , 2010, NeuroImage.

[11]  V. Calhoun,et al.  Dynamic connectivity states estimated from resting fMRI Identify differences among Schizophrenia, bipolar disorder, and healthy control subjects , 2014, Front. Hum. Neurosci..

[12]  Chin-Hui Lee,et al.  Evaluation of sliding window correlation performance for characterizing dynamic functional connectivity and brain states , 2016, NeuroImage.

[13]  R. Weisskoff,et al.  Effect of temporal autocorrelation due to physiological noise and stimulus paradigm on voxel‐level false‐positive rates in fMRI , 1998, Human brain mapping.

[14]  Evan M. Gordon,et al.  Functional System and Areal Organization of a Highly Sampled Individual Human Brain , 2015, Neuron.

[15]  Mary E. Meyerand,et al.  The effect of scan length on the reliability of resting-state fMRI connectivity estimates , 2013, NeuroImage.

[16]  Martin A. Lindquist,et al.  Assessing uncertainty in dynamic functional connectivity , 2017, NeuroImage.

[17]  D. Pfaff,et al.  Recovery of consciousness is mediated by a network of discrete metastable activity states , 2014, Proceedings of the National Academy of Sciences.

[18]  Dimitri Van De Ville,et al.  Disentangling dynamic networks: Separated and joint expressions of functional connectivity patterns in time , 2014, Human brain mapping.

[19]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[20]  J. Morton,et al.  Tracking the Brain's Functional Coupling Dynamics over Development , 2015, The Journal of Neuroscience.

[21]  Daniel S. Margulies,et al.  Common intrinsic connectivity states among posteromedial cortex subdivisions: Insights from analysis of temporal dynamics , 2014, NeuroImage.

[22]  William H. Thompson,et al.  The mean–variance relationship reveals two possible strategies for dynamic brain connectivity analysis in fMRI , 2015, Front. Hum. Neurosci..

[23]  Yufeng Zang,et al.  Toward reliable characterization of functional homogeneity in the human brain: Preprocessing, scan duration, imaging resolution and computational space , 2013, NeuroImage.

[24]  R. Engle.  Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[25]  R. Engle.  Dynamic Conditional Correlation , 2002 .

[26]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[27]  Stephen M. Smith,et al.  Probabilistic independent component analysis for functional magnetic resonance imaging , 2004, IEEE Transactions on Medical Imaging.

[28]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[29]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[30]  Steen Moeller,et al.  Pushing spatial and temporal resolution for functional and diffusion MRI in the Human Connectome Project , 2013, NeuroImage.

[31]  D. Bassett,et al.  Emergence of system roles in normative neurodevelopment , 2015, Proceedings of the National Academy of Sciences.

[32]  J. Pekar,et al.  A method for making group inferences from functional MRI data using independent component analysis , 2001, Human brain mapping.

[33]  Yufeng Zang,et al.  Functional brain hubs and their test–retest reliability: A multiband resting-state functional MRI study , 2013, NeuroImage.

[34]  Walter Schneider,et al.  Identifying the brain's most globally connected regions , 2010, NeuroImage.

[35]  Steen Moeller,et al.  Evaluation of highly accelerated simultaneous multi-slice EPI for fMRI , 2015, NeuroImage.

[36]  Vince D Calhoun,et al.  Dynamic functional connectivity of neurocognitive networks in children , 2017, Human brain mapping.

[37]  Aapo Hyvärinen,et al.  Validating the independent components of neuroimaging time series via clustering and visualization , 2004, NeuroImage.

[38]  Ludovica Griffanti,et al.  Automatic denoising of functional MRI data: Combining independent component analysis and hierarchical fusion of classifiers , 2014, NeuroImage.

[39]  Martin A. Lindquist,et al.  Detecting functional connectivity change points for single-subject fMRI data , 2013, Front. Comput. Neurosci..

[40]  Vince D. Calhoun,et al.  Capturing inter-subject variability with group independent component analysis of fMRI data: A simulation study , 2012, NeuroImage.

[41]  Rex E. Jung,et al.  A Baseline for the Multivariate Comparison of Resting-State Networks , 2011, Front. Syst. Neurosci..

[42]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[43]  Jaroslav Hlinka,et al.  On the danger of detecting network states in white noise , 2015, Front. Comput. Neurosci..

[44]  Eswar Damaraju,et al.  Tracking whole-brain connectivity dynamics in the resting state. , 2014, Cerebral cortex.

[45]  A. Belger,et al.  Dynamic functional connectivity analysis reveals transient states of dysconnectivity in schizophrenia , 2014, NeuroImage: Clinical.

[46]  Tülay Adali,et al.  Estimating the number of independent components for functional magnetic resonance imaging data , 2007, Human brain mapping.

[47]  Mark W. Woolrich,et al.  Resting-state fMRI in the Human Connectome Project , 2013, NeuroImage.

[48]  Scott T. Grafton,et al.  Dynamic reconfiguration of human brain networks during learning , 2010, Proceedings of the National Academy of Sciences.

[49]  R. Turner,et al.  Echo-planar imaging: magnetic resonance imaging in a fraction of a second. , 1991, Science.

[50]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[51]  Vince D. Calhoun,et al.  Time-varying spectral power of resting-state fMRI networks reveal cross-frequency dependence in dynamic connectivity , 2017, PloS one.

[52]  P. Hansen,et al.  A Forecast Comparison of Volatility Models: Does Anything Beat a Garch(1,1)? , 2004 .

[53]  D. Cicchetti.  Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. , 1994 .

[54]  Sepideh Sadaghiani,et al.  Ongoing dynamics in large-scale functional connectivity predict perception , 2015, Proceedings of the National Academy of Sciences.

[55]  Ravi S. Menon,et al.  Resting‐state networks show dynamic functional connectivity in awake humans and anesthetized macaques , 2013, Human brain mapping.

[56]  Martin A. Lindquist,et al.  Evaluating dynamic bivariate correlations in resting-state fMRI: A comparison study and a new approach , 2014, NeuroImage.

[57]  Martin A. Lindquist,et al.  Dynamic connectivity regression: Determining state-related changes in brain connectivity , 2012, NeuroImage.

[58]  H. Laufs,et al.  Decoding Wakefulness Levels from Typical fMRI Resting-State Data Reveals Reliable Drifts between Wakefulness and Sleep , 2014, Neuron.

[59]  Essa Yacoub,et al.  Less noise, more activation: Multiband acquisition schemes for auditory functional MRI , 2015, Magnetic resonance in medicine.

[60]  P. Matthews,et al.  Distinct patterns of brain activity in young carriers of the APOE e4 allele , 2009, NeuroImage.

[61]  Dimitri Van De Ville,et al.  The dynamic functional connectome: State-of-the-art and perspectives , 2017, NeuroImage.

[62]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[63]  Brian Everitt,et al.  Cluster analysis , 1974 .

[64]  David A. Leopold,et al.  Dynamic functional connectivity: Promise, issues, and interpretations , 2013, NeuroImage.

[65]  Steen Moeller,et al.  ICA-based artefact removal and accelerated fMRI acquisition for improved resting state network imaging , 2014, NeuroImage.

[66]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[67]  Min Chen,et al.  Multi-parametric neuroimaging reproducibility: A 3-T resource study , 2011, NeuroImage.

[68]  Keith A. Johnson,et al.  Cortical Hubs Revealed by Intrinsic Functional Connectivity: Mapping, Assessment of Stability, and Relation to Alzheimer's Disease , 2009, The Journal of Neuroscience.

[69]  Andrew W. Roddam,et al.  Measurement Error in Nonlinear Models: a Modern Perspective , 2008 .

[70]  Tülay Adali,et al.  Comparison of multi‐subject ICA methods for analysis of fMRI data , 2010, Human brain mapping.

[71]  Joaquín Goñi,et al.  Changes in structural and functional connectivity among resting-state networks across the human lifespan , 2014, NeuroImage.

[72]  Archana Venkataraman,et al.  Intrinsic functional connectivity as a tool for human connectomics: theory, properties, and optimization. , 2010, Journal of neurophysiology.

[73]  M. B. Nebel,et al.  Quantifying the reliability of image replication studies: The image intraclass correlation coefficient (I2C2) , 2013, Cognitive, affective & behavioral neuroscience.

[74]  Steen Moeller,et al.  Evaluation of slice accelerations using multiband echo planar imaging at 3T , 2013, NeuroImage.

[75]  Daniel A. Handwerker,et al.  Periodic changes in fMRI connectivity , 2012, NeuroImage.

[76]  D. Yurgelun-Todd,et al.  Reproducibility of Single-Subject Functional Connectivity Measurements , 2011, American Journal of Neuroradiology.

[77]  Vince D. Calhoun,et al.  Mutually temporally independent connectivity patterns: A new framework to study the dynamics of brain connectivity at rest with application to explain group difference based on gender , 2015, NeuroImage.