Quantifying temporal correlations: A test–retest evaluation of functional connectivity in resting-state fMRI

There have been many interpretations of functional connectivity and proposed measures of temporal correlations between BOLD signals across different brain areas. These interpretations yield from many studies on functional connectivity using resting-state fMRI data that have emerged in recent years. However, not all of these studies used the same metrics for quantifying the temporal correlations between brain regions. In this paper, we use a public-domain test-retest resting-state fMRI data set to perform a systematic investigation of the stability of the metrics that are often used in resting-state functional connectivity (FC) studies. The fMRI data set was collected across three different sessions. The second session took place approximately eleven months after the first session, and the third session was an hour after the second session. The FC metrics composed of cross-correlation, partial cross-correlation, cross-coherence, and parameters based on an autoregressive model. We discussed the strengths and weaknesses of each metric. We performed ROI-level and full-brain seed-based voxelwise test-retest analyses using each FC metric to assess its stability. For both ROI-level and voxel-level analyses, we found that cross-correlation yielded more stable measurements than the other metrics. We discussed the consequences of this result on the utility of the FC metrics. We observed that for negatively correlated ROIs, their partial cross-correlation is shrunk towards zero, thus affecting the stability of their FC. For the present data set, we found greater stability in FC between the second and third sessions (one hour between sessions) compared to the first and second sessions (approximately 11months between sessions). Finally, we report that some of the metrics showed a positive association between strength and stability. In summary, the results presented in this paper suggest important implications when choosing metrics for quantifying and assessing various types of functional connectivity for resting-state fMRI studies.

[1]  Habib Benali,et al.  Partial correlation for functional brain interactivity investigation in functional MRI , 2006, NeuroImage.

[2]  B. Biswal,et al.  The resting brain: unconstrained yet reliable. , 2009, Cerebral cortex.

[3]  H. Ombao,et al.  Coherence analysis of nonstationary time series: a linear filtering point of view , 2006 .

[4]  O. Dietrich,et al.  Test–retest reproducibility of the default‐mode network in healthy individuals , 2009, Human brain mapping.

[5]  Steven C. R. Williams,et al.  Measuring fMRI reliability with the intra-class correlation coefficient , 2009, NeuroImage.

[6]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[7]  M. Fox,et al.  Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging , 2007, Nature Reviews Neuroscience.

[8]  Andreas Heinz,et al.  Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures , 2012, NeuroImage.

[9]  W. Cleveland.  Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[10]  M. Fox,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[11]  Wesley K. Thompson,et al.  MATLAB toolbox for functional connectivity , 2009, NeuroImage.

[12]  Michael B. Miller,et al.  How reliable are the results from functional magnetic resonance imaging? , 2010, Annals of the New York Academy of Sciences.

[13]  J. Friedman,et al.  New Insights and Faster Computations for the Graphical Lasso , 2011 .

[14]  Hernando Ombao,et al.  Evolutionary Coherence of Nonstationary Signals , 2008, IEEE Transactions on Signal Processing.

[15]  Rainer Goebel,et al.  Investigating directed cortical interactions in time-resolved fMRI data using vector autoregressive modeling and Granger causality mapping. , 2003, Magnetic resonance imaging.

[16]  E. Bullmore,et al.  Functional Connectivity and Brain Networks in Schizophrenia , 2010, The Journal of Neuroscience.

[17]  Mark W. Woolrich,et al.  Network modelling methods for FMRI , 2011, NeuroImage.

[18]  Kevin Murphy,et al.  The impact of global signal regression on resting state correlations: Are anti-correlated networks introduced? , 2009, NeuroImage.

[19]  Hernando Ombao,et al.  Functional connectivity: Shrinkage estimation and randomization test , 2010, NeuroImage.

[20]  A. Walden.  A unified view of multitaper multivariate spectral estimation , 2000 .

[21]  S. Rombouts,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[22]  Karl J. Friston,et al.  Evaluation of different measures of functional connectivity using a neural mass model , 2004, NeuroImage.

[23]  Luiz A. Baccalá,et al.  Partial directed coherence: a new concept in neural structure determination , 2001, Biological Cybernetics.

[24]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[25]  Rainer Goebel,et al.  Mapping directed influence over the brain using Granger causality and fMRI , 2005, NeuroImage.

[26]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[27]  M. Greicius,et al.  Persistent default‐mode network connectivity during light sedation , 2008, Human brain mapping.

[28]  E. Bullmore,et al.  Undirected graphs of frequency-dependent functional connectivity in whole brain networks , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[29]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[30]  Karl J. Friston,et al.  Dynamic causal modeling , 2010, Scholarpedia.

[31]  Xi-Nian Zuo,et al.  Reliable intrinsic connectivity networks: Test–retest evaluation using ICA and dual regression approach , 2010, NeuroImage.

[32]  B. Biswal,et al.  Functional connectivity of default mode network components: Correlation, anticorrelation, and causality , 2009, Human brain mapping.

[33]  V. Haughton,et al.  Frequencies contributing to functional connectivity in the cerebral cortex in "resting-state" data. , 2001, AJNR. American journal of neuroradiology.

[34]  Lee M. Miller,et al.  Measuring interregional functional connectivity using coherence and partial coherence analyses of fMRI data , 2004, NeuroImage.

[35]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[36]  G. A. Miller,et al.  Comparison of different cortical connectivity estimators for high‐resolution EEG recordings , 2007, Human brain mapping.

[37]  Bharat B. Biswal,et al.  The oscillating brain: Complex and reliable , 2010, NeuroImage.

[38]  Karl J. Friston,et al.  Functional Connectivity: The Principal-Component Analysis of Large (PET) Data Sets , 1993, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[39]  M. Greicius,et al.  Decoding subject-driven cognitive states with whole-brain connectivity patterns. , 2012, Cerebral cortex.

[40]  Edith Pomarol-Clotet,et al.  Overall brain connectivity maps show cortico‐subcortical abnormalities in schizophrenia , 2010, Human brain mapping.

[41]  P. Games.  Correlation and Causation: A Logical Snafu , 1990 .

[42]  J. Geweke,et al.  Measurement of Linear Dependence and Feedback between Multiple Time Series , 1982 .

[43]  D. A. Kenny,et al.  Correlation and Causation , 1937, Wilmott.

[44]  E. Bullmore,et al.  Neurophysiological architecture of functional magnetic resonance images of human brain. , 2005, Cerebral cortex.

[45]  R. Todd Constable,et al.  Functional connectivity and alterations in baseline brain state in humans , 2010, NeuroImage.

[46]  A. T. Walden,et al.  Graphical modelling for brain connectivity via partial coherence , 2009, Journal of Neuroscience Methods.

[47]  Claude E. Shannon,et al.  A Mathematical Theory of Communications , 1948 .

[48]  R Quian Quiroga,et al.  Performance of different synchronization measures in real data: a case study on electroencephalographic signals. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  M. Fox,et al.  The global signal and observed anticorrelated resting state brain networks. , 2009, Journal of neurophysiology.

[50]  Alan C. Evans,et al.  Comparing functional connectivity via thresholding correlations and singular value decomposition , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[51]  G. Jackson,et al.  Effect of prior cognitive state on resting state networks measured with functional connectivity , 2005, Human brain mapping.

[52]  Gerald Langner,et al.  The oscillating brain , 2015 .

[53]  F. Gonzalez-Lima,et al.  Structural equation modeling and its application to network analysis in functional brain imaging , 1994 .

[54]  Catie Chang,et al.  Time–frequency dynamics of resting-state brain connectivity measured with fMRI , 2010, NeuroImage.

[55]  Qiang Xu,et al.  Small-world directed networks in the human brain: Multivariate Granger causality analysis of resting-state fMRI , 2011, NeuroImage.

[56]  Yong He,et al.  Graph Theoretical Analysis of Functional Brain Networks: Test-Retest Evaluation on Short- and Long-Term Resting-State Functional MRI Data , 2011, PloS one.