Data-Driven and Predefined ROI-Based Quantification of Long-Term Resting-State fMRI Reproducibility

Resting-state functional magnetic resonance imaging (fMRI) is a promising tool for neuroscience and clinical studies. However, there exist significant variations in strength and spatial extent of resting-state functional connectivity over repeated sessions in a single or multiple subjects with identical experimental conditions. Reproducibility studies have been conducted for resting-state fMRI where the reproducibility was usually evaluated in predefined regions-of-interest (ROIs). It was possible that reproducibility measures strongly depended on the ROI definition. In this work, this issue was investigated by comparing data-driven and predefined ROI-based quantification of reproducibility. In the data-driven analysis, the reproducibility was quantified using functionally connected voxels detected by a support vector machine (SVM)-based technique. In the predefined ROI-based analysis, all voxels in the predefined ROIs were included when estimating the reproducibility. Experimental results show that (1) a moderate to substantial within-subject reproducibility and a reasonable between-subject reproducibility can be obtained using functionally connected voxels identified by the SVM-based technique; (2) in the predefined ROI-based analysis, an increase in ROI size does not always result in higher reproducibility measures; (3) ROI pairs with high connectivity strength have a higher chance to exhibit high reproducibility; (4) ROI pairs with high reproducibility do not necessarily have high connectivity strength; (5) the reproducibility measured from the identified functionally connected voxels is generally higher than that measured from all voxels in predefined ROIs with typical sizes. The findings (2) and (5) suggest that conventional ROI-based analyses would underestimate the resting-state fMRI reproducibility.

[1]  Xiaomu Song,et al.  A SVM-based quantitative fMRI method for resting-state functional network detection. , 2014, Magnetic resonance imaging.

[2]  J. Pekar,et al.  On the relationship between seed‐based and ICA‐based measures of functional connectivity , 2011, Magnetic resonance in medicine.

[3]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[4]  Yong He,et al.  Graph Theoretical Analysis of Functional Brain Networks: Test-Retest Evaluation on Short- and Long-Term Resting-State Functional MRI Data , 2011, PloS one.

[5]  Angus W. MacDonald,et al.  Neurometrics of intrinsic connectivity networks at rest using fMRI: Retest reliability and cross-validation using a meta-level method , 2013, NeuroImage.

[6]  C. Montag,et al.  Assessing the function of the fronto‐parietal attention network: Insights from resting‐state fMRI and the attentional network test , 2014, Human brain mapping.

[7]  Jessica A. Turner,et al.  Behavioral Interpretations of Intrinsic Connectivity Networks , 2011, Journal of Cognitive Neuroscience.

[8]  Abraham Z. Snyder,et al.  Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion , 2012, NeuroImage.

[9]  Hernando Ombao,et al.  Quantifying temporal correlations: A test–retest evaluation of functional connectivity in resting-state fMRI , 2013, NeuroImage.

[10]  Edward T. Bullmore,et al.  Efficiency and Cost of Economical Brain Functional Networks , 2007, PLoS Comput. Biol..

[11]  J. Shimony,et al.  Resting-State fMRI: A Review of Methods and Clinical Applications , 2013, American Journal of Neuroradiology.

[12]  S. Rombouts,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[13]  E. Formisano,et al.  Functional connectivity as revealed by spatial independent component analysis of fMRI measurements during rest , 2004, Human brain mapping.

[14]  Mathijs Raemaekers,et al.  Task and task‐free FMRI reproducibility comparison for motor network identification , 2014, Human brain mapping.

[15]  Xiaomu Song,et al.  Spatiotemporal Denoising and Clustering of fMRI Data , 2006, 2006 International Conference on Image Processing.

[16]  C. Dickey,et al.  Investigation of Long-Term Reproducibility of Intrinsic Connectivity Network Mapping: A Resting-State fMRI Study , 2012, American Journal of Neuroradiology.

[17]  N. Makris,et al.  Gyri of the human neocortex: an MRI-based analysis of volume and variance. , 1998, Cerebral cortex.

[18]  S. Rombouts,et al.  Consistent resting-state networks across healthy subjects , 2006, Proceedings of the National Academy of Sciences.

[19]  Achim Gass,et al.  A serial functional connectivity MRI study in healthy individuals assessing the variability of connectivity measures: reduced interhemispheric connectivity in the motor network during continuous performance. , 2009, Magnetic resonance imaging.

[20]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[21]  T. Paus,et al.  Functional coactivation map of the human brain. , 2008, Cerebral cortex.

[22]  S. Heckers,et al.  Functional resting-state networks are differentially affected in schizophrenia , 2011, Schizophrenia Research.

[23]  Martin Ystad,et al.  Subcortical functional connectivity and verbal episodic memory in healthy elderly—A resting state fMRI study , 2010, NeuroImage.

[24]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[25]  F. Castellanos,et al.  Spontaneous attentional fluctuations in impaired states and pathological conditions: A neurobiological hypothesis , 2007, Neuroscience & Biobehavioral Reviews.

[26]  Sara A. Schmidt,et al.  Default Mode, Dorsal Attention and Auditory Resting State Networks Exhibit Differential Functional Connectivity in Tinnitus and Hearing Loss , 2013, PloS one.

[27]  M. Greicius,et al.  Decoding subject-driven cognitive states with whole-brain connectivity patterns. , 2012, Cerebral cortex.

[28]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[29]  Gerard J. den Heeten,et al.  Functional magnetic resonance imaging for neurosurgical planning in neurooncology , 2004, European Radiology.

[30]  Feng-Xian Yan,et al.  Resting-State Functional Magnetic Resonance Imaging Analysis with Seed Definition Constrained by Regional Homogeneity , 2013, Brain Connect..

[31]  B. Biswal,et al.  Functional connectivity in the motor cortex of resting human brain using echo‐planar mri , 1995, Magnetic resonance in medicine.

[32]  M. Fox,et al.  Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging , 2007, Nature Reviews Neuroscience.

[33]  Karl J. Friston,et al.  Movement‐Related effects in fMRI time‐series , 1996, Magnetic resonance in medicine.

[34]  V. Schöpf,et al.  A systematic investigation of the invariance of resting-state network patterns: is resting-state fMRI ready for pre-surgical planning? , 2013, Front. Hum. Neurosci..

[35]  B. Biswal,et al.  Functional connectivity of default mode network components: Correlation, anticorrelation, and causality , 2009, Human brain mapping.

[36]  D. Zhao,et al.  A facile soft-template synthesis of mesoporous polymeric and carbonaceous nanospheres , 2013, Nature Communications.

[37]  G. Busatto,et al.  Resting-state functional connectivity in normal brain aging , 2013, Neuroscience & Biobehavioral Reviews.

[38]  Fuchun Lin,et al.  Iterative Cross-Correlation Analysis of Resting State Functional Magnetic Resonance Imaging Data , 2013, PloS one.

[39]  S. Debener,et al.  Default-mode brain dysfunction in mental disorders: A systematic review , 2009, Neuroscience & Biobehavioral Reviews.

[40]  Vivek Prabhakaran,et al.  The effect of resting condition on resting-state fMRI reliability and consistency: A comparison between resting with eyes open, closed, and fixated , 2013, NeuroImage.

[41]  A. Turken,et al.  The Neural Architecture of the Language Comprehension Network: Converging Evidence from Lesion and Connectivity Analyses , 2011, Front. Syst. Neurosci..

[42]  O Sporns,et al.  Predicting human resting-state functional connectivity from structural connectivity , 2009, Proceedings of the National Academy of Sciences.

[43]  Alan C. Evans,et al.  Structural Insights into Aberrant Topological Patterns of Large-Scale Cortical Networks in Alzheimer's Disease , 2008, The Journal of Neuroscience.

[44]  J. Xiong,et al.  Detecting functional connectivity in the resting brain: a comparison between ICA and CCA. , 2007, Magnetic resonance imaging.

[45]  Stephen M. Smith,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[46]  Andreas Heinz,et al.  Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures , 2012, NeuroImage.

[47]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[48]  Michael B. Miller,et al.  How reliable are the results from functional magnetic resonance imaging? , 2010, Annals of the New York Academy of Sciences.

[49]  David Thomasson,et al.  Head-repositioning does not reduce the reproducibility of fMRI activation in a block-design motor task , 2011, NeuroImage.

[50]  J. Gotman,et al.  Resting-State Connectivity of the Sustained Attention Network Correlates with Disease Duration in Idiopathic Generalized Epilepsy , 2012, PloS one.

[51]  Kevin Murphy,et al.  How long to scan? The relationship between fMRI temporal signal to noise ratio and necessary scan duration , 2007, NeuroImage.

[52]  V. Calhoun,et al.  Test‐retest reliability and reproducibility of short‐echo‐time spectroscopic imaging of human brain at 3T , 2011, Magnetic resonance in medicine.

[53]  Stephen M. Smith,et al.  Investigations into resting-state connectivity using independent component analysis , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[54]  Yong He,et al.  Effects of Different Correlation Metrics and Preprocessing Factors on Small-World Brain Functional Networks: A Resting-State Functional MRI Study , 2012, PloS one.

[55]  B. Biswal,et al.  The resting brain: unconstrained yet reliable. , 2009, Cerebral cortex.

[56]  O. Dietrich,et al.  Test–retest reproducibility of the default‐mode network in healthy individuals , 2009, Human brain mapping.

[57]  Simon B. Eickhoff,et al.  One-year test–retest reliability of intrinsic connectivity network fMRI in older adults , 2012, NeuroImage.

[58]  Vinod Menon,et al.  Functional connectivity in the resting brain: A network analysis of the default mode hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.