Graph-based network analysis of resting-state fMRI: test-retest reliability of binarized and weighted networks

In the past decade, resting-state functional magnetic resonance imaging (rs-fMRI) and graph-based measures have been widely used to quantitatively characterize the architectures of brain functional networks in healthy individuals and in patients with abnormalities related to psychopathic and neurological disorders. To accurately evaluate the topological organization of brain functional networks, the definition of the nodes and edges for the construction of functional networks is critical. Furthermore, both types of brain functional networks (binarized networks and weighted networks) are widely used to analyze topological organization. However, how to best select the network type is still debated. Consequently, we investigated the test-retest reliability of brain functional networks with binarized and weighted edges using two independent datasets and four strategies for defining nodes. We revealed fair to good reliability for a majority of network topological attributes and overall higher reliabilities for weighted networks than for binarized networks. For regional nodal efficiency, weighted networks also showed higher reliability across nodes. Thus, our findings imply that weighted networks contain more information, leading to more stable results. In addition, we found that the reliability of brain functional networks was influenced by the node definition strategy and that more precise of nodal definition were associated with higher reliability. The time effect of reliability was restricted, as no differences between long-term and short-term reliability were observed. In conclusion, our results suggest that weighted networks have better reliability because they reflect more topological information, implying broader applications of weighted networks related to normal and disordered function of the human brain.

[1]  S. Petersen,et al.  Concepts and principles in the analysis of brain networks , 2011, Annals of the New York Academy of Sciences.

[2]  Olaf Sporns,et al.  Networks analysis, complexity, and brain function , 2002 .

[3]  B. J. Winer Statistical Principles in Experimental Design , 1992 .

[4]  Alan C. Evans,et al.  Mapping anatomical connectivity patterns of human cerebral cortex using in vivo diffusion tensor imaging tractography. , 2009, Cerebral cortex.

[5]  Danielle S. Bassett,et al.  Resolving Anatomical and Functional Structure in Human Brain Organization: Identifying Mesoscale Organization in Weighted Network Representations , 2013, PLoS Comput. Biol..

[6]  Yong He,et al.  Graph-based network analysis of resting-state functional MRI. , 2010 .

[7]  Yu Zhang,et al.  The Human Brainnetome Atlas: A New Brain Atlas Based on Connectional Architecture , 2016, Cerebral cortex.

[8]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[9]  Andreas Heinz,et al.  Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures , 2012, NeuroImage.

[10]  R. Kahn,et al.  Efficiency of Functional Brain Networks and Intellectual Performance , 2009, The Journal of Neuroscience.

[11]  Olaf Sporns,et al.  Weight-conserving characterization of complex functional brain networks , 2011, NeuroImage.

[12]  M. Chun,et al.  Functional connectome fingerprinting: Identifying individuals based on patterns of brain connectivity , 2015, Nature Neuroscience.

[13]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[14]  Martin Nilsson Jacobi,et al.  Hierarchical Organization in , 2005 .

[15]  Paul J. Laurienti,et al.  Comparison of characteristics between region-and voxel-based network analyses in resting-state fMRI data , 2010, NeuroImage.

[16]  Edward T. Bullmore,et al.  Efficiency and Cost of Economical Brain Functional Networks , 2007, PLoS Comput. Biol..

[17]  M E J Newman Assortative mixing in networks. , 2002, Physical review letters.

[18]  Christian Windischberger,et al.  Toward discovery science of human brain function , 2010, Proceedings of the National Academy of Sciences.

[19]  Oliver Grimm,et al.  Test–retest reliability of fMRI-based graph theoretical properties during working memory, emotion processing, and resting state , 2014, NeuroImage.

[20]  Edward T. Bullmore,et al.  Whole-brain anatomical networks: Does the choice of nodes matter? , 2010, NeuroImage.

[21]  Liang Wang,et al.  Altered small‐world brain functional networks in children with attention‐deficit/hyperactivity disorder , 2009, Human brain mapping.

[22]  Efstathios D. Gennatas,et al.  Predicting Regional Neurodegeneration from the Healthy Brain Functional Connectome , 2012, Neuron.

[23]  Mark W. Woolrich,et al.  Network modelling methods for FMRI , 2011, NeuroImage.

[24]  Peter Kirsch,et al.  Test–retest reliability of evoked BOLD signals from a cognitive–emotive fMRI test battery , 2012, NeuroImage.

[25]  Walter Schneider,et al.  Identifying the brain's most globally connected regions , 2010, NeuroImage.

[26]  Alan C. Evans,et al.  Structural Insights into Aberrant Topological Patterns of Large-Scale Cortical Networks in Alzheimer's Disease , 2008, The Journal of Neuroscience.

[27]  Helgi B. Schiöth,et al.  Exposure to subliminal arousing stimuli induces robust activation in the amygdala, hippocampus, anterior cingulate, insular cortex and primary visual cortex: A systematic meta-analysis of fMRI studies , 2012, NeuroImage.

[28]  Yong He,et al.  Graph Theoretical Analysis of Functional Brain Networks: Test-Retest Evaluation on Short- and Long-Term Resting-State Functional MRI Data , 2011, PloS one.

[29]  B. Wandell,et al.  Visual Field Maps in Human Cortex , 2007, Neuron.

[30]  Edward T. Bullmore,et al.  Small-World Brain Networks Revisited , 2016, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[31]  J. Kurths,et al.  Network synchronization, diffusion, and the paradox of heterogeneity. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Danielle S. Bassett,et al.  Resolving Structural Variability in Network Models and the Brain , 2013, PLoS Comput. Biol..

[33]  C. T. Butts,et al.  Revisiting the Foundations of Network Analysis , 2009, Science.

[34]  Thomas E. Nichols,et al.  Functional connectomics from resting-state fMRI , 2013, Trends in Cognitive Sciences.

[35]  O. Sporns,et al.  Network hubs in the human brain , 2013, Trends in Cognitive Sciences.

[36]  E. Bullmore,et al.  A Resilient, Low-Frequency, Small-World Human Brain Functional Network with Highly Connected Association Cortical Hubs , 2006, The Journal of Neuroscience.

[37]  Michael Wigler,et al.  Rare De Novo Variants Associated with Autism Implicate a Large Functional Network of Genes Involved in Formation and Function of Synapses , 2011, Neuron.

[38]  Timothy O. Laumann,et al.  Functional Network Organization of the Human Brain , 2011, Neuron.

[39]  Albert-László Barabási,et al.  Hierarchical organization in complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Olaf Sporns,et al.  Making sense of brain network data , 2013, Nature Methods.

[41]  Jeanyung Chey,et al.  The effect of education on regional brain metabolism and its functional connectivity in an aged population utilizing positron emission tomography , 2015, Neuroscience Research.

[42]  B. Avants,et al.  Reproducibility of functional network metrics and network structure: A comparison of task-related BOLD, resting ASL with BOLD contrast, and resting cerebral blood flow , 2013, Cognitive, affective & behavioral neuroscience.

[43]  Yong Liu,et al.  Disrupted Small-World Brain Networks in Moderate Alzheimer's Disease: A Resting-State fMRI Study , 2012, PloS one.

[44]  Moors Pieter,et al.  Test-retest reliability. , 2014 .

[45]  Danielle S. Bassett,et al.  Conserved and variable architecture of human white matter connectivity , 2011, NeuroImage.

[46]  M. Corbetta,et al.  Common Blood Flow Changes across Visual Tasks: II. Decreases in Cerebral Cortex , 1997, Journal of Cognitive Neuroscience.

[47]  X. Zuo,et al.  Test-retest reliabilities of resting-state FMRI measurements in human brain functional connectomics: A systems neuroscience perspective , 2014, Neuroscience & Biobehavioral Reviews.

[48]  B. Mazoyer,et al.  Cortical networks for working memory and executive functions sustain the conscious resting state in man , 2001, Brain Research Bulletin.

[49]  O. Sporns Network Analysis , Complexity , and Brain Function , 2002 .

[50]  Simon B. Eickhoff,et al.  One-year test–retest reliability of intrinsic connectivity network fMRI in older adults , 2012, NeuroImage.

[51]  K. Worsley,et al.  Impaired small-world efficiency in structural cortical networks in multiple sclerosis associated with white matter lesion load. , 2009, Brain : a journal of neurology.

[52]  O. Sporns,et al.  Network centrality in the human functional connectome. , 2012, Cerebral cortex.

[53]  Scott T. Grafton,et al.  Dynamic reconfiguration of human brain networks during learning , 2010, Proceedings of the National Academy of Sciences.

[54]  M K Markey,et al.  The reliability of measuring physical characteristics of spiculated masses on mammography. , 2006, The British journal of radiology.

[55]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[56]  Jonathan D. Power,et al.  Prediction of Individual Brain Maturity Using fMRI , 2010, Science.

[57]  Yong He,et al.  Age-related changes in topological patterns of large-scale brain functional networks during memory encoding and recognition , 2010, NeuroImage.

[58]  Damien R. Farine,et al.  Measuring phenotypic assortment in animal social networks: weighted associations are more robust than binary edges , 2014, Animal Behaviour.

[59]  Edward T. Bullmore,et al.  Age-related changes in modular organization of human brain functional networks , 2009, NeuroImage.

[60]  Yong He,et al.  Hemisphere- and gender-related differences in small-world brain networks: A resting-state functional MRI study , 2011, NeuroImage.

[61]  Bryon A. Mueller,et al.  Altered resting state complexity in schizophrenia , 2012, NeuroImage.

[62]  V Latora,et al.  Efficient behavior of small-world networks. , 2001, Physical review letters.

[63]  C. Stam,et al.  Alzheimer's disease: connecting findings from graph theoretical studies of brain networks , 2013, Neurobiology of Aging.

[64]  Andreas Daffertshofer,et al.  Comparing Brain Networks of Different Size and Connectivity Density Using Graph Theory , 2010, PloS one.

[65]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[66]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[67]  F. Turkheimer,et al.  Emergence of resting state networks in the preterm human brain , 2010, Proceedings of the National Academy of Sciences.

[68]  Gretel Sanabria-Diaz,et al.  Surface area and cortical thickness descriptors reveal different attributes of the structural human brain networks , 2010, NeuroImage.

[69]  Xiaolan Fu,et al.  Amygdala Volume Predicts Inter-Individual Differences in Fearful Face Recognition , 2013, PloS one.

[70]  O. Sporns,et al.  Rich-Club Organization of the Human Connectome , 2011, The Journal of Neuroscience.

[71]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[72]  Steen Moeller,et al.  The Human Connectome Project's neuroimaging approach , 2016, Nature Neuroscience.

[73]  Andreas Horn,et al.  The structural–functional connectome and the default mode network of the human brain , 2014, NeuroImage.

[74]  Danielle Smith Bassett,et al.  Small-World Brain Networks , 2006, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[75]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[76]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[77]  Maximilian Reiser,et al.  Effects of aging on default mode network activity in resting state fMRI: Does the method of analysis matter? , 2010, NeuroImage.