Test-Retest Reliability of Graph Metrics in Functional Brain Networks: A Resting-State fNIRS Study

Recent research has demonstrated the feasibility of combining functional near-infrared spectroscopy (fNIRS) and graph theory approaches to explore the topological attributes of human brain networks. However, the test-retest (TRT) reliability of the application of graph metrics to these networks remains to be elucidated. Here, we used resting-state fNIRS and a graph-theoretical approach to systematically address TRT reliability as it applies to various features of human brain networks, including functional connectivity, global network metrics and regional nodal centrality metrics. Eighteen subjects participated in two resting-state fNIRS scan sessions held ∼20 min apart. Functional brain networks were constructed for each subject by computing temporal correlations on three types of hemoglobin concentration information (HbO, HbR, and HbT). This was followed by a graph-theoretical analysis, and then an intraclass correlation coefficient (ICC) was further applied to quantify the TRT reliability of each network metric. We observed that a large proportion of resting-state functional connections (∼90%) exhibited good reliability (0.6< ICC <0.74). For global and nodal measures, reliability was generally threshold-sensitive and varied among both network metrics and hemoglobin concentration signals. Specifically, the majority of global metrics exhibited fair to excellent reliability, with notably higher ICC values for the clustering coefficient (HbO: 0.76; HbR: 0.78; HbT: 0.53) and global efficiency (HbO: 0.76; HbR: 0.70; HbT: 0.78). Similarly, both nodal degree and efficiency measures also showed fair to excellent reliability across nodes (degree: 0.52∼0.84; efficiency: 0.50∼0.84); reliability was concordant across HbO, HbR and HbT and was significantly higher than that of nodal betweenness (0.28∼0.68). Together, our results suggest that most graph-theoretical network metrics derived from fNIRS are TRT reliable and can be used effectively for brain network research. This study also provides important guidance on the choice of network metrics of interest for future applied research in developmental and clinical neuroscience.

[1]  E. Bullmore,et al.  A Resilient, Low-Frequency, Small-World Human Brain Functional Network with Highly Connected Association Cortical Hubs , 2006, The Journal of Neuroscience.

[2]  Alan C. Evans,et al.  Uncovering Intrinsic Modular Organization of Spontaneous Brain Activity in Humans , 2009, PloS one.

[3]  Han Zhang,et al.  Test–retest assessment of independent component analysis-derived resting-state functional connectivity based on functional near-infrared spectroscopy , 2011, NeuroImage.

[4]  A. Villringer,et al.  Spontaneous Low Frequency Oscillations of Cerebral Hemodynamics and Metabolism in Human Adults , 2000, NeuroImage.

[5]  Chaozhe Zhu,et al.  Use of fNIRS to assess resting state functional connectivity , 2010, Journal of Neuroscience Methods.

[6]  Massimo Marchiori,et al.  Economic small-world behavior in weighted networks , 2003 .

[7]  Paul J. Laurienti,et al.  Neuroinformatics Original Research Article Materials and Methods Study Participants , 2022 .

[8]  Gorka Zamora-López,et al.  Cortical Hubs Form a Module for Multisensory Integration on Top of the Hierarchy of Cortical Networks , 2009, Front. Neuroinform..

[9]  Quan Zhang,et al.  Adaptive filtering to reduce global interference in non-invasive NIRS measures of brain activation: How well and when does it work? , 2009, NeuroImage.

[10]  Abraham Z. Snyder,et al.  Resting-state functional connectivity in the human brain revealed with diffuse optical tomography , 2009, NeuroImage.

[11]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Vinod Menon,et al.  Functional connectivity in the resting brain: A network analysis of the default mode hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Yong He,et al.  Graph-based network analysis of resting-state functional MRI. , 2010 .

[14]  G. Taga,et al.  Development of Global Cortical Networks in Early Infancy , 2010, The Journal of Neuroscience.

[15]  G. Frisoni,et al.  Functional network disruption in the degenerative dementias , 2011, The Lancet Neurology.

[16]  David A. Boas,et al.  Short separation channel location impacts the performance of short channel regression in NIRS , 2012, NeuroImage.

[17]  Yoko Hoshi,et al.  Functional near-infrared spectroscopy: current status and future prospects. , 2007, Journal of biomedical optics.

[18]  Robert L. Mason,et al.  Statistical Principles in Experimental Design , 2003 .

[19]  Guang-Zhong Yang,et al.  Assessment of the cerebral cortex during motor task behaviours in adults: A systematic review of functional near infrared spectroscopy (fNIRS) studies , 2011, NeuroImage.

[20]  E. Formisano,et al.  Functional connectivity as revealed by spatial independent component analysis of fMRI measurements during rest , 2004, Human brain mapping.

[21]  Albert-László Barabási,et al.  Hierarchical organization in complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Haijing Niu,et al.  Resting-state functional connectivity assessed with two diffuse optical tomographic systems. , 2011, Journal of biomedical optics.

[23]  Edward T. Bullmore,et al.  On the use of correlation as a measure of network connectivity , 2012, NeuroImage.

[24]  E. Bullmore,et al.  Neurophysiological architecture of functional magnetic resonance images of human brain. , 2005, Cerebral cortex.

[25]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[26]  Edward T. Bullmore,et al.  Efficiency and Cost of Economical Brain Functional Networks , 2007, PLoS Comput. Biol..

[27]  Yong He,et al.  Graph theoretical modeling of brain connectivity. , 2010, Current opinion in neurology.

[28]  Yong He,et al.  Revealing Topological Organization of Human Brain Functional Networks with Resting-State Functional near Infrared Spectroscopy , 2012, PloS one.

[29]  Anders M. Dale,et al.  Diffuse optical imaging of brain activation: approaches to optimizing image sensitivity, resolution, and accuracy , 2004, NeuroImage.

[30]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[31]  M. Lowe,et al.  Functional Connectivity in Single and Multislice Echoplanar Imaging Using Resting-State Fluctuations , 1998, NeuroImage.

[32]  James V. Stone.  Independent component analysis: an introduction , 2002, Trends in Cognitive Sciences.

[33]  Norihiro Sadato,et al.  A NIRS–fMRI study of resting state network , 2012, NeuroImage.

[34]  David A. Boas,et al.  The utility of near-infrared spectroscopy in the regression of low-frequency physiological noise from functional magnetic resonance imaging data , 2012, NeuroImage.

[35]  B. Biswal,et al.  Functional connectivity in the motor cortex of resting human brain using echo‐planar mri , 1995, Magnetic resonance in medicine.

[36]  David A. Boas,et al.  Improved recovery of the hemodynamic response in diffuse optical imaging using short optode separations and state-space modeling , 2011, NeuroImage.

[37]  Yong He,et al.  Effects of Different Correlation Metrics and Preprocessing Factors on Small-World Brain Functional Networks: A Resting-State Functional MRI Study , 2012, PloS one.

[38]  A. Villringer,et al.  Non-invasive optical spectroscopy and imaging of human brain function , 1997, Trends in Neurosciences.

[39]  David A. Boas,et al.  A Quantitative Comparison of Simultaneous BOLD fMRI and NIRS Recordings during Functional Brain Activation , 2002, NeuroImage.

[40]  P. Thiran,et al.  Mapping Human Whole-Brain Structural Networks with Diffusion MRI , 2007, PloS one.

[41]  Rolf B. Saager,et al.  Two-detector Corrected Near Infrared Spectroscopy (C-NIRS) detects hemodynamic activation responses more robustly than single-detector NIRS , 2011, NeuroImage.

[42]  Randy L. Gollub,et al.  Test–retest study of fMRI signal change evoked by electroacupuncture stimulation , 2007, NeuroImage.

[43]  Bharat B. Biswal,et al.  Detecting resting-state functional connectivity in the language system using functional near-infrared spectroscopy. , 2010, Journal of biomedical optics.

[44]  E. Gratton,et al.  Near-infrared study of fluctuations in cerebral hemodynamics during rest and motor stimulation: temporal analysis and spatial mapping. , 2000, Medical physics.

[45]  Andreas Heinz,et al.  Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures , 2012, NeuroImage.

[46]  Yong He,et al.  Graph Theoretical Analysis of Functional Brain Networks: Test-Retest Evaluation on Short- and Long-Term Resting-State Functional MRI Data , 2011, PloS one.

[47]  F. Jöbsis.  Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. , 1977, Science.

[48]  I. Miyai,et al.  Removal of the skin blood flow artifact in functional near-infrared spectroscopic imaging data through independent component analysis. , 2007, Journal of biomedical optics.

[49]  D. Delpy,et al.  System for long-term measurement of cerebral blood and tissue oxygenation on newborn infants by near infra-red transillumination , 1988, Medical and Biological Engineering and Computing.

[50]  O. Sporns,et al.  The economy of brain network organization , 2012, Nature Reviews Neuroscience.

[51]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[52]  David A Boas,et al.  A cerebrovascular response model for functional neuroimaging including dynamic cerebral autoregulation. , 2009, Mathematical biosciences.

[53]  T. Prescott,et al.  The brainstem reticular formation is a small-world, not scale-free, network , 2006, Proceedings of the Royal Society B: Biological Sciences.

[54]  David A. Boas,et al.  Quantification of the cortical contribution to the NIRS signal over the motor cortex using concurrent NIRS-fMRI measurements , 2012, NeuroImage.

[55]  B. Biswal,et al.  The resting brain: unconstrained yet reliable. , 2009, Cerebral cortex.

[56]  K. Worsley,et al.  Impaired small-world efficiency in structural cortical networks in multiple sclerosis associated with white matter lesion load. , 2009, Brain : a journal of neurology.

[57]  Edward T. Bullmore,et al.  Reproducibility of graph metrics of human brain functional networks , 2009, NeuroImage.

[58]  Theo Gasser,et al.  Assessing intrarater, interrater and test–retest reliability of continuous measurements , 2002, Statistics in medicine.

[59]  D. Boas,et al.  Resting state functional connectivity of the whole head with near-infrared spectroscopy , 2010, Biomedical optics express.

[60]  M K Markey,et al.  The reliability of measuring physical characteristics of spiculated masses on mammography. , 2006, The British journal of radiology.

[61]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[62]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[63]  Alan C. Evans,et al.  Mapping anatomical connectivity patterns of human cerebral cortex using in vivo diffusion tensor imaging tractography. , 2009, Cerebral cortex.

[64]  Yufeng Zang,et al.  Functional connectivity as revealed by independent component analysis of resting-state fNIRS measurements , 2010, NeuroImage.

[65]  P. Vargha,et al.  A critical discussion of intraclass correlation coefficients. , 1997, Statistics in medicine.

[66]  Alan C. Evans,et al.  Small-world anatomical networks in the human brain revealed by cortical thickness from MRI. , 2007, Cerebral cortex.

[67]  Heidrun Wabnitz,et al.  The physiological origin of task-evoked systemic artefacts in functional near infrared spectroscopy , 2012, NeuroImage.

[68]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[69]  K. Sneppen,et al.  Specificity and Stability in Topology of Protein Networks , 2002, Science.

[70]  M. Kramer,et al.  Emergence of Stable Functional Networks in Long-Term Human Electroencephalography , 2012, The Journal of Neuroscience.

[71]  Emery N Brown,et al.  Adaptive filtering for global interference cancellation and real-time recovery of evoked brain activity: a Monte Carlo simulation study. , 2007, Journal of biomedical optics.

[72]  Mingrui Xia,et al.  Magnetic Resonance Imaging and Graph Theoretical Analysis of Complex Brain Networks in Neuropsychiatric Disorders , 2011, Brain Connect..

[73]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[74]  M E J Newman.  Assortative mixing in networks. , 2002, Physical review letters.

[75]  Brian R. White,et al.  Bedside optical imaging of occipital resting-state functional connectivity in neonates , 2012, NeuroImage.

[76]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[77]  V Latora,et al.  Efficient behavior of small-world networks. , 2001, Physical review letters.

[78]  S. J. Payne,et al.  Effects of Autoregulation and CO2 Reactivity on Cerebral Oxygen Transport , 2009, Annals of Biomedical Engineering.

[79]  Danielle S Bassett,et al.  Cognitive fitness of cost-efficient brain functional networks , 2009, Proceedings of the National Academy of Sciences.