Test-Retest Reliability of Graph Theoretic Metrics in Adolescent Brains

Graph theory analysis of structural brain networks derived from diffusion tensor imaging (DTI) has become a popular analytical method in neuroscience, enabling advanced investigations of neurological and psychiatric disorders. The purpose of this study was to investigate (1) the effects of edge weighting schemes and (2) the effects of varying interscan periods on graph metrics within the adolescent brain. We compared a binary (B) network definition with three weighting schemes: fractional anisotropy (FA), streamline count, and streamline count with density and length correction (SDL). Two commonly used global and two local graph metrics were examined. The analysis was conducted with two groups of adolescent volunteers who received DTI scans either 12 weeks apart (16.62 ± 1.10 years) or within the same scanning session (30 min apart) (16.65 ± 1.14 years). The intraclass correlation coefficient was used to assess test-retest reliability and the coefficient of variation (CV) was used to assess precision. On average, each edge scheme produced reliable results at both time intervals. Weighted measures outperformed binary measures, with SDL weights producing the most reliable metrics. All edge schemes except FA displayed high CV values, leaving FA as the only edge scheme that consistently showed high precision while also producing reliable results. Overall findings suggest that FA weights are more suited for DTI connectome studies in adolescents.

[1]  P. Thiran,et al.  Mapping Human Whole-Brain Structural Networks with Diffusion MRI , 2007, PloS one.

[2]  B. Luna,et al.  White matter development in adolescence: a DTI study. , 2010, Cerebral cortex.

[3]  Alexander Leemans,et al.  Microstructural maturation of the human brain from childhood to adulthood , 2008, NeuroImage.

[4]  Jacobus F. A. Jansen,et al.  The effect and reproducibility of different clinical DTI gradient sets on small world brain connectivity measures , 2010, NeuroImage.

[5]  S. Swinnen,et al.  Brain connectivity and postural control in young traumatic brain injury patients: A diffusion MRI based network analysis☆☆☆ , 2012, NeuroImage: Clinical.

[6]  Dorothee Auer,et al.  Reproducibility of Graph-Theoretic Brain Network Metrics: A Systematic Review , 2014, Brain Connect..

[7]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[8]  Mathieu Bastian,et al.  Gephi: An Open Source Software for Exploring and Manipulating Networks , 2009, ICWSM.

[9]  Patric Hagmann,et al.  Comparing connectomes across subjects and populations at different scales , 2013, NeuroImage.

[10]  Alan C. Evans,et al.  Brain connectivity in normally developing children and adolescents , 2016, NeuroImage.

[11]  Chris Rorden,et al.  Reproducibility of the Structural Brain Connectome Derived from Diffusion Tensor Imaging , 2015, PloS one.

[12]  Colm G. Connolly,et al.  Application of machine learning to structural connectome to predict symptom reduction in depressed adolescents with cognitive behavioral therapy (CBT) , 2019, NeuroImage: Clinical.

[13]  Danielle S. Bassett,et al.  Conserved and variable architecture of human white matter connectivity , 2011, NeuroImage.

[14]  J. Shimony,et al.  Normal brain maturation during childhood: developmental trends characterized with diffusion-tensor MR imaging. , 2001, Radiology.

[15]  D. Sharp,et al.  The role of the posterior cingulate cortex in cognition and disease. , 2014, Brain : a journal of neurology.

[16]  James C. Gee,et al.  Reproducibility of graph metrics of human brain structural networks , 2014, Front. Neuroinform..

[17]  Stephen D. Mayhew,et al.  The structural and functional connectivity of the posterior cingulate cortex: Comparison between deterministic and probabilistic tractography for the investigation of structure–function relationships , 2014, NeuroImage.

[18]  M. P. van den Heuvel,et al.  Impaired Structural Motor Connectome in Amyotrophic Lateral Sclerosis , 2011, PloS one.

[19]  Paul M. Thompson,et al.  Test-Retest Reliability of Graph Theory Measures of Structural Brain Connectivity , 2012, MICCAI.

[20]  Derek K. Jones,et al.  Optimization of graph construction can significantly increase the power of structural brain network studies , 2019, NeuroImage.

[21]  Marcus Kaiser,et al.  Within brain area tractography suggests local modularity using high resolution connectomics , 2017, Scientific Reports.

[22]  T. Paus,et al.  Why do many psychiatric disorders emerge during adolescence? , 2008, Nature Reviews Neuroscience.

[23]  R. Kahn,et al.  Aberrant Frontal and Temporal Complex Network Structure in Schizophrenia: A Graph Theoretical Analysis , 2010, The Journal of Neuroscience.

[24]  P. Basser,et al.  Toward a quantitative assessment of diffusion anisotropy , 1996, Magnetic resonance in medicine.

[25]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[26]  Timothy P. L. Roberts,et al.  Test-Retest Reliability of Computational Network Measurements Derived from the Structural Connectome of the Human Brain , 2013, Brain Connect..

[27]  S. Rombouts,et al.  Structural and functional connectivity in children and adolescents with and without attention deficit/hyperactivity disorder , 2017, Journal of child psychology and psychiatry, and allied disciplines.

[28]  Allan Donner,et al.  Sample size requirements for the design of reliability study: review and new results , 2004 .

[29]  Yang Wang,et al.  Characteristics and variability of structural networks derived from diffusion tensor imaging , 2012, NeuroImage.

[30]  G. Bartzokis,et al.  Multimodal Magnetic Resonance Imaging Assessment of White Matter Aging Trajectories Over the Lifespan of Healthy Individuals , 2012, Biological Psychiatry.

[31]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[32]  Olaf Sporns,et al.  Making sense of brain network data , 2013, Nature Methods.

[33]  D. Bassett,et al.  Emerging Evidence of Connectomic Abnormalities in Schizophrenia , 2011, The Journal of Neuroscience.

[34]  Thomas R. Knösche,et al.  White matter integrity, fiber count, and other fallacies: The do's and don'ts of diffusion MRI , 2013, NeuroImage.

[35]  Fuquan Zhang,et al.  The Shared and Distinct White Matter Networks Between Drug-Naive Patients With Obsessive-Compulsive Disorder and Schizophrenia , 2019, Front. Neurosci..

[36]  Christopher P. Hess,et al.  Towards the “Baby Connectome”: Mapping the Structural Connectivity of the Newborn Brain , 2012, PloS one.

[37]  John M Lachin,et al.  The role of measurement reliability in clinical trials , 2004, Clinical trials.

[38]  Colm G. Connolly,et al.  DTI-based connectome analysis of adolescents with major depressive disorder reveals hypoconnectivity of the right caudate. , 2017, Journal of affective disorders.

[39]  Liang Zhan,et al.  Impaired Inter-Hemispheric Integration in Bipolar Disorder Revealed with Brain Network Analyses , 2013, Biological Psychiatry.

[40]  Nicholas B. Allen,et al.  Development of brain networks and relevance of environmental and genetic factors: A systematic review , 2016, Neuroscience & Biobehavioral Reviews.

[41]  Leonardo L. Gollo,et al.  Connectome sensitivity or specificity: which is more important? , 2016, NeuroImage.

[42]  Duan Xu,et al.  Effects of rejecting diffusion directions on tensor-derived parameters , 2015, NeuroImage.

[43]  Mark E. Bastin,et al.  Test–retest reliability of structural brain networks from diffusion MRI , 2014, NeuroImage.

[44]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[45]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[46]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[47]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[48]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[49]  D. Cicchetti Multiple comparison methods: establishing guidelines for their valid application in neuropsychological research. , 1994, Journal of clinical and experimental neuropsychology.

[50]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[51]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[52]  L. Williams,et al.  Abnormal Structural Networks Characterize Major Depressive Disorder: A Connectome Analysis , 2014, Biological Psychiatry.

[53]  P. Gasquoine Localization of function in anterior cingulate cortex: From psychosurgery to functional neuroimaging , 2013, Neuroscience & Biobehavioral Reviews.

[54]  V. Menon,et al.  White matter development during childhood and adolescence: a cross-sectional diffusion tensor imaging study. , 2005, Cerebral cortex.

[55]  Alan C. Evans,et al.  Structural Insights into Aberrant Topological Patterns of Large-Scale Cortical Networks in Alzheimer's Disease , 2008, The Journal of Neuroscience.

[56]  Kay Jann,et al.  Repeatability Analysis of Global and Local Metrics of Brain Structural Networks , 2014, Brain Connect..

[57]  Edward T. Bullmore,et al.  Schizophrenia, neuroimaging and connectomics , 2012, NeuroImage.