Test–retest reliability of structural brain networks from diffusion MRI

Structural brain networks constructed from diffusion MRI (dMRI) and tractography have been demonstrated in healthy volunteers and more recently in various disorders affecting brain connectivity. However, few studies have addressed the reproducibility of the resulting networks. We measured the test-retest properties of such networks by varying several factors affecting network construction using ten healthy volunteers who underwent a dMRI protocol at 1.5T on two separate occasions. Each T1-weighted brain was parcellated into 84 regions-of-interest and network connections were identified using dMRI and two alternative tractography algorithms, two alternative seeding strategies, a white matter waypoint constraint and three alternative network weightings. In each case, four common graph-theoretic measures were obtained. Network properties were assessed both node-wise and per network in terms of the intraclass correlation coefficient (ICC) and by comparing within- and between-subject differences. Our findings suggest that test-retest performance was improved when: 1) seeding from white matter, rather than grey; and 2) using probabilistic tractography with a two-fibre model and sufficient streamlines, rather than deterministic tensor tractography. In terms of network weighting, a measure of streamline density produced better test-retest performance than tract-averaged diffusion anisotropy, although it remains unclear which is a more accurate representation of the underlying connectivity. For the best performing configuration, the global within-subject differences were between 3.2% and 11.9% with ICCs between 0.62 and 0.76. The mean nodal within-subject differences were between 5.2% and 24.2% with mean ICCs between 0.46 and 0.62. For 83.3% (70/84) of nodes, the within-subject differences were smaller than between-subject differences. Overall, these findings suggest that whilst current techniques produce networks capable of characterising the genuine between-subject differences in connectivity, future work must be undertaken to improve network reliability.

[1]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[2]  Jochen Ditterich,et al.  Splash: A Software Tool for Stereotactic Planning of Recording Chamber Placement and Electrode Trajectories , 2011, Front. Neuroinform..

[3]  Amos Storkey,et al.  A test-retest fMRI dataset for motor, language and spatial attention functions , 2013, GigaScience.

[4]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[5]  Yong He,et al.  Diffusion tensor tractography reveals disrupted topological efficiency in white matter structural networks in multiple sclerosis. , 2011, Cerebral cortex.

[6]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[7]  Bruce Fischl,et al.  Within-subject template estimation for unbiased longitudinal image analysis , 2012, NeuroImage.

[8]  Wenbin Li,et al.  Enriched white matter connectivity networks for accurate identification of MCI patients , 2011, NeuroImage.

[9]  Edward T. Bullmore,et al.  Whole-brain anatomical networks: Does the choice of nodes matter? , 2010, NeuroImage.

[10]  M. Jenkinson Non-linear registration aka Spatial normalisation , 2007 .

[11]  Daniel Rueckert,et al.  Identifying population differences in whole-brain structural networks: A machine learning approach , 2010, NeuroImage.

[12]  Erlend Hodneland,et al.  Cortico-striatal connectivity and cognition in normal aging: A combined DTI and resting state fMRI study , 2011, NeuroImage.

[13]  Olaf Sporns,et al.  MR connectomics: Principles and challenges , 2010, Journal of Neuroscience Methods.

[14]  R. Passingham,et al.  Initial Demonstration of in Vivo Tracing of Axonal Projections in the Macaque Brain and Comparison with the Human Brain Using Diffusion Tensor Imaging and Fast Marching Tractography , 2002, NeuroImage.

[15]  P. Skudlarski,et al.  Brain Connectivity Is Not Only Lower but Different in Schizophrenia: A Combined Anatomical and Functional Approach , 2010, Biological Psychiatry.

[16]  J. Haxby,et al.  Functional Magnetic Resonance Imaging of the Brain , 1995, Annals of Internal Medicine.

[17]  Olaf Sporns,et al.  The Structural Core of Human Cerebral Cortex and its relation to the brain s default network , 2008 .

[18]  Ron Mengelers,et al.  The Effects of FreeSurfer Version, Workstation Type, and Macintosh Operating System Version on Anatomical Volume and Cortical Thickness Measurements , 2012, PloS one.

[19]  E. Bullmore,et al.  Disrupted Axonal Fiber Connectivity in Schizophrenia , 2011, Biological Psychiatry.

[20]  A. Alexander,et al.  White matter tractography using diffusion tensor deflection , 2003, Human brain mapping.

[21]  Jacobus F. A. Jansen,et al.  The effect and reproducibility of different clinical DTI gradient sets on small world brain connectivity measures , 2010, NeuroImage.

[22]  Satrajit S. Ghosh,et al.  Nipype: A Flexible, Lightweight and Extensible Neuroimaging Data Processing Framework in Python , 2011, Front. Neuroinform..

[23]  Alan C. Evans,et al.  Age- and Gender-Related Differences in the Cortical Anatomical Network , 2009, The Journal of Neuroscience.

[24]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[25]  D. C. Alexander,et al.  Modelling uncertainty in two fibre-orientation estimates within a voxel , 2006 .

[26]  Anders M. Dale,et al.  Sequence-independent segmentation of magnetic resonance images , 2004, NeuroImage.

[27]  Lester Melie-García,et al.  Characterizing brain anatomical connections using diffusion weighted MRI and graph theory , 2007, NeuroImage.

[28]  Maxime Descoteaux,et al.  Quantitative evaluation of 10 tractography algorithms on a realistic diffusion MR phantom , 2011, NeuroImage.

[29]  O. Sporns,et al.  Rich-Club Organization of the Human Connectome , 2011, The Journal of Neuroscience.

[30]  Andrew Zalesky,et al.  A DTI-Derived Measure of Cortico-Cortical Connectivity , 2009, IEEE Transactions on Medical Imaging.

[31]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[32]  Patric Hagmann,et al.  Mapping the human connectome at multiple scales with diffusion spectrum MRI , 2012, Journal of Neuroscience Methods.

[33]  Danielle S. Bassett,et al.  Conserved and variable architecture of human white matter connectivity , 2011, NeuroImage.

[34]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[35]  Heidi Johansen-Berg,et al.  Tractography: Where Do We Go from Here? , 2011, Brain Connect..

[36]  P. Basser,et al.  Microstructural and physiological features of tissues elucidated by quantitative-diffusion-tensor MRI. , 1996, Journal of magnetic resonance. Series B.

[37]  M. P. van den Heuvel,et al.  Impaired Structural Motor Connectome in Amyotrophic Lateral Sclerosis , 2011, PloS one.

[38]  Timothy Edward John Behrens,et al.  Non-invasive mapping of connections between human thalamus and cortex using diffusion imaging , 2003, Nature Neuroscience.

[39]  Maxime Descoteaux,et al.  Quantifying Brain Connectivity: A Comparative Tractography Study , 2009, MICCAI.

[40]  Mark W. Woolrich,et al.  Probabilistic diffusion tractography with multiple fibre orientations: What can we gain? , 2007, NeuroImage.

[41]  Geoffrey J M Parker,et al.  A framework for a streamline‐based probabilistic index of connectivity (PICo) using a structural interpretation of MRI diffusion measurements , 2003, Journal of magnetic resonance imaging : JMRI.

[42]  Desmond J. Higham,et al.  Network analysis detects changes in the contralesional hemisphere following stroke , 2011, NeuroImage.

[43]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[44]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[45]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[46]  R. Wilcox Introduction to Robust Estimation and Hypothesis Testing , 1997 .

[47]  Yong He,et al.  Diffusion Tensor Tractography Reveals Abnormal Topological Organization in Structural Cortical Networks in Alzheimer's Disease , 2010, The Journal of Neuroscience.

[48]  Bruce Fischl,et al.  Accurate and robust brain image alignment using boundary-based registration , 2009, NeuroImage.

[49]  Olaf Sporns,et al.  THE HUMAN CONNECTOME: A COMPLEX NETWORK , 2011, Schizophrenia Research.

[50]  Yong He,et al.  Discrete Neuroanatomical Networks Are Associated with Specific Cognitive Abilities in Old Age , 2011, The Journal of Neuroscience.

[51]  Gregory McCarthy,et al.  Scan–rescan reliability of subcortical brain volumes derived from automated segmentation , 2010, Human brain mapping.

[52]  P. V. van Zijl,et al.  Three‐dimensional tracking of axonal projections in the brain by magnetic resonance imaging , 1999, Annals of neurology.

[53]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[54]  Edward T. Bullmore,et al.  Network-based statistic: Identifying differences in brain networks , 2010, NeuroImage.

[55]  Anders M. Dale,et al.  Reliability of MRI-derived measurements of human cerebral cortical thickness: The effects of field strength, scanner upgrade and manufacturer , 2006, NeuroImage.

[56]  P. Thiran,et al.  Mapping Human Whole-Brain Structural Networks with Diffusion MRI , 2007, PloS one.

[57]  Yong He,et al.  Sex- and brain size-related small-world structural cortical networks in young adults: a DTI tractography study. , 2011, Cerebral cortex.

[58]  R. Deriche,et al.  From Diffusion MRI to Brain Connectomics , 2013 .

[59]  Jacob Jelsing,et al.  Validation of in vitro probabilistic tractography , 2007, NeuroImage.

[60]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[61]  Timothy Edward John Behrens,et al.  Characterization and propagation of uncertainty in diffusion‐weighted MR imaging , 2003, Magnetic resonance in medicine.

[62]  Derek K. Jones,et al.  Isotropic resolution diffusion tensor imaging with whole brain acquisition in a clinically acceptable time , 2002, Human brain mapping.

[63]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[64]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[65]  André J. W. van der Kouwe,et al.  Reliability of MRI-derived cortical and subcortical morphometric measures: Effects of pulse sequence, voxel geometry, and parallel imaging , 2009, NeuroImage.

[66]  Allan Donner,et al.  Sample size requirements for the design of reliability study: review and new results , 2004 .

[67]  David C. Van Essen,et al.  The future of the human connectome , 2012, NeuroImage.

[68]  Yang Wang,et al.  Characteristics and variability of structural networks derived from diffusion tensor imaging , 2012, NeuroImage.

[69]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[70]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[71]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..