Connectome sensitivity or specificity: which is more important?

Connectomes with high sensitivity and high specificity are unattainable with current axonal fiber reconstruction methods, particularly at the macro-scale afforded by magnetic resonance imaging. Tensor-guided deterministic tractography yields sparse connectomes that are incomplete and contain false negatives (FNs), whereas probabilistic methods steered by crossing-fiber models yield dense connectomes, often with low specificity due to false positives (FPs). Densely reconstructed probabilistic connectomes are typically thresholded to improve specificity at the cost of a reduction in sensitivity. What is the optimal tradeoff between connectome sensitivity and specificity? We show empirically and theoretically that specificity is paramount. Our evaluations of the impact of FPs and FNs on empirical connectomes indicate that specificity is at least twice as important as sensitivity when estimating key properties of brain networks, including topological measures of network clustering, network efficiency and network modularity. Our asymptotic analysis of small-world networks with idealized modular structure reveals that as the number of nodes grows, specificity becomes exactly twice as important as sensitivity to the estimation of the clustering coefficient. For the estimation of network efficiency, the relative importance of specificity grows linearly with the number of nodes. The greater importance of specificity is due to FPs occurring more prevalently between network modules rather than within them. These spurious inter-modular connections have a dramatic impact on network topology. We argue that efforts to maximize the sensitivity of connectome reconstruction should be realigned with the need to map brain networks with high specificity.

[1]  Allan R. Jones,et al.  A mesoscale connectome of the mouse brain , 2014, Nature.

[2]  Jacob Jelsing,et al.  Validation of in vitro probabilistic tractography , 2007, NeuroImage.

[3]  Maxime Descoteaux,et al.  Quantitative evaluation of 10 tractography algorithms on a realistic diffusion MR phantom , 2011, NeuroImage.

[4]  F. Pestilli,et al.  Evaluation and statistical inference for living connectomes , 2014, Nature Methods.

[5]  A. Anwander,et al.  Validation of tractography: Comparison with manganese tracing , 2015, Human brain mapping.

[6]  Alan Connelly,et al.  MRtrix: Diffusion tractography in crossing fiber regions , 2012, Int. J. Imaging Syst. Technol..

[7]  Larry W. Swanson,et al.  Combining collation and annotation efforts toward completion of the rat and mouse connectomes in BAMS , 2012, Front. Neuroinform..

[8]  Nadim Joni Shah,et al.  Human cortical connectome reconstruction from diffusion weighted MRI: The effect of tractography algorithm , 2012, NeuroImage.

[9]  V Latora,et al.  Efficient behavior of small-world networks. , 2001, Physical review letters.

[10]  Richard F. Betzel,et al.  Resting-brain functional connectivity predicted by analytic measures of network communication , 2013, Proceedings of the National Academy of Sciences.

[11]  M. Raichle,et al.  Tracking neuronal fiber pathways in the living human brain. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Andrew Zalesky,et al.  A DTI-Derived Measure of Cortico-Cortical Connectivity , 2009, IEEE Transactions on Medical Imaging.

[13]  O. Sporns,et al.  The economy of brain network organization , 2012, Nature Reviews Neuroscience.

[14]  Edward T. Bullmore,et al.  Fundamentals of Brain Network Analysis , 2016 .

[15]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[16]  Lester Melie-García,et al.  Studying the human brain anatomical network via diffusion-weighted MRI and Graph Theory , 2008, NeuroImage.

[17]  Nikola T. Markov,et al.  A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex , 2012, Cerebral cortex.

[18]  Benjamin H. Good,et al.  Performance of modularity maximization in practical contexts. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[20]  Timothy E. J. Behrens,et al.  Measuring macroscopic brain connections in vivo , 2015, Nature Neuroscience.

[21]  Andreas Daffertshofer,et al.  Comparing Brain Networks of Different Size and Connectivity Density Using Graph Theory , 2010, PloS one.

[22]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Alan Connelly,et al.  SIFT: Spherical-deconvolution informed filtering of tractograms , 2013, NeuroImage.

[24]  Lav R. Varshney,et al.  Structural Properties of the Caenorhabditis elegans Neuronal Network , 2009, PLoS Comput. Biol..

[25]  Richard F. Betzel,et al.  Multi-scale community organization of the human structural connectome and its relationship with resting-state functional connectivity , 2013, Network Science.

[26]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[27]  O. Sporns,et al.  Organization, development and function of complex brain networks , 2004, Trends in Cognitive Sciences.

[28]  Fernando Calamante,et al.  The contribution of geometry to the human connectome , 2016, NeuroImage.

[29]  J. Rilling,et al.  Comparison of diffusion tractography and tract‐tracing measures of connectivity strength in rhesus macaque connectome , 2015, Human brain mapping.

[30]  O. Sporns,et al.  High-cost, high-capacity backbone for global brain communication , 2012, Proceedings of the National Academy of Sciences.

[31]  Thomas R. Knösche,et al.  White matter integrity, fiber count, and other fallacies: The do's and don'ts of diffusion MRI , 2013, NeuroImage.

[32]  J. Zeman,et al.  quantitative evaluation of by , 2010 .

[33]  Mark W. Woolrich,et al.  Probabilistic diffusion tractography with multiple fibre orientations: What can we gain? , 2007, NeuroImage.

[34]  O. Sporns,et al.  Connectomics-Based Analysis of Information Flow in the Drosophila Brain , 2015, Current Biology.

[35]  Olaf Sporns,et al.  Generative models of the human connectome , 2015, NeuroImage.

[36]  A. Alexander,et al.  Diffusion tensor imaging of the brain , 2007, Neurotherapeutics.

[37]  Richard F. Betzel,et al.  Cooperative and Competitive Spreading Dynamics on the Human Connectome , 2015, Neuron.

[38]  Richard F. Betzel,et al.  Modular Brain Networks. , 2016, Annual review of psychology.

[39]  Henry Kennedy,et al.  A Predictive Network Model of Cerebral Cortical Connectivity Based on a Distance Rule , 2013, Neuron.

[40]  D. Leopold,et al.  Anatomical accuracy of brain connections derived from diffusion MRI tractography is inherently limited , 2014, Proceedings of the National Academy of Sciences.

[41]  O. Sporns Networks of the Brain , 2010 .

[42]  Arthur W. Toga,et al.  Neural Networks of the Mouse Neocortex , 2014, Cell.

[43]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[44]  Li Bai,et al.  Brain tractography using Q-ball imaging and graph theory: Improved connectivities through fibre crossings via a model-based approach , 2010, NeuroImage.

[45]  Derek K. Jones Challenges and limitations of quantifying brain connectivity in vivo with diffusion MRI , 2010 .

[46]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[47]  Edward T. Bullmore,et al.  Whole-brain anatomical networks: Does the choice of nodes matter? , 2010, NeuroImage.

[48]  P. V. van Zijl,et al.  Three‐dimensional tracking of axonal projections in the brain by magnetic resonance imaging , 1999, Annals of neurology.

[49]  Timothy Edward John Behrens,et al.  Characterization and propagation of uncertainty in diffusion‐weighted MR imaging , 2003, Magnetic resonance in medicine.

[50]  Jean-Philippe Thiran,et al.  Structural connectomics in brain diseases , 2013, NeuroImage.

[51]  Camille Roth,et al.  Natural Scales in Geographical Patterns , 2017, Scientific Reports.

[52]  David K. Yu,et al.  Superficial white matter fiber systems impede detection of long-range cortical connections in diffusion MR tractography , 2015, Proceedings of the National Academy of Sciences.

[53]  Simon W. Moore,et al.  Efficient Physical Embedding of Topologically Complex Information Processing Networks in Brains and Computer Circuits , 2010, PLoS Comput. Biol..

[54]  Floris G. Wouterlood,et al.  Neuroanatomical Tract-Tracing 3 , 2006 .

[55]  Chun-Hung Yeh,et al.  Resolving crossing fibres using constrained spherical deconvolution: Validation using diffusion-weighted imaging phantom data , 2008, NeuroImage.

[56]  Santo Fortunato,et al.  Consensus clustering in complex networks , 2012, Scientific Reports.

[57]  Xiaoping Hu,et al.  The effects of connection reconstruction method on the interregional connectivity of brain networks via diffusion tractography , 2012, Human brain mapping.

[58]  Nikos K. Logothetis,et al.  Validation of High-Resolution Tractography Against In Vivo Tracing in the Macaque Visual Cortex , 2015, Cerebral cortex.

[59]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[60]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[61]  Thomas R. Knösche,et al.  Parametric spherical deconvolution: Inferring anatomical connectivity using diffusion MR imaging , 2007, NeuroImage.

[62]  Jean-Philippe Thiran,et al.  Improved statistical evaluation of group differences in connectomes by screening–filtering strategy with application to study maturation of brain connections between childhood and adolescence , 2015, NeuroImage.

[63]  Zoltán Toroczkai,et al.  The role of long-range connections on the specificity of the macaque interareal cortical network , 2013, Proceedings of the National Academy of Sciences.

[64]  Edward T. Bullmore,et al.  Modular and Hierarchically Modular Organization of Brain Networks , 2010, Front. Neurosci..

[65]  S. Brenner,et al.  The structure of the nervous system of the nematode Caenorhabditis elegans. , 1986, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[66]  David G. Norris,et al.  An Investigation of Functional and Anatomical Connectivity Using Magnetic Resonance Imaging , 2002, NeuroImage.

[67]  Michael Breakspear,et al.  Graph analysis of the human connectome: Promise, progress, and pitfalls , 2013, NeuroImage.

[68]  Timothy Edward John Behrens,et al.  A Bayesian framework for global tractography , 2007, NeuroImage.

[69]  G. Johnson,et al.  A Diffusion MRI Tractography Connectome of the Mouse Brain and Comparison with Neuronal Tracer Data , 2015, Cerebral cortex.

[70]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[71]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[72]  Martijn P. van den Heuvel,et al.  Estimating false positives and negatives in brain networks , 2013, NeuroImage.

[73]  Olaf Sporns,et al.  Comparative Connectomics , 2016, Trends in Cognitive Sciences.

[74]  Thomas E. Nichols,et al.  Brain Network Analysis: Separating Cost from Topology Using Cost-Integration , 2011, PloS one.