Novel Brain Complexity Measures Based on Information Theory

Brain networks are widely used models to understand the topology and organization of the brain. These networks can be represented by a graph, where nodes correspond to brain regions and edges to structural or functional connections. Several measures have been proposed to describe the topological features of these networks, but unfortunately, it is still unclear which measures give the best representation of the brain. In this paper, we propose a new set of measures based on information theory. Our approach interprets the brain network as a stochastic process where impulses are modeled as a random walk on the graph nodes. This new interpretation provides a solid theoretical framework from which several global and local measures are derived. Global measures provide quantitative values for the whole brain network characterization and include entropy, mutual information, and erasure mutual information. The latter is a new measure based on mutual information and erasure entropy. On the other hand, local measures are based on different decompositions of the global measures and provide different properties of the nodes. Local measures include entropic surprise, mutual surprise, mutual predictability, and erasure surprise. The proposed approach is evaluated using synthetic model networks and structural and functional human networks at different scales. Results demonstrate that the global measures can characterize new properties of the topology of a brain network and, in addition, for a given number of nodes, an optimal number of edges is found for small-world networks. Local measures show different properties of the nodes such as the uncertainty associated to the node, or the uniqueness of the path that the node belongs. Finally, the consistency of the results across healthy subjects demonstrates the robustness of the proposed measures.

[1]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  M. V. D. Heuvel,et al.  Exploring the brain network: A review on resting-state fMRI functional connectivity , 2010, European Neuropsychopharmacology.

[3]  Habib Benali,et al.  Regions, systems, and the brain: Hierarchical measures of functional integration in fMRI , 2008, Medical Image Anal..

[4]  James P. Crutchfield,et al.  Discovering Noncritical Organization: Statistical Mechanical, Information Theoretic, and Computational Views of Patterns in One-Dimensional Spin Systems , 1998, Entropy.

[5]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[6]  P. Thiran,et al.  Mapping Human Whole-Brain Structural Networks with Diffusion MRI , 2007, PloS one.

[7]  Zoltán Toroczkai,et al.  Why data coherence and quality is critical for understanding interareal cortical networks , 2013, NeuroImage.

[8]  N. Packard,et al.  Symbolic dynamics of noisy chaos , 1983 .

[9]  Patric Hagmann,et al.  Comparing connectomes across subjects and populations at different scales , 2013, NeuroImage.

[10]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[11]  Olaf Sporns,et al.  THE HUMAN CONNECTOME: A COMPLEX NETWORK , 2011, Schizophrenia Research.

[12]  D. P. Russell,et al.  Functional Clustering: Identifying Strongly Interactive Brain Regions in Neuroimaging Data , 1998, NeuroImage.

[13]  J. Crutchfield,et al.  Structural information in two-dimensional patterns: entropy convergence and excess entropy. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Olaf Sporns,et al.  MR connectomics: Principles and challenges , 2010, Journal of Neuroscience Methods.

[15]  Nikolaos Papanikolaou,et al.  Fiber tracking: A qualitative and quantitative comparison between four different software tools on the reconstruction of major white matter tracts , 2016, European journal of radiology open.

[16]  O. Sporns,et al.  Rich Club Organization of Macaque Cerebral Cortex and Its Role in Network Communication , 2012, PloS one.

[17]  Danielle S Bassett,et al.  Brain graphs: graphical models of the human brain connectome. , 2011, Annual review of clinical psychology.

[18]  Paul M. Thompson,et al.  Test-Retest Reliability of Graph Theory Measures of Structural Brain Connectivity , 2012, MICCAI.

[19]  Robert Shaw,et al.  The Dripping Faucet As A Model Chaotic System , 1984 .

[20]  Tsachy Weissman,et al.  The Information Lost in Erasures , 2008, IEEE Transactions on Information Theory.

[21]  Imma Boada,et al.  Brain parcellation based on information theory , 2017, Comput. Methods Programs Biomed..

[22]  Olaf Sporns,et al.  The human connectome: Origins and challenges , 2013, NeuroImage.

[23]  G Tononi,et al.  A complexity measure for selective matching of signals by the brain. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Ryota Kanai,et al.  Efficient Algorithms for Searching the Minimum Information Partition in Integrated Information Theory , 2017, Entropy.

[25]  R. Deriche,et al.  From Diffusion MRI to Brain Connectomics , 2013 .

[26]  Györgyi,et al.  Entropy decay as a measure of stochasticity in chaotic systems. , 1986, Physical review. A, General physics.

[27]  Alessandro Vespignani,et al.  Detecting rich-club ordering in complex networks , 2006, physics/0602134.

[28]  Alain Giron,et al.  Predicting functional connectivity from structural connectivity via computational models using MRI: An extensive comparison study , 2015, NeuroImage.

[29]  Guorong Wu,et al.  A blind deconvolution approach to recover effective connectivity brain networks from resting state fMRI data , 2012, Medical Image Anal..

[30]  Marcus Kaiser,et al.  A tutorial in connectome analysis: Topological and spatial features of brain networks , 2011, NeuroImage.

[31]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[32]  Patric Hagmann,et al.  Mapping the human connectome at multiple scales with diffusion spectrum MRI , 2012, Journal of Neuroscience Methods.

[33]  O. Sporns,et al.  High-cost, high-capacity backbone for global brain communication , 2012, Proceedings of the National Academy of Sciences.

[34]  João Ricardo Sato,et al.  Measuring network's entropy in ADHD: A new approach to investigate neuropsychiatric disorders , 2013, NeuroImage.

[35]  G. Edelman,et al.  Degeneracy and complexity in biological systems , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[37]  Klaas E. Stephan,et al.  The anatomical basis of functional localization in the cortex , 2002, Nature Reviews Neuroscience.

[38]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[39]  V Latora,et al.  Efficient behavior of small-world networks. , 2001, Physical review letters.

[40]  P. Grassberger Toward a quantitative theory of self-generated complexity , 1986 .

[41]  Raymond W. Yeung,et al.  A First Course in Information Theory , 2002 .

[42]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[43]  G. Edelman,et al.  A measure for brain complexity: relating functional segregation and integration in the nervous system. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[45]  S. Boccaletti,et al.  Complex network theory and the brain , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[46]  Michael Breakspear,et al.  Graph analysis of the human connectome: Promise, progress, and pitfalls , 2013, NeuroImage.

[47]  David McMahon A Brief Introduction to Information Theory , 2008 .

[48]  G Tononi,et al.  Measures of degeneracy and redundancy in biological networks. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[49]  Andre Santos Ribeiro,et al.  Multimodal Imaging Brain Connectivity Analysis toolbox (MIBCA) , 2014 .

[50]  E. Bullmore,et al.  The hubs of the human connectome are generally implicated in the anatomy of brain disorders , 2014, Brain : a journal of neurology.

[51]  O. Sporns,et al.  Organization, development and function of complex brain networks , 2004, Trends in Cognitive Sciences.

[52]  Steen Moeller,et al.  The Human Connectome Project: A data acquisition perspective , 2012, NeuroImage.

[53]  Robert Oostenveld,et al.  ConnectomeDB—Sharing human brain connectivity data , 2016, NeuroImage.

[54]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[55]  M R DeWeese,et al.  How to measure the information gained from one symbol. , 1999, Network.

[56]  Cornelis J Stam,et al.  Graph theoretical analysis of complex networks in the brain , 2007, Nonlinear biomedical physics.

[57]  Olaf Sporns,et al.  Connectivity and complexity: the relationship between neuroanatomy and brain dynamics , 2000, Neural Networks.

[58]  G. Edelman,et al.  Complexity and coherency: integrating information in the brain , 1998, Trends in Cognitive Sciences.