Topological Reinforcement as a Principle of Modularity Emergence in Brain Networks

Modularity is a ubiquitous topological feature of structural brain networks at various scales. While a variety of potential mechanisms have been proposed, the fundamental principles by which modularity emerges in neural networks remain elusive. We tackle this question with a plasticity model of neural networks derived from a purely topological perspective. The topological reinforcement (TR) model acts by enhancing the topological overlap (TO) between nodes. Specifically, the TR rule iteratively connects a randomly selected node to a non-neighbor with the highest TO, while pruning another network link at random, hence preserving graph density. The topological reinforcement reliably evolves synthetic random networks toward a modular architecture. Additionally, the final modular structure reflects features of the initial networks, particularly, local density variations (‘proto-modules’), thus allowing to predict the modules of the evolved graph. Subsequently, we show that this topological selection principle when implemented biologically is equivalent to the classic Hebbian rule. Concretely, we explore a simple model of excitable dynamics, the SER model, in which the activity of network nodes is described by discrete susceptible, excited and refractory states. In this case, the plasticity rule acts in a Hebbian-like fashion, i.e., based on the functional connectivity (FC) between nodes represented by co-activations. Results produced by the SER-based model are consistent with TR, showing a consistent final network configuration. Our findings suggest that the selective reinforcement of topological overlap may be a fundamental mechanism by which brain networks evolve toward modular structure.

[1]  Ivan Tyukin,et al.  Spatially constrained adaptive rewiring in cortical networks creates spatially modular small world architectures , 2014, Cognitive Neurodynamics.

[2]  Marc-Thorsten Hütt,et al.  Subgraph fluctuations in random graphs. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  D. van den Berg,et al.  Adaptive rewiring in chaotic networks renders small-world connectivity with consistent clusters , 2004 .

[4]  Marc-Thorsten Hütt,et al.  A closer look at the apparent correlation of structural and functional connectivity in excitable neural networks , 2015, Scientific Reports.

[5]  J. Rapoport,et al.  Simple models of human brain functional networks , 2012, Proceedings of the National Academy of Sciences.

[6]  S. Shen-Orr,et al.  Superfamilies of Evolved and Designed Networks , 2004, Science.

[7]  Aric Hagberg,et al.  Exploring Network Structure, Dynamics, and Function using NetworkX , 2008, Proceedings of the Python in Science Conference.

[8]  Mauro Copelli,et al.  Response of electrically coupled spiking neurons: a cellular automaton approach. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Olaf Sporns,et al.  Computational Methods for the Analysis of Brain Connectivity , 2002 .

[10]  A. Barabasi,et al.  Hierarchical Organization of Modularity in Metabolic Networks , 2002, Science.

[11]  Yoram Burak,et al.  Shaping Neural Circuits by High Order Synaptic Interactions , 2016, PLoS Comput. Biol..

[12]  P. Bak,et al.  A forest-fire model and some thoughts on turbulence , 1990 .

[13]  Graham L. Baum,et al.  Modular Segregation of Structural Brain Networks Supports the Development of Executive Function in Youth , 2016, Current Biology.

[14]  Wu-Jie Yuan,et al.  Interplay between structure and dynamics in adaptive complex networks: emergence and amplification of modularity by adaptive dynamics. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Gaël Varoquaux,et al.  Proceedings of the 20th Python in Science Conference 2021 (SciPy 2021), Virtual Conference, July 12 - July 18, 2021 , 2008, SciPy.

[16]  Alex Arenas,et al.  Synchronization reveals topological scales in complex networks. , 2006, Physical review letters.

[17]  C Hilgetag Mathematical approaches to the analysis of neural connectivity in the mammalian brain. , 1999 .

[18]  Drossel,et al.  Self-organized critical forest-fire model. , 1992, Physical review letters.

[19]  Piet Van Mieghem,et al.  Emergence of Modular Structure in a Large-Scale Brain Network with Interactions between Dynamics and Connectivity , 2010, Front. Comput. Neurosci..

[20]  K. Sneppen,et al.  Specificity and Stability in Topology of Protein Networks , 2002, Science.

[21]  Danielle S Bassett,et al.  Generative models for network neuroscience: prospects and promise , 2017, Journal of The Royal Society Interface.

[22]  David Saad,et al.  The Interplay between Microscopic and Mesoscopic Structures in Complex Networks , 2010, PloS one.

[23]  S. Shen-Orr,et al.  Network motifs: simple building blocks of complex networks. , 2002, Science.

[24]  Pablo M. Gleiser,et al.  Synchronization and structure in an adaptive oscillator network , 2006 .

[25]  Marc-Thorsten Hütt,et al.  Role of long cycles in excitable dynamics on graphs. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Marc-Thorsten Hütt,et al.  Organization of Excitable Dynamics in Hierarchical Biological Networks , 2008, PLoS Comput. Biol..

[27]  A Vázquez,et al.  The topological relationship between the large-scale attributes and local interaction patterns of complex networks , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Marc-Thorsten Hütt,et al.  Stochastic resonance in discrete excitable dynamics on graphs , 2012 .

[29]  M. Meilă Comparing clusterings---an information based distance , 2007 .

[30]  Martin Rosvall,et al.  Maps of random walks on complex networks reveal community structure , 2007, Proceedings of the National Academy of Sciences.

[31]  Marc-Thorsten Hütt,et al.  Toward a theory of coactivation patterns in excitable neural networks , 2018, PLoS Comput. Biol..

[32]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[33]  O. Kinouchi,et al.  Optimal dynamical range of excitable networks at criticality , 2006, q-bio/0601037.

[34]  Richard F. Betzel,et al.  Modular Brain Networks. , 2016, Annual review of psychology.

[35]  Steve Horvath,et al.  Network neighborhood analysis with the multi-node topological overlap measure , 2007, Bioinform..

[36]  Erik Steur,et al.  Self-organisation of small-world networks by adaptive rewiring in response to graph diffusion , 2017, Scientific Reports.

[37]  Marc-Thorsten Hütt,et al.  Topological determinants of self-sustained activity in a simple model of excitable dynamics on graphs , 2014, Scientific Reports.

[38]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[39]  Gagan S Wig,et al.  Segregated Systems of Human Brain Networks , 2017, Trends in Cognitive Sciences.

[40]  Cees van Leeuwen,et al.  Robust emergence of small-world structure in networks of spiking neurons , 2007, Cognitive Neurodynamics.

[41]  Marcus Kaiser,et al.  Development of multi-cluster cortical networks by time windows for spatial growth , 2007, Neurocomputing.

[42]  M P Young,et al.  Anatomical connectivity defines the organization of clusters of cortical areas in the macaque monkey and the cat. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[43]  Olaf Sporns,et al.  Connectivity and complexity: the relationship between neuroanatomy and brain dynamics , 2000, Neural Networks.

[44]  Jean-Baptiste Mouret,et al.  Neural Modularity Helps Organisms Evolve to Learn New Skills without Forgetting Old Skills , 2015, PLoS Comput. Biol..

[45]  C. Myers,et al.  Using networks to measure similarity between genes: association index selection , 2013, Nature Methods.

[46]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[47]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[48]  Marc-Thorsten Hütt,et al.  Building Blocks of Self-Sustained Activity in a Simple Deterministic Model of Excitable Neural Networks , 2012, Front. Comput. Neurosci..

[49]  Dante R Chialvo,et al.  Brain organization into resting state networks emerges at criticality on a model of the human connectome. , 2012, Physical review letters.

[50]  P. Kaye Infectious diseases of humans: Dynamics and control , 1993 .

[51]  Changsong Zhou,et al.  Hierarchical organization unveiled by functional connectivity in complex brain networks. , 2006, Physical review letters.

[52]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[53]  Changsong Zhou,et al.  Hierarchical modular structure enhances the robustness of self-organized criticality in neural networks , 2012 .

[54]  Marcus Kaiser,et al.  Optimal Hierarchical Modular Topologies for Producing Limited Sustained Activation of Neural Networks , 2009, Front. Neuroinform..

[55]  Marcus Kaiser,et al.  Nonlinear growth: an origin of hub organization in complex networks , 2017, Royal Society Open Science.

[56]  Olaf Sporns,et al.  Graph Theory Methods for the Analysis of Neural Connectivity Patterns , 2003 .

[57]  Peter A. Robinson,et al.  Using Geometry to Uncover Relationships Between Isotropy, Homogeneity, and Modularity in Cortical Connectivity , 2013, Brain Connect..

[58]  S. Shen-Orr,et al.  Networks Network Motifs : Simple Building Blocks of Complex , 2002 .

[59]  Alexandros Goulas,et al.  The strength of weak connections in the macaque cortico-cortical network , 2014, Brain Structure and Function.

[60]  Jürgen Jost,et al.  Self-organization in Balanced State Networks by STDP and Homeostatic Plasticity , 2015, PLoS Comput. Biol..

[61]  Cees van Leeuwen,et al.  Emergence of scale-free network with chaotic units , 2003 .

[62]  Claudia D. Tesche,et al.  Topological dynamics in spike-timing dependent plastic model neural networks , 2013, Front. Neural Circuits.

[63]  Olaf Sporns,et al.  Generative models of the human connectome , 2015, NeuroImage.

[64]  William D. Hopkins,et al.  Modular structure facilitates mosaic evolution of the brain in chimpanzees and humans , 2014, Nature Communications.