Less is More: Wiring-Economical Modular Networks Support Self-Sustained Firing-Economical Neural Avalanches for Efficient Processing

Brain network is remarkably cost-efficient while the fundamental physical mechanisms underlying its economical optimization in network structure and dynamics are not clear. Here we study intricate cost-efficient interplay between structure and dynamics in biologically plausible spatial modular neuronal network models. We find that critical avalanche states from excitation-inhibition balance, under modular network topology with less wiring cost, can also achieve less costs in firing, but with strongly enhanced response sensitivity to stimuli. We derived mean-field equations that govern the macroscopic network dynamics through a novel approximate theory. The mechanism of low firing cost and stronger response in the form of critical avalanche is explained as a proximity to a Hopf bifurcation of the modules when increasing their connection density. Our work reveals the generic mechanism underlying the cost-efficient modular organization and critical dynamics widely observed in neural systems, providing insights to brain-inspired efficient computational designs.

[1]  Stefan Rotter,et al.  Higher-Order Statistics of Input Ensembles and the Response of Simple Model Neurons , 2003, Neural Computation.

[2]  Yuguo Yu,et al.  Energy‐efficient neural information processing in individual neurons and neuronal networks , 2017, Journal of neuroscience research.

[3]  Leonardo L. Gollo,et al.  Criticality in the brain: A synthesis of neurobiology, models and cognition , 2017, Progress in Neurobiology.

[4]  Woodrow L. Shew,et al.  Voltage Imaging of Waking Mouse Cortex Reveals Emergence of Critical Neuronal Dynamics , 2014, The Journal of Neuroscience.

[5]  Changsong Zhou,et al.  Hopf Bifurcation in Mean Field Explains Critical Avalanches in Excitation-Inhibition Balanced Neuronal Networks: A Mechanism for Multiscale Variability , 2020, Frontiers in Systems Neuroscience.

[6]  O. Sporns,et al.  Organization, development and function of complex brain networks , 2004, Trends in Cognitive Sciences.

[7]  Xiao-Jing Wang,et al.  Mean-Field Theory of Irregularly Spiking Neuronal Populations and Working Memory in Recurrent Cortical Networks , 2003 .

[8]  Gerald M. Rubin,et al.  Cortical column and whole-brain imaging with molecular contrast and nanoscale resolution , 2019, Science.

[9]  Alexandros Goulas,et al.  Is the brain really a small-world network? , 2015, Brain Structure and Function.

[10]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Dante R Chialvo,et al.  Brain organization into resting state networks emerges at criticality on a model of the human connectome. , 2012, Physical review letters.

[12]  Edward T. Bullmore,et al.  Modular and Hierarchically Modular Organization of Brain Networks , 2010, Front. Neurosci..

[13]  Marcus Kaiser,et al.  Clustered organization of cortical connectivity , 2007, Neuroinformatics.

[14]  Rubin Wang,et al.  Energy expenditure computation of a single bursting neuron , 2018, Cognitive Neurodynamics.

[15]  Kaushik Roy,et al.  Hierarchical Temporal Memory Based on Spin-Neurons and Resistive Memory for Energy-Efficient Brain-Inspired Computing , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Adam P. Hill,et al.  Warm Body Temperature Facilitates Energy Efficient Cortical Action Potentials , 2012, PLoS Comput. Biol..

[17]  Raul Rodriguez-Esteban,et al.  Global optimization of cerebral cortex layout. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Fernando Calamante,et al.  The contribution of geometry to the human connectome , 2016, NeuroImage.

[19]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[20]  Sergio Martinoia,et al.  Self-organized criticality in cortical assemblies occurs in concurrent scale-free and small-world networks , 2015, Scientific Reports.

[21]  Leonardo L. Gollo,et al.  Fragility and volatility of structural hubs in the human connectome , 2018, Nature Neuroscience.

[22]  Woodrow L. Shew,et al.  Neuronal Avalanches Imply Maximum Dynamic Range in Cortical Networks at Criticality , 2009, The Journal of Neuroscience.

[23]  O. Sporns,et al.  Network neuroscience , 2017, Nature Neuroscience.

[24]  O. Sporns,et al.  The economy of brain network organization , 2012, Nature Reviews Neuroscience.

[25]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[26]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[27]  M. Raichle,et al.  Appraising the brain's energy budget , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Daqing Guo,et al.  Self-Sustained Irregular Activity in 2-D Small-World Networks of Excitatory and Inhibitory Neurons , 2010, IEEE Transactions on Neural Networks.

[29]  Rong Wang,et al.  Hierarchical Connectome Modes and Critical State Jointly Maximize Human Brain Functional Diversity. , 2019, Physical review letters.

[30]  Pedro V. Carelli,et al.  Criticality between cortical states , 2018, bioRxiv.

[31]  S. Carpenter,et al.  Early-warning signals for critical transitions , 2009, Nature.

[32]  Marcus Kaiser,et al.  Criticality of spreading dynamics in hierarchical cluster networks without inhibition , 2007, 0802.2508.

[33]  Olaf Sporns,et al.  Small worlds inside big brains , 2006, Proceedings of the National Academy of Sciences.

[34]  Srdjan Ostojic,et al.  Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons , 2014, Nature Neuroscience.

[35]  Yan Cui,et al.  Heterogeneity of synaptic input connectivity regulates spike-based neuronal avalanches , 2018, Neural Networks.

[36]  Pablo Balenzuela,et al.  Criticality in Large-Scale Brain fMRI Dynamics Unveiled by a Novel Point Process Analysis , 2012, Front. Physio..

[37]  J. Kaas Evolution of columns, modules, and domains in the neocortex of primates , 2012, Proceedings of the National Academy of Sciences.

[38]  T. Sejnowski,et al.  Metabolic cost as a unifying principle governing neuronal biophysics , 2010, Proceedings of the National Academy of Sciences.

[39]  Rob R. de Ruyter van Steveninck,et al.  The metabolic cost of neural information , 1998, Nature Neuroscience.

[40]  D. Chklovskii,et al.  Wiring optimization can relate neuronal structure and function. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[41]  K. Y. Wong,et al.  Stochastic Oscillation in Self-Organized Critical States of Small Systems: Sensitive Resting State in Neural Systems. , 2016, Physical review letters.

[42]  Yating Zhu,et al.  Can the activities of the large scale cortical network be expressed by neural energy? A brief review , 2015, Cognitive Neurodynamics.

[43]  Nicholas Bennett,et al.  Analysis of Power Laws, Shape Collapses, and Neural Complexity: New Techniques and MATLAB Support via the NCC Toolbox , 2016, Front. Physiol..

[44]  Changsong Zhou,et al.  Co-emergence of multi-scale cortical activities of irregular firing, oscillations and avalanches achieves cost-efficient information capacity , 2017, PLoS Comput. Biol..

[45]  O. Kinouchi,et al.  Optimal dynamical range of excitable networks at criticality , 2006, q-bio/0601037.

[46]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[47]  Changsong Zhou,et al.  Features of spatial and functional segregation and integration of the primate connectome revealed by trade-off between wiring cost and efficiency , 2017, PLoS computational biology.

[48]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[49]  Changsong Zhou,et al.  Trade-off between Multiple Constraints Enables Simultaneous Formation of Modules and Hubs in Neural Systems , 2013, PLoS Comput. Biol..

[50]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.