Optimal spike-based communication in excitable networks with strong-sparse and weak-dense links

The connectivity of complex networks and functional implications has been attracting much interest in many physical, biological and social systems. However, the significance of the weight distributions of network links remains largely unknown except for uniformly- or Gaussian-weighted links. Here, we show analytically and numerically, that recurrent neural networks can robustly generate internal noise optimal for spike transmission between neurons with the help of a long-tailed distribution in the weights of recurrent connections. The structure of spontaneous activity in such networks involves weak-dense connections that redistribute excitatory activity over the network as noise sources to optimally enhance the responses of individual neurons to input at sparse-strong connections, thus opening multiple signal transmission pathways. Electrophysiological experiments confirm the importance of a highly broad connectivity spectrum supported by the model. Our results identify a simple network mechanism for internal noise generation by highly inhomogeneous connection strengths supporting both stability and optimal communication.

[1]  Marián Boguñá,et al.  Correlations in weighted networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Michael Rudolph,et al.  Do Neocortical Pyramidal Neurons Display Stochastic Resonance? , 2001, Journal of Computational Neuroscience.

[3]  Edward Ott,et al.  Weighted percolation on directed networks. , 2008, Physical review letters.

[4]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[5]  Matjaž Perc,et al.  Fast random rewiring and strong connectivity impair subthreshold signal detection in excitable networks , 2010 .

[6]  Keiichi Kitajo,et al.  Behavioral stochastic resonance within the human brain. , 2003, Physical review letters.

[7]  A. Destexhe,et al.  Synaptic background activity controls spike transfer from thalamus to cortex , 2005, Nature Neuroscience.

[8]  Arvind Kumar,et al.  The High-Conductance State of Cortical Networks , 2008, Neural Computation.

[9]  Kurt Wiesenfeld,et al.  Stochastic resonance and the benefits of noise: from ice ages to crayfish and SQUIDs , 1995, Nature.

[10]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[11]  Matthieu Gilson,et al.  Stability versus Neuronal Specialization for STDP: Long-Tail Weight Distributions Solve the Dilemma , 2011, PloS one.

[12]  Aymar de Rugy,et al.  Muscle Coordination Is Habitual Rather than Optimal , 2012, The Journal of Neuroscience.

[13]  E. Callaway,et al.  Fine-scale specificity of cortical networks depends on inhibitory cell type and connectivity , 2005, Nature Neuroscience.

[14]  Nicolas Brunel,et al.  Dynamics of the Firing Probability of Noisy Integrate-and-Fire Neurons , 2002, Neural Computation.

[15]  Brendon O. Watson,et al.  Internal Dynamics Determine the Cortical Response to Thalamic Stimulation , 2005, Neuron.

[16]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[17]  A. Grinvald,et al.  Interaction of sensory responses with spontaneous depolarization in layer 2/3 barrel cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Carson C. Chow,et al.  Stochastic resonance without tuning , 1995, Nature.

[19]  Mark D. McDonnell,et al.  The benefits of noise in neural systems: bridging theory and experiment , 2011, Nature Reviews Neuroscience.

[20]  T. Hromádka,et al.  Sparse Representation of Sounds in the Unanesthetized Auditory Cortex , 2008, PLoS biology.

[21]  A. Koulakov,et al.  Correlated Connectivity and the Distribution of Firing Rates in the Neocortex , 2008, The Journal of Neuroscience.

[22]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[23]  Jinzhi Lei,et al.  Burst synchronization transitions in a neuronal network of subnetworks. , 2011, Chaos.

[24]  Thomas T. Imhoff,et al.  Noise-enhanced tactile sensation , 1996, Nature.

[25]  Anthony N. Burkitt,et al.  A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties , 2006, Biological Cybernetics.

[26]  G. Buzsáki,et al.  Hippocampal CA1 pyramidal cells form functionally distinct sublayers , 2011, Nature Neuroscience.

[27]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[28]  Dietmar Plenz,et al.  The organization of strong links in complex networks , 2011, Nature Physics.

[29]  C. Petersen,et al.  The Excitatory Neuronal Network of the C2 Barrel Column in Mouse Primary Somatosensory Cortex , 2009, Neuron.

[30]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[31]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[32]  Tim P Vogels,et al.  Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons , 2005, The Journal of Neuroscience.

[33]  C. Shatz,et al.  Synaptic Activity and the Construction of Cortical Circuits , 1996, Science.

[34]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[35]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[36]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[37]  D. Hansel,et al.  Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. , 2005, Physical review letters.

[38]  Frank Moss,et al.  Use of behavioural stochastic resonance by paddle fish for feeding , 1999, Nature.

[39]  Vladislav Volman,et al.  Activity-dependent stochastic resonance in recurrent neuronal networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  D. Chialvo.  Emergent complex neural dynamics , 2010, 1010.2530.

[41]  K. Harris,et al.  Laminar Structure of Spontaneous and Sensory-Evoked Population Activity in Auditory Cortex , 2009, Neuron.

[42]  D. Plenz,et al.  Spontaneous cortical activity in awake monkeys composed of neuronal avalanches , 2009, Proceedings of the National Academy of Sciences.

[43]  Dezhe Z. Jin,et al.  Support for a synaptic chain model of neuronal sequence generation , 2010, Nature.

[44]  G. Bianconi.  Emergence of weight-topology correlations in complex scale-free networks , 2004, cond-mat/0412399.

[45]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[46]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[47]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[48]  G. Buzsáki,et al.  Theta Oscillations Provide Temporal Windows for Local Circuit Computation in the Entorhinal-Hippocampal Loop , 2009, Neuron.

[49]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[50]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[51]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.

[52]  D. Hansel,et al.  On the Distribution of Firing Rates in Networks of Cortical Neurons , 2011, The Journal of Neuroscience.

[53]  A. Vespignani,et al.  The architecture of complex weighted networks. , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[54]  M. Steriade,et al.  Natural waking and sleep states: a view from inside neocortical neurons. , 2001, Journal of neurophysiology.

[55]  M. A. de Menezes,et al.  Fluctuations in network dynamics. , 2004, Physical review letters.

[56]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  Vladislav Volman,et al.  Signal processing in local neuronal circuits based on activity-dependent noise and competition. , 2009, Chaos.

[58]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[59]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[60]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[61]  Carson C. Chow,et al.  Aperiodic stochastic resonance. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.