Asynchronous Rate Chaos in Spiking Neuronal Circuits

The brain exhibits temporally complex patterns of activity with features similar to those of chaotic systems. Theoretical studies over the last twenty years have described various computational advantages for such regimes in neuronal systems. Nevertheless, it still remains unclear whether chaos requires specific cellular properties or network architectures, or whether it is a generic property of neuronal circuits. We investigate the dynamics of networks of excitatory-inhibitory (EI) spiking neurons with random sparse connectivity operating in the regime of balance of excitation and inhibition. Combining Dynamical Mean-Field Theory with numerical simulations, we show that chaotic, asynchronous firing rate fluctuations emerge generically for sufficiently strong synapses. Two different mechanisms can lead to these chaotic fluctuations. One mechanism relies on slow I-I inhibition which gives rise to slow subthreshold voltage and rate fluctuations. The decorrelation time of these fluctuations is proportional to the time constant of the inhibition. The second mechanism relies on the recurrent E-I-E feedback loop. It requires slow excitation but the inhibition can be fast. In the corresponding dynamical regime all neurons exhibit rate fluctuations on the time scale of the excitation. Another feature of this regime is that the population-averaged firing rate is substantially smaller in the excitatory population than in the inhibitory population. This is not necessarily the case in the I-I mechanism. Finally, we discuss the neurophysiological and computational significance of our results.

[1]  Sven Jahnke,et al.  How Chaotic is the Balanced State? , 2009, Front. Comput. Neurosci..

[2]  Germán Mato,et al.  Asynchronous States and the Emergence of Synchrony in Large Networks of Interacting Excitatory and Inhibitory Neurons , 2003, Neural Computation.

[3]  David Hansel,et al.  Short-Term Plasticity Explains Irregular Persistent Activity in Working Memory Tasks , 2013, The Journal of Neuroscience.

[4]  Daniel J. Amit,et al.  Oscillations and Irregular Emission in Networks of Linear Spiking Neurons , 2004, Journal of Computational Neuroscience.

[5]  F. Wolf,et al.  Dynamical entropy production in spiking neuron networks in the balanced state. , 2010, Physical review letters.

[6]  M. Frotscher,et al.  Rapid Signaling at Inhibitory Synapses in a Dentate Gyrus Interneuron Network , 2001, The Journal of Neuroscience.

[7]  L. Abbott,et al.  Beyond the edge of chaos: amplification and temporal integration by recurrent networks in the chaotic regime. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  D. Hansel,et al.  The Mechanism of Orientation Selectivity in Primary Visual Cortex without a Functional Map , 2012, The Journal of Neuroscience.

[9]  Haim Sompolinsky,et al.  Chaos and synchrony in a model of a hypercolumn in visual cortex , 1996, Journal of Computational Neuroscience.

[10]  A. Babloyantz,et al.  Low-dimensional chaos in an instance of epilepsy. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[12]  Jonathan Touboul,et al.  Synchronization in random balanced networks. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  B. Kendall Nonlinear Dynamics and Chaos , 2001 .

[14]  L. Abbott,et al.  Eigenvalue spectra of random matrices for neural networks. , 2006, Physical review letters.

[15]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[16]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[17]  M. Gassmann,et al.  Regulation of neuronal GABAB receptor functions by subunit composition , 2012, Nature Reviews Neuroscience.

[18]  Germán Mato,et al.  On Numerical Simulations of Integrate-and-Fire Neural Networks , 1998, Neural Computation.

[19]  Omri Harish Network mechanisms of working memory : from persistent dynamics to chaos , 2013 .

[20]  M. Carandini,et al.  Parvalbumin-Expressing Interneurons Linearly Transform Cortical Responses to Visual Stimuli , 2012, Neuron.

[21]  ShrikiOren,et al.  Rate models for conductance-based cortical neuronal networks , 2003 .

[22]  H Korn,et al.  A nonrandom dynamic component in the synaptic noise of a central neuron. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[23]  D A Chamberlain,et al.  The Brighton resuscitation ambulances: a continuing experiment in prehospital care by ambulance staff. , 1976, British medical journal.

[24]  Terence Tao,et al.  Random matrices: Universality of ESDs and the circular law , 2008, 0807.4898.

[25]  Nicolas Brunel,et al.  From Spiking Neuron Models to Linear-Nonlinear Models , 2011, PLoS Comput. Biol..

[26]  D. Hansel,et al.  How Noise Contributes to Contrast Invariance of Orientation Tuning in Cat Visual Cortex , 2002, The Journal of Neuroscience.

[27]  G. Carmignoto,et al.  Activity-dependent decrease in NMDA receptor responses during development of the visual cortex. , 1992, Science.

[28]  G. Wainrib,et al.  Topological and dynamical complexity of random neural networks. , 2012, Physical review letters.

[29]  Rainer Engelken,et al.  Comment on “Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons” , 2015, bioRxiv.

[30]  L. Abbott,et al.  From fixed points to chaos: Three models of delayed discrimination , 2013, Progress in Neurobiology.

[31]  David Hansel,et al.  Synchronous Chaos and Broad Band Gamma Rhythm in a Minimal Multi-Layer Model of Primary Visual Cortex , 2011, PLoS Comput. Biol..

[32]  David J. Freedman,et al.  A hierarchy of intrinsic timescales across primate cortex , 2014, Nature Neuroscience.

[33]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[34]  D. Hansel,et al.  Very long transients, irregular firing, and chaotic dynamics in networks of randomly connected inhibitory integrate-and-fire neurons. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[36]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[37]  H Sompolinsky,et al.  Dynamics of random neural networks with bistable units. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  M. Timme,et al.  Stable irregular dynamics in complex neural networks. , 2007, Physical review letters.

[39]  J. Lübke,et al.  Functional Properties of AMPA and NMDA Receptors Expressed in Identified Types of Basal Ganglia Neurons , 1997, The Journal of Neuroscience.

[40]  Oren Shriki,et al.  Rate Models for Conductance-Based Cortical Neuronal Networks , 2003, Neural Computation.

[41]  Fred Wolf,et al.  Single cell dynamics determine strength of chaos in collective network dynamics , 2011, BMC Neuroscience.

[42]  T. Tao Outliers in the spectrum of iid matrices with bounded rank perturbations , 2010 .

[43]  D. Hansel,et al.  Temporal decorrelation of collective oscillations in neural networks with local inhibition and long-range excitation. , 2007, Physical review letters.

[44]  G. Ermentrout,et al.  Parabolic bursting in an excitable system coupled with a slow oscillation , 1986 .

[45]  Hansel,et al.  Synchronization and computation in a chaotic neural network. , 1992, Physical review letters.

[46]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[47]  Nicholas J. Priebe,et al.  Inhibition, Spike Threshold, and Stimulus Selectivity in Primary Visual Cortex , 2008, Neuron.

[48]  Aaditya V. Rangan,et al.  Emergent dynamics in a model of visual cortex , 2013, Journal of Computational Neuroscience.

[49]  József Fiser,et al.  Suppression of cortical neural variability is stimulus- and state-dependent. , 2012, Journal of neurophysiology.

[50]  Hansel,et al.  Solvable model of spatiotemporal chaos. , 1993, Physical review letters.

[51]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[52]  Kenneth D Miller,et al.  Properties of networks with partially structured and partially random connectivity. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Boris S. Gutkin,et al.  Dynamics of Membrane Excitability Determine Interspike Interval Variability: A Link Between Spike Generation Mechanisms and Cortical Spike Train Statistics , 1998, Neural Computation.

[54]  Huaixing Wang,et al.  A specialized NMDA receptor function in layer 5 recurrent microcircuitry of the adult rat prefrontal cortex , 2008, Proceedings of the National Academy of Sciences.

[55]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[56]  Srdjan Ostojic,et al.  Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons , 2014, Nature Neuroscience.

[57]  M. London,et al.  Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex , 2010, Nature.

[58]  PHARMACOLOGY AND NERVE ENDINGS , 1934 .

[59]  L. Abbott,et al.  Stimulus-dependent suppression of chaos in recurrent neural networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[60]  J. Brumberg,et al.  Cortical pyramidal cells as non-linear oscillators: Experiment and spike-generation theory , 2007, Brain Research.

[61]  D. Hansel,et al.  Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. , 2005, Physical review letters.

[62]  B. Sakmann,et al.  Whisker movements evoked by stimulation of single pyramidal cells in rat motor cortex , 2004, Nature.

[63]  Anthony M Zador,et al.  Millisecond-scale differences in neural activity in auditory cortex can drive decisions , 2008, Nature Neuroscience.