Computing and Stability in Cortical Networks

Cortical neurons are predominantly excitatory and highly interconnected. In spite of this, the cortex is remarkably stable: normal brains do not exhibit the kind of runaway excitation one might expect of such a system. How does the cortex maintain stability in the face of this massive excitatory feedback? More importantly, how does it do so during computations, which necessarily involve elevated firing rates? Here we address these questions in the context of attractor networksnetworks that exhibit multiple stable states, or memories. We find that such networks can be stabilized at the relatively low firing rates observed in vivo if two conditions are met: (1) the background state, where all neurons are firing at low rates, is inhibition dominated, and (2) the fraction of neurons involved in a memory is above some threshold, so that there is sufficient coupling between the memory neurons and the background. This allows dynamical stabilization of the attractors, meaning feedback from the pool of background neurons stabilizes what would otherwise be an unstable state. We suggest that dynamical stabilization may be a strategy used for a broad range of computations, not just those involving attractors.

[1]  Josemir W Sander,et al.  The epidemiology of epilepsy: the size of the problem. , 2001, Seizure.

[2]  Nicolas Brunel,et al.  Dynamics of the Firing Probability of Noisy Integrate-and-Fire Neurons , 2002, Neural Computation.

[3]  Josemir W Sander,et al.  CPD — Education and self-assessment The epidemiology of epilepsy: the size of the problem , 2001, Seizure.

[4]  A. Treves Mean-field analysis of neuronal spike dynamics , 1993 .

[5]  Xiao-Jing Wang,et al.  The dynamical stability of reverberatory neural circuits , 2002, Biological Cybernetics.

[6]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[7]  M. Hasselmo,et al.  Graded persistent activity in entorhinal cortex neurons , 2002, Nature.

[8]  D. Amit,et al.  Effective neural response function for collective population states. , 1999, Network.

[9]  Buhmann Oscillations and low firing rates in associative memory neural networks. , 1989, Physical review. A, General physics.

[10]  A.,et al.  Spontaneous GABA * Receptor-Mediated Inhibitory Currents in Adult Rat Somatosensory Cortex , 2002 .

[11]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[12]  D. Hansel,et al.  Existence and stability of persistent states in large neuronal networks. , 2001, Physical review letters.

[13]  N. Brunel,et al.  Firing frequency of leaky intergrate-and-fire neurons with synaptic current dynamics. , 1998, Journal of theoretical biology.

[14]  W. Gerstner,et al.  Coherence and incoherence in a globally coupled ensemble of pulse-emitting units. , 1993, Physical review letters.

[15]  G. Sell,et al.  The Hopf Bifurcation and Its Applications , 1976 .

[16]  P. Lennie The Cost of Cortical Computation , 2003, Current Biology.

[17]  D. Prince,et al.  GABA A receptor-mediated currents in interneurons and pyramidal cells of rat visual cortex , 1998 .

[18]  Abbott,et al.  Asynchronous states in networks of pulse-coupled oscillators. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[19]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[20]  J M Fuster,et al.  Neuronal firing in the inferotemporal cortex of the monkey in a visual memory task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  P. Goldman-Rakic,et al.  Dissociation of object and spatial processing domains in primate prefrontal cortex. , 1993, Science.

[22]  Boris S. Gutkin,et al.  Dynamics of Membrane Excitability Determine Interspike Interval Variability: A Link Between Spike Generation Mechanisms and Cortical Spike Train Statistics , 1998, Neural Computation.

[23]  Y. Miyashita,et al.  Top-down signal from prefrontal cortex in executive control of memory retrieval , 1999, Nature.

[24]  Paul Antoine Salin,et al.  Spontaneous GABAA receptor-mediated inhibitory currents in adult rat somatosensory cortex. , 1996, Journal of neurophysiology.

[25]  Frances S. Chance,et al.  Gain Modulation from Background Synaptic Input , 2002, Neuron.

[26]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[27]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[28]  X. Wang,et al.  Synaptic Basis of Cortical Persistent Activity: the Importance of NMDA Receptors to Working Memory , 1999, The Journal of Neuroscience.

[29]  Nicolas Brunel,et al.  Dynamics of a recurrent network of spiking neurons before and following learning , 1997 .

[30]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[31]  Nicolas Brunel,et al.  Firing Rate of the Noisy Quadratic Integrate-and-Fire Neuron , 2003, Neural Computation.

[32]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[33]  L. Barrett‐Lennard,et al.  Graded persistent activity in entorhinal cortex neurons , 2002 .

[34]  E. Gardner The space of interactions in neural network models , 1988 .

[35]  H. Seung,et al.  In vivo intracellular recording and perturbation of persistent activity in a neural integrator , 2001, Nature Neuroscience.

[36]  Bard Ermentrout,et al.  Type I Membranes, Phase Resetting Curves, and Synchrony , 1996, Neural Computation.

[37]  Yasushi Miyashita,et al.  Forward Processing of Long-Term Associative Memory in Monkey Inferotemporal Cortex , 2003, The Journal of Neuroscience.

[38]  G. Ermentrout,et al.  Parabolic bursting in an excitable system coupled with a slow oscillation , 1986 .

[39]  Sompolinsky,et al.  Willshaw model: Associative memory with sparse coding and low firing rates. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[40]  B. Richmond,et al.  Intrinsic dynamics in neuronal networks. I. Theory. , 2000, Journal of neurophysiology.

[41]  Nava Rubin,et al.  Neural networks with low local firing rates , 1989 .

[42]  Y. Miyashita,et al.  Neural representation of visual objects: encoding and top-down activation , 2000, Current Opinion in Neurobiology.

[43]  Alessandro Treves,et al.  Localized activity profiles and storage capacity of rate-based autoassociative networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  G. Ojemann,et al.  Anatomic subdivisions in human temporal cortical neuronal activity related to recent verbal memory , 2002, Nature Neuroscience.

[45]  D. Mcintyre,et al.  Kindling: some old and some new , 2002, Epilepsy Research.

[46]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[47]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[48]  Peter E. Latham,et al.  Associative memory in realistic neuronal networks , 2001, NIPS.

[49]  T. Sejnowski,et al.  Comparison of current-driven and conductance-driven neocortical model neurons with Hodgkin-Huxley voltage-gated channels. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[50]  D. McCormick,et al.  Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. , 1985, Journal of neurophysiology.

[51]  A. Treves,et al.  How much of the hippocampus can be explained by functional constraints? , 1996, Hippocampus.

[52]  J. Magee,et al.  Distance-Dependent Increase in AMPA Receptor Number in the Dendrites of Adult Hippocampal CA1 Pyramidal Neurons , 2001, The Journal of Neuroscience.

[53]  B. Richmond,et al.  Intrinsic dynamics in neuronal networks. II. experiment. , 2000, Journal of neurophysiology.

[54]  Prof. Dr. Valentino Braitenberg,et al.  Anatomy of the Cortex , 1991, Studies of Brain Function.

[55]  D. Prince,et al.  GABAA receptor‐mediated currents in interneurons and pyramidal cells of rat visual cortex , 1998, The Journal of physiology.

[56]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[57]  K. Nakamura,et al.  Mnemonic firing of neurons in the monkey temporal pole during a visual recognition memory task. , 1995, Journal of neurophysiology.

[58]  E. Fetz,et al.  Synaptic Interactions between Primate Precentral Cortex Neurons Revealed by Spike-Triggered Averaging of Intracellular Membrane Potentials In Vivo , 1996, The Journal of Neuroscience.

[59]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[60]  N. Brunel Persistent activity and the single-cell frequency–current curve in a cortical network model , 2000, Network.