Computation by Ensemble Synchronization in Recurrent Networks with Synaptic Depression

While computation by ensemble synchronization is considered to be a robust and efficient way for information processing in the cortex (C. Von der Malsburg and W. Schneider (1986) Biol. Cybern. 54: 29–40; W. Singer (1994) Inter. Rev. Neuro. 37: 153–183; J.J. Hopfield (1995) Nature 376: 33–36; E. Vaadia et al. (1995) Nature 373: 515–518), the neuronal mechanisms that might be used to achieve it are yet to be uncovered. Here we analyze a neural network model in which the computations are performed by near coincident firing of neurons in response to external inputs. This near coincident firing is enabled by activity dependent depression of inter-neuron connections. We analyze the network behavior by using a mean-field approximation, which allows predicting the network response to various inputs. We demonstrate that the network is very sensitive to temporal aspects of the inputs. In particular, periodically applied inputs of increasing frequency result in different response profiles. Moreover, applying combinations of different stimuli lead to a complex response, which cannot be easily predicted from responses to individual components. These results demonstrate that networks with synaptic depression can perform complex computations on time-dependent inputs utilizing the ability to generate temporally synchronous firing of single neurons.

[1]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[2]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[3]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[4]  J. T. Murphy,et al.  Cross Correlation Studies in Primate Motor Cortex: Synaptic Interaction and Shared Input , 1985, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[5]  J. L. Hemmen,et al.  Nonlinear neural networks. , 1986, Physical review letters.

[6]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[7]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[8]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[9]  S. Strogatz,et al.  Synchronization of pulse-coupled biological oscillators , 1990 .

[10]  D. P. Phillips,et al.  Separate mechanisms control spike numbers and inter-spike intervals in transient responses of cat auditory cortex neurons , 1991, Hearing Research.

[11]  Ad Aertsen,et al.  Coding and Computation in the Cortex: Single-Neuron Activity and Cooperative Phenomena , 1992 .

[12]  A. Treves.  Mean-field analysis of neuronal spike dynamics , 1993 .

[13]  W Singer,et al.  Coherence as an organizing principle of cortical functions. , 1994, International review of neurobiology.

[14]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[15]  Germán Mato,et al.  Synchrony in Excitatory Neural Networks , 1995, Neural Computation.

[16]  A. Aertsen,et al.  Dynamics of neuronal interactions in monkey cortex in relation to behavioural events , 1995, Nature.

[17]  R. Christopher deCharms,et al.  Primary cortical representation of sounds by the coordination of action-potential timing , 1996, Nature.

[18]  M Abeles,et al.  Spatio-temporal firing patterns in the frontal cortex of behaving monkeys , 1996, Journal of Physiology-Paris.

[19]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[20]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[21]  P. Heil,et al.  Auditory cortical onset responses revisited. I. First-spike timing. , 1997, Journal of neurophysiology.

[22]  A. Aertsen,et al.  Spike synchronization and rate modulation differentially involved in motor cortical function. , 1997, Science.

[23]  M. Kilgard,et al.  Plasticity of temporal information processing in the primary auditory cortex , 1998, Nature Neuroscience.

[24]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.

[25]  M. Merzenich,et al.  Optimizing sound features for cortical neurons. , 1998, Science.

[26]  I. Tetko,et al.  Spatiotemporal activity patterns of rat cortical neurons predict responses in a conditioned task. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Israel Nelken,et al.  Responses of auditory-cortex neurons to structural features of natural sounds , 1999, Nature.

[28]  B. Richmond,et al.  Intrinsic dynamics in neuronal networks. I. Theory. , 2000, Journal of neurophysiology.

[29]  H. Markram,et al.  t Synchrony Generation in Recurrent Networks with Frequency-Dependent Synapses , 2000, The Journal of Neuroscience.

[30]  G. Elston,et al.  Pyramidal Cells, Patches, and Cortical Columns: a Comparative Study of Infragranular Neurons in TEO, TE, and the Superior Temporal Polysensory Area of the Macaque Monkey , 2000, The Journal of Neuroscience.

[31]  Carl van Vreeswijk,et al.  Patterns of Synchrony in Neural Networks with Spike Adaptation , 2001, Neural Computation.

[32]  Bard Ermentrout,et al.  When inhibition not excitation synchronizes neural firing , 1994, Journal of Computational Neuroscience.

[33]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.