Recognition by Variance: Learning Rules for Spatiotemporal Patterns

Recognizing specific spatiotemporal patterns of activity, which take place at timescales much larger than the synaptic transmission and membrane time constants, is a demand from the nervous system exemplified, for instance, by auditory processing. We consider the total synaptic input that a single readout neuron receives on presentation of spatiotemporal spiking input patterns. Relying on the monotonic relation between the mean and the variance of a neuron's input current and its spiking output, we derive learning rules that increase the variance of the input current evoked by learned patterns relative to that obtained from random background patterns. We demonstrate that the model can successfully recognize a large number of patterns and exhibits a slow deterioration in performance with increasing number of learned patterns. In addition, robustness to time warping of the input patterns is revealed to be an emergent property of the model. Using a leaky integrate-and-fire realization of the readout neuron, we demonstrate that the above results also apply when considering spiking output.

[1]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[2]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[3]  A. Aertsen,et al.  Neural representation of the acoustic biotope: On the existence of stimulus-event relations for sensory neurons , 1979, Biological Cybernetics.

[4]  W. Senn,et al.  Neocortical pyramidal cells respond as integrate-and-fire neurons to in vivo-like input currents. , 2003, Journal of neurophysiology.

[5]  J J Hopfield,et al.  What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Michael J. Berry,et al.  The structure and precision of retinal spike trains. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[7]  D Margoliash,et al.  Auditory representation of autogenous song in the song system of white-crowned sparrows. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[8]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[9]  Paul C. Bressloff,et al.  Perceptron-like learning in time-summating neural networks , 1992 .

[10]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[11]  H Markram,et al.  Dynamics of population rate codes in ensembles of neocortical neurons. , 2004, Journal of neurophysiology.

[12]  H. Kelley Method of Gradients , 1962 .

[13]  Christof Koch,et al.  Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey , 1999, Neural Computation.

[14]  Dezhe Z Jin,et al.  Spiking neural network for recognizing spatiotemporal sequences of spikes. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  P. J. Sjöström,et al.  Endocannabinoid-dependent neocortical layer-5 LTD in the absence of postsynaptic spiking. , 2004, Journal of neurophysiology.

[16]  J. Schiller,et al.  NMDA spikes in basal dendrites of cortical pyramidal neurons , 2000, Nature.

[17]  E. Chichilnisky,et al.  Precision of spike trains in primate retinal ganglion cells. , 2004, Journal of neurophysiology.