Duality of Rate Coding and Temporal Coding in Multilayered Feedforward Networks

A functional role for precise spike timing has been proposed as an alternative hypothesis to rate coding. We show in this article that both the synchronous firing code and the population rate code can be used dually in a common framework of a single neural network model. Furthermore, these two coding mechanisms are bridged continuously by several modulatable model parameters, including shared connectivity, feedback strength, membrane leak rate, and neuron heterogeneity. The rates of change of these parameters are closely related to the response time and the timescale of learning.

[1]  P Lánský,et al.  On approximations of Stein's neuronal model. , 1984, Journal of theoretical biology.

[2]  Kazuyuki Aihara,et al.  Possible neural coding with interevent intervals of synchronous firing. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  C. Koch,et al.  Synaptic background activity influences spatiotemporal integration in single pyramidal cells. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[4]  P H Tiesinga,et al.  Robust gamma oscillations in networks of inhibitory hippocampal interneurons , 1999, Network.

[5]  Kazuyuki Aihara,et al.  Dual Information Representation with Stable Firing Rates and Chaotic Spatiotemporal Spike Patterns in a Neural Network Model , 2001, Neural Computation.

[6]  Kazuyuki Aihara,et al.  Ergodicity of Spike Trains: When Does Trial Averaging Make Sense? , 2003, Neural Computation.

[7]  Mark C. W. van Rossum,et al.  Fast Propagation of Firing Rates through Layered Networks of Noisy Neurons , 2002, The Journal of Neuroscience.

[8]  Xiaoqin Wang,et al.  Temporal and rate representations of time-varying signals in the auditory cortex of awake primates , 2001, Nature Neuroscience.

[9]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[10]  K. Hoffmann,et al.  Synchronization of Neuronal Activity during Stimulus Expectation in a Direction Discrimination Task , 1997, The Journal of Neuroscience.

[11]  Tomoki Fukai,et al.  Fokker-Planck approach to the pulse packet propagation in synfire chain , 2001, Neural Networks.

[12]  Antonio R. Damasio,et al.  The Brain Binds Entities and Events by Multiregional Activation from Convergence Zones , 1989, Neural Computation.

[13]  Carson C. Chow,et al.  Synchronization and Oscillatory Dynamics in Heterogeneous, Mutually Inhibited Neurons , 1998, Journal of Computational Neuroscience.

[14]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[15]  R. Stein,et al.  The information capacity of nerve cells using a frequency code. , 1967, Biophysical journal.

[16]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[17]  Stephen Coombes,et al.  Dynamics of Strongly Coupled Spiking Neurons , 2000, Neural Computation.

[18]  R. Douglas,et al.  Opening the grey box , 1991, Trends in Neurosciences.

[19]  Kazuyuki Aihara,et al.  Self-Organizing Dual Coding Based on Spike-Time-Dependent Plasticity , 2004, Neural Computation.

[20]  G. Laurent,et al.  Who reads temporal information contained across synchronized and oscillatory spike trains? , 1998, Nature.

[21]  Kazuyuki Aihara,et al.  Dynamical Cell Assembly Hypothesis -- Theoretical Possibility of Spatio-temporal Coding in the Cortex , 1996, Neural Networks.

[22]  Pérez,et al.  Synchronization, diversity, and topology of networks of integrate and fire oscillators , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[23]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[24]  W Singer,et al.  Patterns of Synchronization in the Superior Colliculus of Anesthetized Cats , 1999, The Journal of Neuroscience.

[25]  J Feng,et al.  Synchronization due to common pulsed input in Stein's model. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[26]  Ad Aertsen,et al.  Propagation of cortical synfire activity: survival probability in single trials and stability in the mean , 2001, Neural Networks.

[27]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[28]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[29]  Bottani.  Pulse-coupled relaxation oscillators: From biological synchronization to self-organized criticality. , 1995, Physical review letters.

[30]  R. Eckhorn,et al.  Coherent oscillations: A mechanism of feature linking in the visual cortex? , 1988, Biological Cybernetics.

[31]  Eytan Domany,et al.  Models of Neural Networks I , 1991 .

[32]  Simone Cardoso.  Synchronization of Neuronal Activity during Stimulus Expectation in a Direction Discrimination Task , 1997 .

[33]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[34]  A. Aertsen,et al.  Dynamics of neuronal interactions in monkey cortex in relation to behavioural events , 1995, Nature.

[35]  M. Abeles.  Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[36]  Carson C. Chow,et al.  Noise shaping in populations of coupled model neurons. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[37]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[38]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[39]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[40]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[41]  T. Sejnowski,et al.  Information transfer in entrained cortical neurons. , 2002, Network.

[42]  K. Aihara,et al.  Synchronization of pulse-coupled excitable neurons. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[43]  L. Paninski,et al.  Information about movement direction obtained from synchronous activity of motor cortical neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[45]  Christof Koch,et al.  Biophysics of Computation: Information Processing in Single Neurons (Computational Neuroscience Series) , 1998 .

[46]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[47]  O. Prospero-Garcia,et al.  Reliability of Spike Timing in Neocortical Neurons , 1995 .

[48]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[49]  J. Krüger,et al.  Recognizing the visual stimulus from neuronal discharges , 1991, Trends in Neurosciences.

[50]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[51]  C. Gray,et al.  Cellular Mechanisms Contributing to Response Variability of Cortical Neurons In Vivo , 1999, The Journal of Neuroscience.

[52]  Bruce W. Knight,et al.  Dynamics of Encoding in a Population of Neurons , 1972, The Journal of general physiology.

[53]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[54]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[55]  Kazuyuki Aihara,et al.  Filtered interspike interval encoding by class II neurons , 2003 .

[56]  Kazuyuki Aihara,et al.  Spatiotemporal Spike Encoding of a Continuous External Signal , 2002, Neural Computation.

[57]  E. Niebur,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2022 .

[58]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[59]  Sauer,et al.  Reconstruction of dynamical systems from interspike intervals. , 1994, Physical review letters.

[60]  A. Aertsen,et al.  Spike synchronization and rate modulation differentially involved in motor cortical function. , 1997, Science.

[61]  Kazuyuki Aihara,et al.  Bridging rate coding and temporal spike coding by effect of noise. , 2002, Physical review letters.