Impact of synaptic unreliability on the information transmitted by spiking neurons.

The spike generating mechanism of cortical neurons is highly reliable, able to produce spikes with a precision of a few milliseconds or less. The excitatory synapses driving these neurons are by contrast much less reliable, subject both to release failures and quantal fluctuations. This suggests that synapses represent the primary bottleneck limiting the faithful transmission of information through cortical circuitry. How does the capacity of a neuron to convey information depend on the properties of its synaptic drive? We address this question rigorously in an information theoretic framework. We consider a model in which a population of independent unreliable synapses provides the drive to an integrate-and-fire neuron. Within this model, the mutual information between the synaptic drive and the resulting output spike train can be computed exactly from distributions that depend only on a single variable, the interspike interval. The reduction of the calculation to dependence on only a single variable greatly reduces the amount of data required to obtain reliable information estimates. We consider two factors that govern the rate of information transfer: the synaptic reliability and the number of synapses connecting each presynaptic axon to its postsynaptic target (i.e., the connection redundancy, which constitutes a special form of input synchrony). The information rate is a smooth function of both mechanisms; no sharp transition is observed from an "unreliable" to a "reliable" mode. Increased connection redundancy can compensate for synaptic unreliability, but only under the assumption that the fine temporal structure of individual spikes carries information. If only the number of spikes in some relatively long-time window carries information (a "mean rate" code), an increase in the fidelity of synaptic transmission results in a seemingly paradoxical decrease in the information available in the spike train. This suggests that the fine temporal structure of spike trains can be used to maintain reliable transmission with unreliable synapses.

[1]  U. Fano Ionization Yield of Radiations. II. The Fluctuations of the Number of Ions , 1947 .

[2]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[3]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[4]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[5]  W. McCulloch,et al.  The limiting information capacity of a neuronal link , 1952 .

[6]  B. Katz Nerve, Muscle and Synapse , 1966 .

[7]  H. L. Bryant,et al.  Spike initiation by transmembrane current: a white‐noise analysis. , 1976, The Journal of physiology.

[8]  W. Precht The synaptic organization of the brain G.M. Shepherd, Oxford University Press (1975). 364 pp., £3.80 (paperback) , 1976, Neuroscience.

[9]  G. Shepherd The Synaptic Organization of the Brain , 1979 .

[10]  L. Optican,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. , 1987, Journal of neurophysiology.

[11]  William Bialek,et al.  Real-time performance of a movement-sensitive neuron in the blowfly visual system: coding and information transfer in short spike sequences , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  R. Zucker Short-term synaptic plasticity. , 1989 .

[13]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[14]  B J Richmond,et al.  Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. II. Information transmission. , 1990, Journal of neurophysiology.

[15]  C. Stevens,et al.  Origin of variability in quantal size in cultured hippocampal neurons and hippocampal slices. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[16]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  R. Malinow,et al.  The probability of transmitter release at a mammalian central synapse , 1993, Nature.

[18]  K M Harris,et al.  Occurrence and three-dimensional structure of multiple synapses between individual radiatum axons and their target pyramidal cells in hippocampal area CA1 , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[20]  Christian Rosenmund,et al.  Nonuniform probability of glutamate release at a hippocampal synapse. , 1993, Science.

[21]  William Bialek,et al.  Bits and brains: Information flow in the nervous system , 1993 .

[22]  A. Burgen Information flow in the nervous system , 1993, European Review.

[23]  C. Stevens,et al.  An evaluation of causes for unreliability of synaptic transmission. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[24]  E. Vaadia,et al.  Synchronization in neuronal transmission and its importance for information processing. , 1994 .

[25]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[26]  William T Newsome,et al.  Is there a signal in the noise? , 1995, Current Opinion in Neurobiology.

[27]  William R. Softky,et al.  Simple codes versus efficient codes , 1995, Current Opinion in Neurobiology.

[28]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[29]  O. Prospero-Garcia,et al.  Reliability of Spike Timing in Neocortical Neurons , 1995 .

[30]  Anthony M. Zador,et al.  Information through a Spiking Neuron , 1995, NIPS.

[31]  C. Stevens,et al.  Neural Coding: The enigma of the brain , 1995, Current Biology.

[32]  D Ferster,et al.  Cracking the Neuronal Code , 1995, Science.

[33]  Michael DeWeese,et al.  Optimization Principles for the Neural Code , 1995, NIPS.

[34]  Barak A. Pearlmutter,et al.  VC Dimension of an Integrate-and-Fire Neuron Model , 1996, Neural Comput..

[35]  K. Martin,et al.  Excitatory synaptic inputs to spiny stellate cells in cat visual cortex , 1996, Nature.

[36]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[37]  C. Koch,et al.  From stimulus encoding to feature extraction in weakly electric fish , 1996, Nature.

[38]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[39]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[40]  S. Laughlin,et al.  The rate of information transfer at graded-potential synapses , 1996, Nature.

[41]  Christof Koch,et al.  Coding of Time-Varying Signals in Spike Trains of Integrate-and-Fire Neurons with Random Threshold , 1999, Neural Computation.

[42]  J. Anthony Movshon,et al.  Reconstructing Stimulus Velocity from Neuronal Responses in Area MT , 1996, NIPS.

[43]  A. Zador,et al.  Dynamic Synapses in the Cortex , 1997, Neuron.

[44]  Stefano Panzeri,et al.  How Well Can We Estimate the Information Carried in Neuronal Responses from Limited Samples? , 1997, Neural Computation.

[45]  C. Stevens,et al.  Heterogeneity of Release Probability, Facilitation, and Depletion at Central Synapses , 1997, Neuron.

[46]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[47]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[48]  Thomas J. Carew,et al.  Multiple overlapping processes underlying short-term synaptic enhancement , 1997, Trends in Neurosciences.

[49]  Pamela Reinagel,et al.  Decoding visual information from a population of retinal ganglion cells. , 1997, Journal of neurophysiology.

[50]  B. Connors,et al.  Distinct forms of short-term plasticity at excitatory synapses of hippocampus and neocortex. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[51]  G D Lewen,et al.  Reproducibility and Variability in Neural Spike Trains , 1997, Science.

[52]  L. Abbott,et al.  A Quantitative Description of Short-Term Plasticity at Excitatory Synapses in Layer 2/3 of Rat Primary Visual Cortex , 1997, The Journal of Neuroscience.

[53]  Wolfgang Maass,et al.  Dynamic Stochastic Synapses as Computational Units , 1997, Neural Computation.