The coding of information by spiking neurons: an analytical study.

We analyse analytically the coding of information by a spiking neuron. The emphasis is on the question of how many spikes are necessary for the reliable discrimination of two different input signals. The discrimination ability is measured by the second-order Rényi mutual information between the random variable describing the name of the signal and a sequence of n output spikes. Analysing this measure as a function of n, we study the coding strategy of a single spiking neuron, with the following main results. A small number of output spikes is required for efficient discrimination of input signals, i.e. for encoding them, if the separation is easy; a large number of output spikes is required in the difficult case of separation of very similar input signals. Three different versions of the spike response model of a single neuron are studied. The approach presented can be regarded as a non-parametric version of the reconstruction method of Bialek.

[1]  Deco,et al.  Statistical-ensemble theory of redundancy reduction and the duality between unsupervised and supervised neural learning. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  William R. Softky,et al.  Simple codes versus efficient codes , 1995, Current Opinion in Neurobiology.

[3]  Wulfram Gerstner,et al.  Associative memory in a network of ‘spiking’ neurons , 1992 .

[4]  Wulfram Gerstner,et al.  Associative Memory in a Network of 'Biological' Neurons , 1990, NIPS.

[5]  M. Stemmler.  A single spike suffices: the simplest form of stochastic resonance in model neurons , 1996 .

[6]  E. Adrian,et al.  The impulses produced by sensory nerve endings , 1926, The Journal of physiology.

[7]  E. Adrian,et al.  The impulses produced by sensory nerve endings , 1926, The Journal of physiology.

[8]  W. Gerstner,et al.  Coherence and incoherence in a globally coupled ensemble of pulse-emitting units. , 1993, Physical review letters.

[9]  Adrian edgar douglas.  The basis of sensation: the action of the sense organs. , 1964 .

[10]  William T Newsome,et al.  Is there a signal in the noise? , 1995, Current Opinion in Neurobiology.

[11]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[12]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  Gustavo Deco,et al.  Nonlinear higher-order statistical decorrelation by volume-conserving neural architectures , 1995, Neural Networks.

[14]  Deco,et al.  Learning time series evolution by unsupervised extraction of correlations. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[15]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[16]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[17]  Anthony M. Zador,et al.  Information through a Spiking Neuron , 1995, NIPS.

[18]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[19]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[20]  A. Rényi.  On Measures of Entropy and Information , 1961 .

[21]  E. Adrian,et al.  The impulses produced by sensory nerve‐endings , 1926 .

[22]  E. Adrian.  The Mechanism of Nervous Action: Electrical Studies of the Neurone , 1932 .

[23]  G. Deco,et al.  An Information-Theoretic Approach to Neural Computing , 1997, Perspectives in Neural Computing.

[24]  Donald L. Snyder,et al.  Random point processes , 1975 .

[25]  M. Abeles.  Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[26]  B. Pompe,et al.  On some entropy methods in data analysis , 1994 .

[27]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.