Information transmission with spiking Bayesian neurons

Spike trains of cortical neurons resulting from repeatedpresentations of a stimulus are variable and exhibit Poisson-like statistics. Many models of neural coding therefore assumed that sensory information is contained in instantaneous firing rates, not spike times. Here, we ask how much information about time-varying stimuli can be transmitted by spiking neurons with such input and output variability. In particular, does this variability imply spike generation to be intrinsically stochastic? We consider a model neuron that estimates optimally the current state of a time-varying binary variable (e.g. presence of a stimulus) by integrating incoming spikes. The unit signals its current estimate to other units with spikes whenever the estimate increased by a fixed amount. As shown previously, this computation results in integrate and fire dynamics with Poisson-like output spike trains. This output variability is entirely due to the stochastic input rather than noisy spike generation. As a result such a deterministic neuron can transmit most of the information about the time varying stimulus. This contrasts with a standard model of sensory neurons, the linear–nonlinear Poisson (LNP) model which assumes that most variability in output spike trains is due to stochastic spike generation. Although it yields the same firing statistics, we found that such noisy firing results in the loss of most information. Finally, we use this framework to compare potential effects of top-down attention versus bottom-up saliency on information transfer with spiking neurons.

[1]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[2]  R. Stein,et al.  The information capacity of nerve cells using a frequency code. , 1967, Biophysical journal.

[3]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[4]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[5]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[6]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989 .

[7]  B J Richmond,et al.  Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. II. Information transmission. , 1990, Journal of neurophysiology.

[8]  J P Miller,et al.  Representation of sensory information in the cricket cercal sensory system. II. Information theoretic calculation of system accuracy and optimal tuning-curve widths of four primary interneurons. , 1991, Journal of neurophysiology.

[9]  J. Robson,et al.  Steady discharges of X and Y retinal ganglion cells of cat under photopic illuminance , 1992, Visual Neuroscience.

[10]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[11]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[12]  Stefano Panzeri,et al.  How Well Can We Estimate the Information Carried in Neuronal Responses from Limited Samples? , 1997, Neural Computation.

[13]  Michael J. Berry,et al.  Adaptation of retinal processing to image contrast and spatial scale , 1997, Nature.

[14]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[15]  Rajesh P. N. Rao,et al.  Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex , 1997, Neural Computation.

[16]  J Gautrais,et al.  Rate coding versus temporal order coding: a theoretical approach. , 1998, Bio Systems.

[17]  Boris S. Gutkin,et al.  Dynamics of Membrane Excitability Determine Interspike Interval Variability: A Link Between Spike Generation Mechanisms and Cortical Spike Train Statistics , 1998, Neural Computation.

[18]  Michael J. Berry,et al.  The Neural Code of the Retina , 1999, Neuron.

[19]  Peter E. Latham,et al.  Narrow Versus Wide Tuning Curves: What's Best for a Population Code? , 1999, Neural Computation.

[20]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[21]  Alexander Borst,et al.  Information theory and neural coding , 1999, Nature Neuroscience.

[22]  B J Richmond,et al.  Stochastic nature of precisely timed spike patterns in visual system neuronal responses. , 1999, Journal of neurophysiology.

[23]  William Bialek,et al.  Adaptive Rescaling Maximizes Information Transmission , 2000, Neuron.

[24]  E J Chichilnisky,et al.  A simple white noise analysis of neuronal light responses , 2001, Network.

[25]  Adrienne L. Fairhall,et al.  Efficiency and ambiguity in an adaptive neural code , 2001, Nature.

[26]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[27]  Si Wu,et al.  Attention Modulation of Neural Tuning Through Peak and Base Rate , 2001, Neural Computation.

[28]  M. Carrasco,et al.  Covert attention affects the psychometric function of contrast sensitivity , 2002, Vision Research.

[29]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[30]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[31]  R. Freeman,et al.  Orientation selectivity in the cat's striate cortex is invariant with stimulus contrast , 2004, Experimental Brain Research.

[32]  Emery N. Brown,et al.  Dynamic Analysis of Neural Encoding by Point Process Adaptive Filtering , 2004, Neural Computation.

[33]  Rajesh P. N. Rao Hierarchical Bayesian Inference in Networks of Spiking Neurons , 2004, NIPS.

[34]  Stefan Treue,et al.  Perceptual enhancement of contrast by attention , 2004, Trends in Cognitive Sciences.

[35]  Rajesh P. N. Rao Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.

[36]  Jianfeng Feng,et al.  Decoding Input Signals in Time Domain—A Model Approach , 2004, Journal of Computational Neuroscience.

[37]  L. Paninski,et al.  Superlinear Population Encoding of Dynamic Hand Trajectory in Primary Motor Cortex , 2004, The Journal of Neuroscience.

[38]  Nicole C. Rust,et al.  Do We Know What the Early Visual System Does? , 2005, The Journal of Neuroscience.

[39]  W. Gerstner,et al.  Generalized Bienenstock-Cooper-Munro rule for spiking neurons that maximizes information transmission. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[40]  M. Meister,et al.  Dynamic predictive coding by the retina , 2005, Nature.

[41]  E J Chichilnisky,et al.  Prediction and Decoding of Retinal Ganglion Cell Responses with a Probabilistic Spiking Model , 2005, The Journal of Neuroscience.

[42]  Mohammad Rezaeian Hidden Markov Process: A New Representation, Entropy Rate and Estimation Entropy , 2006, ArXiv.

[43]  Angela J. Yu Optimal Change-Detection and Spiking Neurons , 2006, NIPS.

[44]  Alexandre Pouget,et al.  Exact Inferences in a Neural Implementation of a Hidden Markov Model , 2007, Neural Computation.

[45]  Peter Dayan,et al.  Fast Population Coding , 2007, Neural Computation.

[46]  Sophie Denève,et al.  Bayesian Spiking Neurons I: Inference , 2008, Neural Computation.