Coding and Decoding with Adapting Neurons: A Population Approach to the Peri-Stimulus Time Histogram

The response of a neuron to a time-dependent stimulus, as measured in a Peri-Stimulus-Time-Histogram (PSTH), exhibits an intricate temporal structure that reflects potential temporal coding principles. Here we analyze the encoding and decoding of PSTHs for spiking neurons with arbitrary refractoriness and adaptation. As a modeling framework, we use the spike response model, also known as the generalized linear neuron model. Because of refractoriness, the effect of the most recent spike on the spiking probability a few milliseconds later is very strong. The influence of the last spike needs therefore to be described with high precision, while the rest of the neuronal spiking history merely introduces an average self-inhibition or adaptation that depends on the expected number of past spikes but not on the exact spike timings. Based on these insights, we derive a ‘quasi-renewal equation’ which is shown to yield an excellent description of the firing rate of adapting neurons. We explore the domain of validity of the quasi-renewal equation and compare it with other rate equations for populations of spiking neurons. The problem of decoding the stimulus from the population response (or PSTH) is addressed analogously. We find that for small levels of activity and weak adaptation, a simple accumulator of the past activity is sufficient to decode the original input, but when refractory effects become large decoding becomes a non-linear function of the past activity. The results presented here can be applied to the mean-field analysis of coupled neuron networks, but also to arbitrary point processes with negative self-interaction.

[1]  A. Hawkes Spectra of some self-exciting and mutually exciting point processes , 1971 .

[2]  Oren Shriki,et al.  Rate Models for Conductance-Based Cortical Neuronal Networks , 2003, Neural Computation.

[3]  Wulfram Gerstner,et al.  Noise in Integrate-and-Fire Neurons: From Stochastic Input to Escape Rates , 2000, Neural Computation.

[4]  Carson C. Chow,et al.  Correlations, fluctuations, and stability of a finite-size network of coupled oscillators. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  W. Senn,et al.  Neocortical pyramidal cells respond as integrate-and-fire neurons to in vivo-like input currents. , 2003, Journal of neurophysiology.

[6]  P. Schwindt,et al.  Slow conductances in neurons from cat sensorimotor cortex in vitro and their role in slow excitability changes. , 1988, Journal of neurophysiology.

[7]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[8]  Dmitri B. Chklovskii,et al.  Over-complete representations on recurrent neural networks can support persistent percepts , 2010, NIPS.

[9]  Nicolas Brunel,et al.  Phase diagrams of sparsely connected networks of excitatory and inhibitory spiking neurons , 2000, Neurocomputing.

[10]  E. Marder,et al.  Decoding Synapses , 1996, The Journal of Neuroscience.

[11]  Nicolas Brunel,et al.  From Spiking Neuron Models to Linear-Nonlinear Models , 2011, PLoS Comput. Biol..

[12]  M. Chacron,et al.  Integrate-and-fire neurons with threshold noise: a tractable model of how interspike interval correlations affect neuronal signal transmission. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Xiao-Jing Wang,et al.  Spike-Frequency Adaptation of a Generalized Leaky Integrate-and-Fire Model Neuron , 2004, Journal of Computational Neuroscience.

[14]  K. Naka,et al.  White-Noise Analysis of a Neuron Chain: An Application of the Wiener Theory , 1972, Science.

[15]  Maria V. Sanchez-Vives,et al.  Adaptation and temporal decorrelation by single neurons in the primary visual cortex. , 2003, Journal of neurophysiology.

[16]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[17]  M. Fuortes,et al.  Interpretation of the Repetitive Firing of Nerve Cells , 1962, The Journal of general physiology.

[18]  Adrienne L. Fairhall,et al.  Efficiency and ambiguity in an adaptive neural code , 2001, Nature.

[19]  Wulfram Gerstner,et al.  Predicting spike timing of neocortical pyramidal neurons by simple threshold models , 2006, Journal of Computational Neuroscience.

[20]  L. Paninski Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[21]  J. Storm,et al.  Action potential repolarization and a fast after‐hyperpolarization in rat hippocampal pyramidal cells. , 1987, The Journal of physiology.

[22]  D. Hansel,et al.  How Spike Generation Mechanisms Determine the Neuronal Response to Fluctuating Inputs , 2003, The Journal of Neuroscience.

[23]  Jean-Pascal Pfister,et al.  Optimal Spike-Timing-Dependent Plasticity for Precise Action Potential Firing in Supervised Learning , 2005, Neural Computation.

[24]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[25]  W. Gerstner,et al.  Parameter extraction and classification of three cortical neuron types reveals two distinct adaptation mechanisms. , 2012, Journal of neurophysiology.

[26]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[27]  P. Lennie,et al.  Contrast adaptation in striate cortex of macaque , 1989, Vision Research.

[28]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[29]  B. Sakmann,et al.  Spiking in primary somatosensory cortex during natural whisking in awake head-restrained rats is cell-type specific , 2009, Proceedings of the National Academy of Sciences.

[30]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[31]  Bruce W. Knight,et al.  Dynamics of Encoding in Neuron Populations: Some General Mathematical Features , 2000, Neural Computation.

[32]  Daniel J. Amit,et al.  Quantitative Study of Attractor Neural Network Retrieving at Low Spike Rates: I , 1991 .

[33]  Wulfram Gerstner,et al.  Noise and the PSTH Response to Current Transients: I. General Theory and Application to the Integrate-and-Fire Neuron , 2001, Journal of Computational Neuroscience.

[34]  E J Chichilnisky,et al.  Prediction and Decoding of Retinal Ganglion Cell Responses with a Probabilistic Spiking Model , 2005, The Journal of Neuroscience.

[35]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[36]  Wulfram Gerstner,et al.  A benchmark test for a quantitative assessment of simple neuron models , 2008, Journal of Neuroscience Methods.

[37]  Wulfram Gerstner,et al.  From Stochastic Nonlinear Integrate-and-Fire to Generalized Linear Models , 2011, NIPS.

[38]  C. Enroth-Cugell,et al.  The contrast sensitivity of retinal ganglion cells of the cat , 1966, The Journal of physiology.

[39]  Terrence J Sejnowski,et al.  Communication in Neuronal Networks , 2003, Science.

[40]  D. Amit,et al.  Quantitative study of attractor neural networks retrieving at low spike rates: II. Low-rate retrieval in symmetric networks , 1991 .

[41]  A. Treves Mean-field analysis of neuronal spike dynamics , 1993 .

[42]  Liam Paninski,et al.  Statistical models for neural encoding, decoding, and optimal stimulus design. , 2007, Progress in brain research.

[43]  M. J. Richardson,et al.  Firing-rate response of linear and nonlinear integrate-and-fire neurons to modulated current-based and conductance-based synaptic drive. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[45]  Wulfram Gerstner,et al.  Spike-response model , 2008, Scholarpedia.

[46]  Farzad Farkhooi,et al.  Adaptation reduces variability of the neuronal population code. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  C. Gray,et al.  Dynamic spike threshold reveals a mechanism for synaptic coincidence detection in cortical neurons in vivo. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[48]  M. Carandini,et al.  Summation and division by neurons in primate visual cortex. , 1994, Science.

[49]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[50]  Nicholas G Hatsopoulos,et al.  The science of neural interface systems. , 2009, Annual review of neuroscience.

[51]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[52]  Walter Senn,et al.  Minimal Models of Adapted Neuronal Response to In VivoLike Input Currents , 2004, Neural Computation.

[53]  P. Dayan,et al.  Synapses with short-term plasticity are optimal estimators of presynaptic membrane potentials , 2010, Nature Neuroscience.

[54]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[55]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  Wulfram Gerstner,et al.  From spiking neurons to rate models: a cascade model as an approximation to spiking neuron models with refractoriness. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  M. J. Richardson,et al.  Dynamics of populations and networks of neurons with voltage-activated and calcium-activated currents. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[58]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[59]  P. Schwindt,et al.  Multiple potassium conductances and their functions in neurons from cat sensorimotor cortex in vitro. , 1988, Journal of neurophysiology.

[60]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[61]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[62]  Wulfram Gerstner,et al.  Universality in neural networks: the importance of the ‘mean firing rate’ , 1992, Biological Cybernetics.

[63]  J. Ringo Stimulus specific adaptation in inferior temporal and medial temporal cortex of the monkey , 1996, Behavioural Brain Research.

[64]  Wulfram Gerstner,et al.  Coding properties of spiking neurons: reverse and cross-correlations , 2001, Neural Networks.

[65]  J. Poulet,et al.  Synaptic Mechanisms Underlying Sparse Coding of Active Touch , 2011, Neuron.

[66]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[67]  R. Kass,et al.  Bayesian decoding of neural spike trains , 2010 .

[68]  Eero P. Simoncelli,et al.  Spike-triggered neural characterization. , 2006, Journal of vision.

[69]  Andreas V. M. Herz,et al.  A Universal Model for Spike-Frequency Adaptation , 2003, Neural Computation.

[70]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[71]  M. Meister,et al.  Fast and Slow Contrast Adaptation in Retinal Circuitry , 2002, Neuron.

[72]  Terrence J. Sejnowski,et al.  Soft Mixer Assignment in a Hierarchical Generative Model of Natural Scene Statistics , 2006, Neural Computation.

[73]  Kamiar Rahnama Rad,et al.  Mean-Field Approximations for Coupled Populations of Generalized Linear Model Spiking Neurons with Markov Refractoriness , 2009, Neural Computation.

[74]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[75]  Bartlett W. Mel,et al.  Encoding and Decoding Bursts by NMDA Spikes in Basal Dendrites of Layer 5 Pyramidal Neurons , 2009, The Journal of Neuroscience.

[76]  Johannes Schemmel,et al.  Spike-Frequency Adapting Neural Ensembles: Beyond Mean Adaptation and Renewal Theories , 2007, Neural Computation.

[77]  N. Brunel,et al.  From subthreshold to firing-rate resonance. , 2003, Journal of neurophysiology.

[78]  Wulfram Gerstner,et al.  What Matters in Neuronal Locking? , 1996, Neural Computation.

[79]  W. Wildman,et al.  Theoretical Neuroscience , 2014 .

[80]  Alan A. Stocker,et al.  Is the Homunculus Aware of Sensory Adaptation? , 2009, Neural Computation.

[81]  R L Smith,et al.  Adaptation, saturation, and physiological masking in single auditory-nerve fibers. , 1979, The Journal of the Acoustical Society of America.

[82]  W Gerstner,et al.  Noise spectrum and signal transmission through a population of spiking neurons. , 1999, Network.

[83]  W. Senn,et al.  Multiple time scales of temporal response in pyramidal and fast spiking cortical neurons. , 2006, Journal of neurophysiology.