Firing-rate models for neurons with a broad repertoire of spiking behaviors

Instantaneous firing rates are commonly used to describe either the compound spiking activity of neuron ensembles (population rate) or the trial-averaged response of individual neurons to multiple repetitions of the same stimulus. The dynamics of firing rates is often studied by means of population or firing-rate models. The main motivation for using such models rather than spiking neuron models is to reduce the dimensionality and complexity of the microscopic dynamics to allow analytical tractability, efficient simulation, and intuitive understanding. In most cases, population models have to be treated as purely phenomenological descriptions. Only under simplifying assumptions can they be derived or extracted from the single-neuron dynamics. Previous studies in this field were mainly restricted to homogeneous populations of simple integrate-and-fire neurons which can, to some extent, mimic the rather stereotypical behaviour of regularly firing neurons (e.g., pyramidal cells in the neocortex). Electrophysiological studies have revealed a large diversity of neuron types with different dynamical behaviours, ranging from regular spiking to bursting cells, from accommodating to non-accommodating cells, from integrators to resonators, from depolarization- to hyperpolarization-activated cells, etc. So far, the effect of this neuron-type diversity on the dynamics of neural populations is unclear. Here, we investigate the rate-response characteristics for a variety of neuron types in simulation experiments. To this end, we extend previous work on simple integrate-and-fire neurons [1,2] to the multi-timescale adaptive threshold (MAT) [3] and the Izhikevich model [4]. The model neurons are probed by spike trains modeled as realizations of inhomogeneous Poisson or Gamma point processes with sinusoidally modulated intensity. Average rates, modulation amplitudes and phases of the period-averaged spike responses are measured for a broad range of stimulus, neuron and synapse parameters. The stationary and nonstationary response properties are parameterized by means of nonlinear activation functions and linear filter kernels, respectively, serving as ingredients for simple linear-nonlinear firing rate models. We show that linear-nonlinear rate models can accurately predict the population responses to novel test stimuli for a broad range of parameters and neuron types.

[1]  Shigeru Shinomoto,et al.  Kernel bandwidth optimization in spike rate estimation , 2009, Journal of Computational Neuroscience.

[2]  T. Sejnowski,et al.  [Letters to nature] , 1996, Nature.

[3]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[4]  Markus Diesmann,et al.  Exact Subthreshold Integration with Continuous Spike Times in Discrete-Time Neural Network Simulations , 2007, Neural Computation.

[5]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[6]  H. Markram,et al.  Interneurons of the neocortical inhibitory system , 2004, Nature Reviews Neuroscience.

[7]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[8]  Frances S. Chance,et al.  Gain Modulation from Background Synaptic Input , 2002, Neuron.

[9]  Pierre Yger,et al.  NeuralEnsemble.Org: Unifying neural simulators in Python to ease the model complexity bottleneck , 1970 .

[10]  Gaute T. Einevoll,et al.  Firing-rate models capture essential response dynamics of LGN relay cells , 2013, Journal of Computational Neuroscience.

[11]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[12]  Sylvain Crochet,et al.  Synaptic Computation and Sensory Processing in Neocortical Layer 2/3 , 2013, Neuron.

[13]  Rupert Swarbrick,et al.  Firing-rate response of a neuron receiving excitatory and inhibitory synaptic shot noise. , 2010, Physical review letters.

[14]  Eugene M Izhikevich,et al.  Hybrid spiking models , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[15]  Shigeru Shinomoto,et al.  Elemental Spiking Neuron Model for Reproducing Diverse Firing Patterns and Predicting Precise Firing Times , 2011, Front. Comput. Neurosci..

[16]  Nicolas Brunel,et al.  From Spiking Neuron Models to Linear-Nonlinear Models , 2011, PLoS Comput. Biol..

[17]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[18]  Tomoki Fukai,et al.  Supercomputers Ready for Use as Discovery Machines for Neuroscience , 2012, Front. Neuroinform..

[19]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[20]  M. J. Richardson,et al.  Firing-rate response of linear and nonlinear integrate-and-fire neurons to modulated current-based and conductance-based synaptic drive. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  C. Petersen,et al.  The Excitatory Neuronal Network of the C2 Barrel Column in Mouse Primary Somatosensory Cortex , 2009, Neuron.

[22]  K. Funke,et al.  On the significance of temporally structured activity in the dorsal lateral geniculate nucleus (LGN) , 1997, Progress in Neurobiology.

[23]  W. Gerstner,et al.  Microcircuits of excitatory and inhibitory neurons in layer 2/3 of mouse barrel cortex. , 2012, Journal of neurophysiology.

[24]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[25]  Frances S. Chance,et al.  Effects of synaptic noise and filtering on the frequency response of spiking neurons. , 2001, Physical review letters.

[26]  Stefan Rotter,et al.  Exact digital simulation of time-invariant linear systems with applications to neuronal modeling , 1999, Biological Cybernetics.

[27]  Youping Xiao,et al.  A simple model of retina-LGN transmission , 2008, Journal of Computational Neuroscience.

[28]  Markus Diesmann,et al.  Simplicity and Efficiency of Integrate-and-Fire Neuron Models , 2009, Neural Computation.

[29]  Tomoki Fukai,et al.  Spiking network simulation code for petascale computers , 2014, Front. Neuroinform..

[30]  Kenneth D. Harris,et al.  Laminar-dependent effects of cortical state on auditory cortical spontaneous activity , 2012, Front. Neural Circuits.

[31]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[32]  B. Mandelbrot,et al.  RANDOM WALK MODELS FOR THE SPIKE ACTIVITY OF A SINGLE NEURON. , 1964, Biophysical journal.

[33]  P. Johannesma,et al.  Diffusion Models for the Stochastic Activity of Neurons , 1968 .

[34]  Eero P. Simoncelli,et al.  Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Encoding Model , 2004, Neural Computation.

[35]  Gaute T. Einevoll,et al.  Rate Dynamics of Leaky Integrate-and-Fire Neurons with Strong Synapses , 2010, Front. Comput. Neurosci..

[36]  Shigeru Shinomoto,et al.  Made-to-Order Spiking Neuron Model Equipped with a Multi-Timescale Adaptive Threshold , 2009, Front. Comput. Neurosci..

[37]  Awad H. Al-Mohy,et al.  A New Scaling and Squaring Algorithm for the Matrix Exponential , 2009, SIAM J. Matrix Anal. Appl..

[38]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[39]  Alex Roxin,et al.  The Role of Degree Distribution in Shaping the Dynamics in Networks of Sparsely Connected Spiking Neurons , 2011, Front. Comput. Neurosci..

[40]  Stephen Coombes,et al.  Waves, bumps, and patterns in neural field theories , 2005, Biological Cybernetics.

[41]  Wulfram Gerstner,et al.  Predicting spike timing of neocortical pyramidal neurons by simple threshold models , 2006, Journal of Computational Neuroscience.

[42]  C. Morris,et al.  Voltage oscillations in the barnacle giant muscle fiber. , 1981, Biophysical journal.

[43]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[44]  N. Matsuki,et al.  Interpyramid spike transmission stabilizes the sparseness of recurrent network activity. , 2013, Cerebral cortex.

[45]  E J Chichilnisky,et al.  Prediction and Decoding of Retinal Ganglion Cell Responses with a Probabilistic Spiking Model , 2005, The Journal of Neuroscience.

[46]  Nicholas J. Higham,et al.  The Scaling and Squaring Method for the Matrix Exponential Revisited , 2005, SIAM J. Matrix Anal. Appl..

[47]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[48]  Gaute T. Einevoll,et al.  Neural network firing-rate models on integral form , 2007, Biological Cybernetics.

[49]  Ben H. Jansen,et al.  Electroencephalogram and visual evoked potential generation in a mathematical model of coupled cortical columns , 1995, Biological Cybernetics.

[50]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[51]  R. Stein A THEORETICAL ANALYSIS OF NEURONAL VARIABILITY. , 1965, Biophysical journal.

[52]  Wulfram Gerstner,et al.  The quantitative single-neuron modeling competition , 2008, Biological Cybernetics.

[53]  Anders M. Dale,et al.  Estimation of Thalamocortical and Intracortical Network Models from Joint Thalamic Single-Electrode and Cortical Laminar-Electrode Recordings in the Rat Barrel System , 2009, PLoS Comput. Biol..

[54]  Wulfram Gerstner,et al.  Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. , 2005, Journal of neurophysiology.

[55]  Anthony N. Burkitt,et al.  A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties , 2006, Biological Cybernetics.

[56]  M. Carandini,et al.  Inhibition dominates sensory responses in awake cortex , 2012, Nature.

[57]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..