Dynamical mean-field theory of spiking neuron ensembles: response to a single spike with independent noises.

A semianalytical dynamical mean-field theory has been developed for a study of dynamics of an ensemble of N-unit FitzHugh-Nagumo neurons subject to white noises. Assuming weak noises and the Gaussian distribution of state variables, we have driven equations of motions for moments of local and global variables. Dynamical mean-field approximation (DMA) has replaced original, 2N-dimensional stochastic differential equations (DEs) by eight-dimensional deterministic DEs, whereas the conventional moment method yields N(2N+3)-dimensional deterministic DEs for local variables. We have discussed the dependence of the spike firing precision and the synchronization on the noise intensity, synaptic coupling, and the size of the neuron ensemble. The spike timing precision is shown to be improved by increasing the size of the neuron ensemble, even when there are no couplings among neurons. When the coupling is introduced, neurons in ensembles respond to an input spike with a partial synchronization. Results calculated by our DMA theory are in good agreement with those obtained by direct simulations. DMA theory is extended to a large cluster which can be divided into multiple subclusters according to their functions. A model calculation has demonstrated that when the noise intensity is moderate, the spike propagation with a fairly precise timing is possible among noisy subclusters with feed-forward couplings, as in the synfire chain. We have compared DMA theory with the conventional moment method, showing that the former may be alternatively derived from the latter by a reduction in the number of moments with the mean-field approximation.

[1]  S. Yoshizawa,et al.  An Active Pulse Transmission Line Simulating Nerve Axon , 1962, Proceedings of the IRE.

[2]  Hu,et al.  Phase synchronization in coupled nonidentical excitable systems and array-enhanced coherence resonance , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[3]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.

[4]  E. Haskell,et al.  Population density methods for large-scale modelling of neuronal networks with realistic synaptic kinetics: cutting the dimension down to size , 2001 .

[5]  R. FitzHugh.  Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[6]  Scott Kirkpatrick,et al.  Single-Site Approximations in the Electronic Theory of Simple Binary Alloys , 1968 .

[7]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[8]  David Horn,et al.  Fast Temporal Encoding and Decoding with Spiking Neurons , 1998, Neural Computation.

[9]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  Hideo Hasegawa,et al.  Stochastic resonance of ensemble neurons for transient spike trains: wavelet analysis. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  A. Longtin.  Stochastic resonance in neuron models , 1993 .

[12]  deCharms Rc,et al.  Information coding in the cortex by independent or coordinated populations. , 1998 .

[13]  H C Tuckwell,et al.  Noisy spiking neurons and networks: useful approximations for firing probabilities and global behavior. , 1998, Bio Systems.

[14]  Frank Moss,et al.  Stochastic resonance: noise-enhanced order , 1999 .

[15]  Germán Mato,et al.  On Numerical Simulations of Integrate-and-Fire Neural Networks , 1998, Neural Computation.

[16]  K Pakdaman,et al.  Dynamics of moments of FitzHugh-Nagumo neuronal models and stochastic bifurcations. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  K Pakdaman,et al.  Response of an ensemble of noisy neuron models to a single input. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[18]  Khashayar Pakdaman,et al.  Noise-induced transition in excitable neuron models , 2001, Biological Cybernetics.

[19]  Lawrence Sirovich,et al.  On the Simulation of Large Populations of Neurons , 2004, Journal of Computational Neuroscience.

[20]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[21]  Abbott,et al.  Asynchronous states in networks of pulse-coupled oscillators. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[22]  H. Tuckwell,et al.  Statistical properties of stochastic nonlinear dynamical models of single spiking neurons and neural networks. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[23]  Moss,et al.  Noise-Mediated Spike Timing Precision from Aperiodic Stimuli in an Array of Hodgekin-Huxley-Type Neurons. , 1996, Physical review letters.

[24]  M. Tovée,et al.  Processing speed in the cerebral cortex and the neurophysiology of visual masking , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[25]  N G Stocks,et al.  Generic noise-enhanced coding in neuronal arrays. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  C. Carr,et al.  A time-comparison circuit in the electric fish midbrain. I. Behavior and physiology , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  R. Christopher deCharms,et al.  Primary cortical representation of sounds by the coordination of action-potential timing , 1996, Nature.

[28]  J. Eggermont.  Is There a Neural Code? , 1998, Neuroscience & Biobehavioral Reviews.

[29]  Wiesenfeld,et al.  Stochastic resonance on a circle. , 1994, Physical review letters.

[30]  Heinz Zemanek,et al.  Kybernetik , 1964, Elektron. Rechenanlagen.

[31]  E. Adrian,et al.  The impulses produced by sensory nerve endings , 1926, The Journal of physiology.

[32]  Tj Sejnowski,et al.  Neural Codes and Distributed Representations , 1999 .

[33]  R. Eckhorn,et al.  Coherent oscillations: A mechanism of feature linking in the visual cortex? , 1988, Biological Cybernetics.

[34]  André Longtin,et al.  Stochastic and Deterministic Resonances for Excitable Systems , 1998 .

[35]  C. Stevens,et al.  Input synchrony and the irregular firing of cortical neurons , 1998, Nature Neuroscience.

[36]  A. Treves.  Mean-field analysis of neuronal spike dynamics , 1993 .

[37]  T. Kanamaru,et al.  Theoretical analysis of array-enhanced stochastic resonance in the diffusively coupled FitzHugh-Nagumo equation. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  Carson C. Chow,et al.  Stochastic resonance without tuning , 1995, Nature.

[39]  H. C. Tuckwell,et al.  A dynamical system for the approximate moments of nonlinear stochastic models of spiking neurons and networks , 2000 .

[40]  Y. Kuramoto.  Collective synchronization of pulse-coupled oscillators and excitable units , 1991 .

[41]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[42]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[43]  Rufin van Rullen,et al.  Rate Coding Versus Temporal Order Coding: What the Retinal Ganglion Cells Tell the Visual Cortex , 2001, Neural Computation.

[44]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  E. Louis,et al.  Triggering synchronized oscillations through arbitrarily weak diversity in close-to-threshold excitable media. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[46]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[47]  H. Kalmus.  Biological Cybernetics , 1972, Nature.

[48]  André Longtin,et al.  Stochastic resonance in models of neuronal ensembles , 1997 .

[49]  Arthur Sherman,et al.  From spikers to bursters via coupling: Help from heterogeneity , 2001, Bulletin of mathematical biology.

[50]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[51]  Shunsuke Sato,et al.  Stochastic resonance and spike-timing precision in an ensemble of leaky integrate and fire neuron models , 1999 .

[52]  K Pakdaman,et al.  Noise-enhanced neuronal reliability. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Paul Soven,et al.  Coherent-Potential Model of Substitutional Disordered Alloys , 1967 .

[54]  A. Zador,et al.  Neural representation and the cortical code. , 2000, Annual review of neuroscience.

[55]  R. Reid,et al.  Synchronous activity in the visual system. , 1999, Annual review of physiology.

[56]  Henry C. Tuckwell,et al.  Analytical and Simulation Results for Stochastic Fitzhugh-Nagumo Neurons and Neural Networks , 1998, Journal of Computational Neuroscience.