Ergodicity of Spike Trains: When Does Trial Averaging Make Sense?

Neuronal information processing is often studied on the basis of spiking patterns. The relevant statistics such as firing rates calculated with the peri-stimulus time histogram are obtained by averaging spiking patterns over many experimental runs. However, animals should respond to one experimental stimulation in real situations, and what is available to the brain is not the trial statistics but the population statistics. Consequently, physiological ergodicity, namely, the consistency between trial averaging and population averaging, is implicitly assumed in the data analyses, although it does not trivially hold true. In this letter, we investigate how characteristics of noisy neural network models, such as single neuron properties, external stimuli, and synaptic inputs, affect the statistics of firing patterns. In particular, we show that how high membrane potential sensitivity to input fluctuations, inability of neurons to remember past inputs, external stimuli with large variability and temporally separated peaks, and relatively few contributions of synaptic inputs result in spike trains that are reproducible over many trials. The reproducibility of spike trains and synchronous firing are contrasted and related to the ergodicity issue. Several numerical calculations with neural network examples are carried out to support the theoretical results.

[1]  Kazuyuki Aihara,et al.  Bridging rate coding and temporal spike coding by effect of noise. , 2002, Physical review letters.

[2]  A. Herz,et al.  Content-addressable memory with spiking neurons , 1999 .

[3]  Ad Aertsen,et al.  Dynamics of functional coupling in the cerebral cortex , 1994 .

[4]  E. Vaadia,et al.  Spatiotemporal structure of cortical activity: properties and behavioral relevance. , 1998, Journal of neurophysiology.

[5]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[6]  Kazuyuki Aihara,et al.  Global and local synchrony of coupled neurons in small-world networks , 2004, Biological Cybernetics.

[7]  Deliang Wang,et al.  Global competition and local cooperation in a network of neural oscillators , 1995 .

[8]  Mark C. W. van Rossum,et al.  Fast Propagation of Firing Rates through Layered Networks of Noisy Neurons , 2002, The Journal of Neuroscience.

[9]  O. Prospero-Garcia,et al.  Reliability of Spike Timing in Neocortical Neurons , 1995 .

[10]  E. Harth,et al.  Cooperativity in brain function: Assemblies of approximately 30 neurons , 1982, Experimental Neurology.

[11]  H. L. Bryant,et al.  Spike initiation by transmembrane current: a white‐noise analysis. , 1976, The Journal of physiology.

[12]  Kazuyuki Aihara,et al.  Possible neural coding with interevent intervals of synchronous firing. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Kazuyuki Aihara,et al.  Dual Information Representation with Stable Firing Rates and Chaotic Spatiotemporal Spike Patterns in a Neural Network Model , 2001, Neural Computation.

[14]  E. Niebur,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2022 .

[15]  Wulfram Gerstner,et al.  Spiking Neuron Models: An Introduction , 2002 .

[16]  J. Kurths,et al.  Array-enhanced coherence resonance: nontrivial effects of heterogeneity and spatial independence of noise. , 2001, Physical review letters.

[17]  Bulsara,et al.  Nonlinear dynamic elements with noisy sinusoidal forcing: Enhancing response via nonlinear coupling. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[18]  Frank Moss,et al.  Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance , 1993, Nature.

[19]  Bulsara,et al.  Cooperative behavior in the periodically modulated Wiener process: Noise-induced complexity in a model neutron. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[20]  Kazuyuki Aihara,et al.  Spatiotemporal Spike Encoding of a Continuous External Signal , 2002, Neural Computation.

[21]  J Feng,et al.  Synchronization due to common pulsed input in Stein's model. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[22]  Bruce W. Knight,et al.  Dynamics of Encoding in a Population of Neurons , 1972, The Journal of general physiology.

[23]  Bulsara,et al.  Array enhanced stochastic resonance and spatiotemporal synchronization. , 1995, Physical review letters.

[24]  M. Abeles Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[25]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[26]  Kazuyuki Aihara,et al.  Duality of Rate Coding and Temporal Coding in Multilayered Feedforward Networks , 2003, Neural Computation.

[27]  D. Chik,et al.  Coherence resonance and noise-induced synchronization in globally coupled Hodgkin-Huxley neurons. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[28]  S. Strogatz,et al.  Synchronization of pulse-coupled biological oscillators , 1990 .

[29]  A. Aertsen,et al.  Dynamics of neuronal interactions in monkey cortex in relation to behavioural events , 1995, Nature.

[30]  J. Kurths,et al.  Array-Enhanced Coherence Resonance , 2001 .

[31]  D. Ferster,et al.  The contribution of noise to contrast invariance of orientation tuning in cat visual cortex. , 2000, Science.

[32]  A. Aertsen,et al.  Neuronal assemblies , 1989, IEEE Transactions on Biomedical Engineering.

[33]  N. Rashevsky,et al.  Mathematical biology , 1961, Connecticut medicine.

[34]  J. von Neumann,et al.  Probabilistic Logic and the Synthesis of Reliable Organisms from Unreliable Components , 1956 .

[35]  Gordon L. Shaw,et al.  Computer simulation in brain science: Simulations of the trion model and the search for the code of higher cortical processing , 1988 .

[36]  Wulfram Gerstner,et al.  Spiking Neuron Models: Formal spiking neuron models , 2002 .

[37]  A. Hodgkin The local electric changes associated with repetitive action in a non‐medullated axon , 1948, The Journal of physiology.

[38]  Germán Mato,et al.  Synchrony in Excitatory Neural Networks , 1995, Neural Computation.

[39]  L. Ricciardi,et al.  Diffusion Processes and Related Topics in Biology. , 1978 .

[40]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[41]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[42]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[44]  Terrence J. Sejnowski,et al.  RAPID STATE SWITCHING IN BALANCED CORTICAL NETWORK MODELS , 1995 .

[45]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[46]  J. Kurths,et al.  Coherence Resonance in a Noise-Driven Excitable System , 1997 .

[47]  M. Egelhaaf,et al.  Variability in spike trains during constant and dynamic stimulation. , 1999, Science.

[48]  J. D. Hunter,et al.  Resonance effect for neural spike time reliability. , 1998, Journal of neurophysiology.

[49]  Hu,et al.  Phase synchronization in coupled nonidentical excitable systems and array-enhanced coherence resonance , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[50]  Kazuyuki Aihara,et al.  Dynamical Cell Assembly Hypothesis -- Theoretical Possibility of Spatio-temporal Coding in the Cortex , 1996, Neural Networks.

[51]  Wulfram Gerstner,et al.  Extracting Oscillations: Neuronal Coincidence Detection with Noisy Periodic Spike Input , 1998, Neural Computation.

[52]  Eugene M. Izhikevich,et al.  Neural excitability, Spiking and bursting , 2000, Int. J. Bifurc. Chaos.

[53]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[54]  Wulfram Gerstner,et al.  Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns , 1993, Biological Cybernetics.

[55]  E. Barkai,et al.  Nonergodicity of blinking nanocrystals and other Lévy-walk processes. , 2005, Physical review letters.

[56]  Carson C. Chow,et al.  Stochastic resonance without tuning , 1995, Nature.

[57]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[58]  Stephen Coombes,et al.  Dynamics of Strongly Coupled Spiking Neurons , 2000, Neural Computation.

[59]  G A Cecchi,et al.  Noise in neurons is message dependent. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.