Integration and transmission of distributed deterministic neural activity in feed-forward networks

A ten layer feed-forward network characterized by diverging/converging patterns of projection between successive layers of regular spiking (RS) neurons is activated by an external spatiotemporal input pattern fed to Layer 1 in presence of stochastic background activities fed to all layers. We used three dynamical systems to derive the external input spike trains including the temporal information, and three types of neuron models for the network, i.e. either a network formed either by neurons modeled by exponential integrate-and-fire dynamics (RS-EIF, Fourcaud-Trocmé et al., 2003), or by simple spiking neurons (RS-IZH, Izhikevich, 2004) or by multiple-timescale adaptive threshold neurons (RS-MAT, Kobayashi et al., 2009), given five intensities for the background activity. The assessment of the temporal structure embedded in the output spike trains was carried out by detecting the preferred firing sequences for the reconstruction of de-noised spike trains (Asai and Villa, 2008). We confirmed that the RS-MAT model is likely to be more efficient in integrating and transmitting the temporal structure embedded in the external input. We observed that this structure could be propagated not only up to the 10th layer but in some cases it was retained better beyond the 4th downstream layers. This study suggests that diverging/converging network structures, by the propagation of synfire activity, could play a key role in the transmission of complex temporal patterns of discharges associated to deterministic nonlinear activity. This article is part of a Special Issue entitled Neural Coding.

[1]  Eric O. Postma,et al.  Robust Feedforward Processing in Synfire Chains , 1996, Int. J. Neural Syst..

[2]  Yoshiyuki Asai,et al.  Deterministic neural dynamics transmitted through neural networks , 2008, Neural Networks.

[3]  Shigeru Shinomoto,et al.  Made-to-Order Spiking Neuron Model Equipped with a Multi-Timescale Adaptive Threshold , 2009, Front. Comput. Neurosci..

[4]  A. Longtin Stochastic resonance in neuron models , 1993 .

[5]  Igor V. Tetko,et al.  A Comparative Study of Pattern Detection Algorithm and Dynamical System Approach Using Simulated Spike Trains , 1997, ICANN.

[6]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[7]  Fredric M. Wolf,et al.  Action Potential Onset Dynamics and the Response Speed of Neuronal Populations , 2004, Journal of Computational Neuroscience.

[8]  A E Villa,et al.  Dynamical cell assemblies in the rat auditory cortex in a reaction-time task. , 1998, Bio Systems.

[9]  José Pedro Segundo,et al.  Nonlinear Dynamics of Point Process Systems and Data , 2003, Int. J. Bifurc. Chaos.

[10]  Alessandro E P Villa,et al.  Empirical Evidence about Temporal Structure in Multi-unit Recordings , 2000 .

[11]  I. Tetko,et al.  Spatiotemporal activity patterns of rat cortical neurons predict responses in a conditioned task. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[12]  M. Volgushev,et al.  Unique features of action potential initiation in cortical neurons , 2006, Nature.

[13]  Professor Moshe Abeles,et al.  Local Cortical Circuits , 1982, Studies of Brain Function.

[14]  Norio Matsuki,et al.  Circuit topology for synchronizing neurons in spontaneously active networks , 2010, Proceedings of the National Academy of Sciences.

[15]  M. Abeles Quantification, smoothing, and confidence limits for single-units' histograms , 1982, Journal of Neuroscience Methods.

[16]  Klaus Obermayer,et al.  The effect of background noise on the precision of pulse packet propagation in feed-forward networks , 2007, Neurocomputing.

[17]  R. Miller Time and the brain , 2000 .

[18]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[19]  Markus Diesmann,et al.  A Compositionality Machine Realized by a Hierarchic Architecture of Synfire Chains , 2011, Front. Comput. Neurosci..

[20]  A. Aertsen,et al.  Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model , 2008, The Journal of Neuroscience.

[21]  Igor V. Tetko,et al.  Deterministic Behaviour of Short Time Series , 1999 .

[22]  Yoshiyuki Asai,et al.  Transmission of Distributed Deterministic Temporal Information through a Diverging/Converging Three-Layers Neural Network , 2010, ICANN.

[23]  M. Abeles,et al.  Detecting precise firing sequences in experimental data , 2001, Journal of Neuroscience Methods.

[24]  Alessandro E. P. Villa,et al.  Low-dimensional chaotic attractors in the rat brain , 1996, Biological Cybernetics.

[25]  D. Hansel,et al.  How Spike Generation Mechanisms Determine the Neuronal Response to Fluctuating Inputs , 2003, The Journal of Neuroscience.

[26]  Hideyuki Câteau,et al.  Controlling Synfire Chain by Inhibitory Synaptic Input , 2007 .

[27]  Stefan Rotter,et al.  Higher-Order Statistics of Input Ensembles and the Response of Simple Model Neurons , 2003, Neural Computation.

[28]  Yoshiyuki Asai,et al.  Detection of a Dynamical System Attractor from Spike Train Analysis , 2006, ICANN.

[29]  J. Segundo,et al.  The spike trains of inhibited pacemaker neurons seen through the magnifying glass of nonlinear analyses. , 1998, Neuroscience.

[30]  Markus Diesmann,et al.  The ground state of cortical feed-forward networks , 2002, Neurocomputing.

[31]  Kazushi Ikeda,et al.  A synfire chain in layered coincidence detectors with random synaptic delays , 2003, Neural Networks.

[32]  Igor V. Tetko,et al.  A pattern grouping algorithm for analysis of spatiotemporal patterns in neuronal spike trains. 1. Detection of repeated patterns , 2001, Journal of Neuroscience Methods.

[33]  W. Gerstner,et al.  Dynamic I-V curves are reliable predictors of naturalistic pyramidal-neuron voltage traces. , 2008, Journal of neurophysiology.

[34]  Alessandro E. P. Villa,et al.  Determination of chaotic attractors in the rat brain , 1996 .

[35]  A. Bulsara,et al.  Stochastic resonance in a single neuron model: theory and analog simulation. , 1991, Journal of theoretical biology.

[36]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[37]  Igor V. Tetko,et al.  Pattern grouping algorithm and de-convolution filtering of non-stationary correlated Poisson processes , 2001, Neurocomputing.

[38]  Yoshiyuki Asai,et al.  Reconstruction of Underlying Nonlinear Deterministic Dynamics Embedded in Noisy Spike Trains , 2008, Journal of biological physics.

[39]  Wulfram Gerstner,et al.  A benchmark test for a quantitative assessment of simple neuron models , 2008, Journal of Neuroscience Methods.

[40]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[41]  Daniel Lehmann,et al.  Modeling Compositionality by Dynamic Binding of Synfire Chains , 2004, Journal of Computational Neuroscience.

[42]  Markus Diesmann,et al.  The spread of rate and correlation in stationary cortical networks , 2003, Neurocomputing.

[43]  Nicolas Brunel,et al.  How Connectivity, Background Activity, and Synaptic Properties Shape the Cross-Correlation between Spike Trains , 2009, The Journal of Neuroscience.

[44]  Igor V. Tetko,et al.  A pattern grouping algorithm for analysis of spatiotemporal patterns in neuronal spike trains. 2. Application to simultaneous single unit recordings , 2001, Journal of Neuroscience Methods.

[45]  Shigeru Shinomoto,et al.  Elemental Spiking Neuron Model for Reproducing Diverse Firing Patterns and Predicting Precise Firing Times , 2011, Front. Comput. Neurosci..

[46]  Daqing Guo,et al.  Signal propagation in feedforward neuronal networks with unreliable synapses , 2011, Journal of Computational Neuroscience.

[47]  Igor V. Tetko,et al.  Spatiotemporal activity patterns detected from single cell measurements from behaving animals , 1999, Other Conferences.

[48]  Moshe Abeles,et al.  On Embedding Synfire Chains in a Balanced Network , 2003, Neural Computation.