Modeling networks of spiking neurons as interacting processes with memory of variable length

We consider a new class of non Markovian processes with a countable number of interacting components, both in discrete and continuous time. Each component is represented by a point process indicating if it has a spike or not at a given time. The system evolves as follows. For each component, the rate (in continuous time) or the probability (in discrete time) of having a spike depends on the entire time evolution of the system since the last spike time of the component. In discrete time this class of systems extends in a non trivial way both Spitzer's interacting particle systems, which are Markovian, and Rissanen's stochastic chains with memory of variable length which have finite state space. In continuous time they can be seen as a kind of Rissanen's variable length memory version of the class of self-exciting point processes which are also called "Hawkes processes", however with infinitely many components. These features make this class a good candidate to describe the time evolution of networks of spiking neurons. In this article we present a critical reader's guide to recent papers dealing with this class of models, both in discrete and in continuous time. We briefly sketch results concerning perfect simulation and existence issues, de-correlation between successive interspike intervals, the longtime behavior of finite non-excited systems and propagation of chaos in mean field systems.

[1]  J. Touboul Propagation of chaos in neural fields , 2011, 1108.2414.

[2]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[3]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[4]  J. Huguenard,et al.  Reciprocal inhibitory connections and network synchrony in the mammalian thalamus. , 1999, Science.

[5]  Karl J. Friston,et al.  Neural masses and fields: modeling the dynamics of brain activity , 2014, Front. Comput. Neurosci..

[6]  Guilherme Ost,et al.  A model for neural activity in the absence of external stimuli , 2014 .

[7]  F. Delarue,et al.  Particle systems with a singular mean-field self-excitation. Application to neuronal networks , 2014, 1406.1151.

[8]  Hawkes processes with variable length memory and an infinite number of components , 2014, Advances in Applied Probability.

[9]  B Cessac,et al.  A discrete time neural network model with spiking neurons: II: Dynamics with noise , 2010, Journal of mathematical biology.

[10]  E. Orlandi,et al.  Neighborhood radius estimation for variable-neighborhood random fields , 2010, 1002.4850.

[11]  J. Touboul,et al.  Mean-field description and propagation of chaos in networks of Hodgkin-Huxley and FitzHugh-Nagumo neurons , 2012, The Journal of Mathematical Neuroscience.

[12]  G. Mil’shtein,et al.  Interaction of Markov Processes , 1972 .

[13]  F. Delarue,et al.  Global solvability of a networked integrate-and-fire model of McKean–Vlasov type , 2012, 1211.0299.

[14]  Guilherme Ost,et al.  Hydrodynamic Limit for Spatially Structured Interacting Neurons , 2015 .

[15]  Lasso and probabilistic inequalities for multivariate point processes , 2015, 1208.0570.

[16]  B. Cessac,et al.  Mean-field equations, bifurcation map and route to chaos in discrete time neural networks , 1994 .

[17]  Eva Locherbach,et al.  On a toy model of interacting neurons , 2014, 1410.3263.

[18]  Marc Benayoun,et al.  Avalanches in a Stochastic Model of Spiking Neurons , 2010, PLoS Comput. Biol..

[19]  Olivier D. Faugeras,et al.  A Constructive Mean-Field Analysis of Multi-Population Neural Networks with Random Synaptic Weights and Stochastic Inputs , 2008, Front. Comput. Neurosci..

[20]  Paul C. Bressloff,et al.  Stochastic Neural Field Theory and the System-Size Expansion , 2009, SIAM J. Appl. Math..

[21]  Antonio Galves,et al.  Stochastic chains with memory of variable length , 2008, 0804.2050.

[22]  M. Samuelides,et al.  Large deviations and mean-field theory for asymmetric random recurrent neural networks , 2002 .

[23]  E. Presutti,et al.  Hydrodynamic Limit for Interacting Neurons , 2014, 1401.4264.

[24]  Imre Csiszár,et al.  Context tree estimation for not necessarily finite memory processes, via BIC and MDL , 2005, IEEE Transactions on Information Theory.

[25]  J. Rasmussen,et al.  Perfect simulation of Hawkes processes , 2005, Advances in Applied Probability.

[26]  Jonathan D. Touboul,et al.  On the Dynamics of Random Neuronal Networks , 2014, Journal of Statistical Physics.

[27]  R. Kötter,et al.  Connecting Mean Field Models of Neural Activity to EEG and fMRI Data , 2010, Brain Topography.

[28]  A. Sznitman Topics in propagation of chaos , 1991 .

[29]  A. Galves,et al.  Infinite Systems of Interacting Chains with Memory of Variable Length—A Stochastic Model for Biological Neural Nets , 2012, 1212.5505.

[30]  P. Brémaud,et al.  STABILITY OF NONLINEAR HAWKES PROCESSES , 1996 .

[31]  JORMA RISSANEN,et al.  A universal data compression system , 1983, IEEE Trans. Inf. Theory.

[32]  D. Brillinger Maximum likelihood analysis of spike trains of interacting nerve cells , 2004, Biological Cybernetics.

[33]  A. Masi,et al.  Mathematical Methods for Hydrodynamic Limits , 1991 .

[34]  A. Hawkes Point Spectra of Some Mutually Exciting Point Processes , 1971 .

[35]  T M Li Ge Te Interacting Particle Systems , 2013 .

[36]  C. Landim,et al.  Scaling Limits of Interacting Particle Systems , 1998 .

[37]  A. Galves,et al.  Identifying interacting pairs of sites in Ising models on a countable set , 2010, 1006.0272.

[38]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[39]  Stefan Grosskinsky Warwick,et al.  Interacting Particle Systems , 2016 .

[40]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[41]  S. Delattre,et al.  High dimensional Hawkes processes , 2014, 1403.5764.

[42]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[43]  M. Kac Foundations of Kinetic Theory , 1956 .