Investigating the integrate and fire model as the limit of a random discharge model: a stochastic analysis perspective

In the mean field integrate-and-fire model, the dynamics of a typical neuron within a large network is modeled as a diffusion-jump stochastic process whose jump takes place once the voltage reaches a threshold. In this work, the main goal is to establish the convergence relationship between the regularized process and the original one where in the regularized process, the jump mechanism is replaced by a Poisson dynamic, and jump intensity within the classically forbidden domain goes to infinity as the regularization parameter vanishes. On the macroscopic level, the Fokker-Planck equation for the process with random discharges (i.e. Poisson jumps) are defined on the whole space, while the equation for the limit process is on the half space. However, with the iteration scheme, the difficulty due to the domain differences has been greatly mitigated and the convergence for the stochastic process and the firing rates can be established. Moreover, we find a polynomial-order convergence for the distribution by a re-normalization argument in probability theory. Finally, by numerical experiments, we quantitatively explore the rate and the asymptotic behavior of the convergence for both linear and nonlinear models.

[1]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[2]  C. Cercignani.  Rarefied Gas Dynamics: From Basic Concepts to Actual Calculations , 2000 .

[3]  B. Øksendal.  Stochastic Differential Equations , 1985 .

[4]  H. Yau,et al.  Linear Boltzmann equation as the weak coupling limit of a random Schrödinger equation , 1999 .

[5]  Duane Q. Nykamp,et al.  A Population Density Approach That Facilitates Large-Scale Modeling of Neural Networks: Analysis and an Application to Orientation Tuning , 2004, Journal of Computational Neuroscience.

[6]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[7]  Leszek Słomiński,et al.  Stochastic differential equations with jump reflection at time-dependent barriers , 2010 .

[8]  R. Veltz,et al.  Long time behavior of a mean-field model of interacting neurons , 2018, 1810.08562.

[9]  M. Pulvirenti,et al.  THE LINEAR BOLTZMANN EQUATION FOR LONG-RANGE FORCES: A DERIVATION FROM PARTICLE SYSTEMS , 1999 .

[10]  A. Friedman.  Partial Differential Equations of Parabolic Type , 1983 .

[11]  Floyd B. Hanson,et al.  Applied stochastic processes and control for jump-diffusions - modeling, analysis, and computation , 2007, Advances in design and control.

[12]  T. Liggett.  Continuous Time Markov Processes: An Introduction , 2010 .

[13]  Patrick Jahn,et al.  Motoneuron membrane potentials follow a time inhomogeneous jump diffusion process , 2011, Journal of Computational Neuroscience.

[14]  Maria E. Schonbek,et al.  Classical Solutions for a Nonlinear Fokker-Planck Equation Arising in Computational Neuroscience , 2011, 1109.1298.

[15]  Duane Q. Nykamp,et al.  A Population Density Approach That Facilitates Large-Scale Modeling of Neural Networks: Extension to Slow Inhibitory Synapses , 2001, Neural Computation.

[16]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[17]  Louis Tao,et al.  A numerical solver for a nonlinear Fokker-Planck equation representation of neuronal network dynamics , 2011, J. Comput. Phys..

[18]  Iddo Ben-Ari,et al.  Ergodic behavior of diffusions with random jumps from the boundary , 2009 .

[19]  Lawrence Sirovich,et al.  On the Simulation of Large Populations of Neurons , 2004, Journal of Computational Neuroscience.

[20]  Jingwei Hu,et al.  A structure preserving numerical scheme for Fokker-Planck equations of neuron networks: numerical analysis and exploration , 2019, J. Comput. Phys..

[21]  W. Feller.  Diffusion processes in one dimension , 1954 .

[22]  F. Delarue,et al.  Particle systems with a singular mean-field self-excitation. Application to neuronal networks , 2014, 1406.1151.

[23]  Maria Giovanna Garroni,et al.  Green Functions for Second Order Parabolic Integro-Differential Problems , 1993 .

[24]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[25]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[26]  María J. Cáceres,et al.  Analysis of nonlinear noisy integrate & fire neuron models: blow-up and steady states , 2010, Journal of mathematical neuroscience.

[27]  M. Mattia,et al.  Population dynamics of interacting spiking neurons. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  D. Talay,et al.  Mean-Field Limit of a Stochastic Particle System Smoothly Interacting Through Threshold Hitting-Times and Applications to Neural Networks with Dendritic Component , 2014, SIAM J. Math. Anal..

[29]  Wenbo V. Li,et al.  Diffusions with holding and jumping boundary , 2013 .

[30]  Jian‐Guo Liu,et al.  Rigorous Justification of the Fokker-Planck Equations of Neural Networks Based on an Iteration Perspective , 2020, SIAM J. Math. Anal..

[31]  David Cai,et al.  Cascade-induced synchrony in stochastically driven neuronal networks. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  B. Øksendal.  Stochastic differential equations : an introduction with applications , 1987 .

[33]  W. Feller.  THE PARABOLIC DIFFERENTIAL EQUATIONS AND THE ASSOCIATED SEMI-GROUPS OF TRANSFORMATIONS , 1952 .

[34]  S. Shreve,et al.  Stochastic differential equations , 1955, Mathematical Proceedings of the Cambridge Philosophical Society.

[35]  María J Cáceres,et al.  Beyond blow-up in excitatory integrate and fire neuronal networks: Refractory period and spontaneous activity. , 2014, Journal of theoretical biology.

[36]  R. Durrett.  Probability: Theory and Examples , 1993 .

[37]  C. DeWitt-Morette,et al.  Mathematical Analysis and Numerical Methods for Science and Technology , 1990 .

[38]  Romain Veltz,et al.  Hopf bifurcation in a Mean-Field model of spiking neurons , 2021, Electronic Journal of Probability.

[39]  Ricarda Schneider,et al.  Analysis and numerical solver for excitatory-inhibitory networks with delay and refractory periods , 2017, ESAIM: Mathematical Modelling and Numerical Analysis.

[40]  Philip Protter.  Stochastic differential equations with jump reflection at the boundary , 1980, Advances in Applied Probability.

[41]  Lawrence Sirovich,et al.  Dynamics of neural populations: Stability and synchrony , 2006, Network.

[42]  Jun Peng.  A note on the first passage time of diffusions with holding and jumping boundary , 2014 .

[43]  Sylvain Rubenthaler,et al.  First hitting times for general non-homogeneous 1d diffusion processes: density estimates in small time , 2013 .

[44]  Olivier D. Faugeras,et al.  Noise-Induced Behaviors in Neural Mean Field Dynamics , 2011, SIAM J. Appl. Dyn. Syst..

[45]  R. Durrett.  Stochastic Calculus: A Practical Introduction , 1996 .

[46]  Xiao-Jing Wang,et al.  Mean-Field Theory of Irregularly Spiking Neuronal Populations and Working Memory in Recurrent Cortical Networks , 2003 .

[47]  Aaditya V. Rangan,et al.  DYNAMICS OF CURRENT-BASED, POISSON DRIVEN, INTEGRATE-AND-FIRE NEURONAL NETWORKS " , 2010 .

[48]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[49]  R. Pinsky,et al.  Spectral analysis of a family of second-order elliptic operators with nonlocal boundary condition indexed by a probability measure , 2007, 0707.0612.