Mean Field description of and propagation of chaos in recurrent multipopulation networks of Hodgkin-Huxley and Fitzhugh-Nagumo neurons

We derive the mean-field equations arising as the limit of a network of interacting spiking neurons, as the number of neurons goes to infinity. The neurons belong to a fixed number of populations and are represented either by the Hodgkin-Huxley model or by one of its simplified version, the Fitzhugh-Nagumo model. The synapses between neurons are either electrical or chemical. The network is assumed to be fully connected. The maximum conductances vary randomly. Under the condition that all neurons initial conditions are drawn independently from the same law that depends only on the population they belong to, we prove that a propagation of chaos phenomenon takes places, namely that in the mean-field limit, any finite number of neurons become independent and, within each population, have the same probability distribution. This probability distribution is solution of a set of implicit equations, either nonlinear stochastic differential equations resembling the McKean-Vlasov equations, or non-local partial differential equations resembling the McKean-Vlasov-Fokker- Planck equations. We prove the well-posedness of these equations, i.e. the existence and uniqueness of a solution. We also show the results of some preliminary numerical experiments that indicate that the mean-field equations are a good representation of the mean activity of a ?finite size network, even for modest sizes. These experiment also indicate that the McKean-Vlasov-Fokker- Planck equations may be a good way to understand the mean-field dynamics through, e.g., a bifurcation analysis.

[1]  Alain-Sol Sznitman A propagation of chaos result for Burgers' equation , 1986 .

[2]  Olivier D. Faugeras,et al.  Local/Global Analysis of the Stationary Solutions of Some Neural Field Equations , 2009, SIAM J. Appl. Dyn. Syst..

[3]  D. Dawson Critical dynamics and fluctuations for a mean-field model of cooperative behavior , 1983 .

[4]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[5]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[6]  J. Touboul,et al.  A characterization of the first hitting time of double integral processes to curved boundaries , 2008, Advances in Applied Probability.

[7]  David Terman,et al.  Mathematical foundations of neuroscience , 2010 .

[8]  W. Schiesser The Numerical Method of Lines: Integration of Partial Differential Equations , 1991 .

[9]  John M. Beggs,et al.  Behavioral / Systems / Cognitive Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004 .

[10]  S. Coombes,et al.  Bumps, breathers, and waves in a neural network with spike frequency adaptation. , 2005, Physical review letters.

[11]  R. FitzHugh Mathematical models of threshold phenomena in the nerve membrane , 1955 .

[12]  X. Mao,et al.  Stochastic Differential Equations and Applications , 1998 .

[13]  A. Sznitman Équations de type de Boltzmann, spatialement homogènes , 1984 .

[14]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[15]  A. Guionnet Averaged and quenched propagation of chaos for spin glass dynamics , 1997 .

[16]  Alain Destexhe,et al.  A Master Equation Formalism for Macroscopic Modeling of Asynchronous Irregular Activity States , 2009, Neural Computation.

[17]  Hiroshi Tanaka,et al.  Some probabilistic problems in the spatially homogeneous Boltzmann equation , 1983 .

[18]  Marc Benayoun,et al.  Avalanches in a Stochastic Model of Spiking Neurons , 2010, PLoS Comput. Biol..

[19]  J. M. Herrmann,et al.  Phase transitions towards criticality in a neural system with adaptive interactions. , 2009, Physical review letters.

[20]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[21]  Paul C. Bressloff,et al.  Stochastic Neural Field Theory and the System-Size Expansion , 2009, SIAM J. Appl. Math..

[22]  Hiroshi Tanaka Limit Theorems for Certain Diffusion Processes with Interaction , 1984 .

[23]  A. Sznitman Nonlinear reflecting diffusion process, and the propagation of chaos and fluctuations associated , 1984 .

[24]  Olivier D. Faugeras,et al.  Absolute Stability and Complete Synchronization in a Class of Neural Fields Models , 2008, SIAM J. Appl. Math..

[25]  H. Plesser Aspects of Signal Processing in Noisy Neurons , 2001 .

[26]  Terrence J. Sejnowski,et al.  An Efficient Method for Computing Synaptic Conductances Based on a Kinetic Model of Receptor Binding , 1994, Neural Computation.

[27]  H. Sompolinsky,et al.  Relaxational dynamics of the Edwards-Anderson model and the mean-field theory of spin-glasses , 1982 .

[28]  W. Braun,et al.  The Vlasov dynamics and its fluctuations in the 1/N limit of interacting classical particles , 1977 .

[29]  Christoph W. Ueberhuber Numerical computation : methods, software, and analysis , 1997 .

[30]  H. McKean,et al.  A CLASS OF MARKOV PROCESSES ASSOCIATED WITH NONLINEAR PARABOLIC EQUATIONS , 1966, Proceedings of the National Academy of Sciences of the United States of America.

[31]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[32]  William E. Schiesser,et al.  A Compendium of Partial Differential Equation Models: Method of Lines Analysis with Matlab , 2009 .

[33]  Hiroshi Tanaka,et al.  Central limit theorem for a simple diffusion model of interacting particles , 1981 .

[34]  Olivier Faugeras,et al.  The spikes trains probability distributions: A stochastic calculus approach , 2007, Journal of Physiology-Paris.

[35]  Olivier P. Faugeras,et al.  Hyperbolic Planforms in Relation to Visual Edges and Textures Perception , 2009, PLoS Comput. Biol..

[36]  Hiroshi Tanaka Probabilistic treatment of the Boltzmann equation of Maxwellian molecules , 1978 .

[37]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[38]  Lyle J. Graham,et al.  Population model of hippocampal pyramidal neurons, linking a refractory density approach to conductance-based neurons. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[40]  A. Treves Mean-field analysis of neuronal spike dynamics , 1993 .

[41]  A. Sznitman Topics in propagation of chaos , 1991 .

[42]  D. Bover,et al.  Moment equation methods for nonlinear stochastic systems , 1978 .

[43]  Michael A. Buice,et al.  Systematic Fluctuation Expansion for Neural Network Activity Equations , 2009, Neural Computation.

[44]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[45]  K. Morton,et al.  Numerical Solution of Partial Differential Equations: Introduction , 2005 .

[46]  R. FitzHugh Theoretical Effect of Temperature on Threshold in the Hodgkin-Huxley Nerve Model , 1966, The Journal of general physiology.

[47]  Boris S. Gutkin,et al.  Multiple Bumps in a Neuronal Model of Working Memory , 2002, SIAM J. Appl. Math..

[48]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[49]  Marian Stamp Dawkins,et al.  The Noisy Brain: Stochastic Dynamics as a Principle of Brain Function The Noisy Brain: Stochastic Dynamics as a Principle of Brain Function. By Edmund T. Rolls & Gustavo Deco. Oxford: Oxford University Press (2010). Pp. 310. Price £37.95 hardback. , 2010, Animal Behaviour.

[50]  Olivier D. Faugeras,et al.  A Constructive Mean-Field Analysis of Multi-Population Neural Networks with Random Synaptic Weights and Stochastic Inputs , 2008, Front. Comput. Neurosci..

[51]  Ohira,et al.  Master-equation approach to stochastic neurodynamics. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[52]  M. Mattia,et al.  Population dynamics of interacting spiking neurons. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  G. Jumarie Solution of the multivariate Fokker-Planck equation by using a maximum path entropy principle , 1990 .

[54]  Cheng Ly,et al.  Critical Analysis of Dimension Reduction by a Moment Closure Method in a Population Density Approach to Neural Network Modeling , 2007, Neural Computation.

[55]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  Samuel Herrmann Julian Tugaut Non-uniqueness of stationary measures for self-stabilizing processes , 2009, 0903.2460.

[57]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[58]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.

[59]  S. A.,et al.  A Propagation of Chaos Result for Burgers ' Equation , 2022 .

[60]  A. Hammerstein Nichtlineare Integralgleichungen nebst Anwendungen , 1930 .

[61]  Denis Talay,et al.  A STOCHASTIC PARTICLE METHOD WITH RANDOM WEIGHTS FOR THE COMPUTATION OF STATISTICAL SOLUTIONS OF MCKEAN-VLASOV EQUATIONS , 2001 .

[62]  S. Yoshizawa,et al.  An Active Pulse Transmission Line Simulating Nerve Axon , 1962, Proceedings of the IRE.

[63]  J. Cowan,et al.  A mathematical theory of visual hallucination patterns , 1979, Biological Cybernetics.

[64]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[65]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[66]  T. Alderweireld,et al.  A Theory for the Term Structure of Interest Rates , 2004, cond-mat/0405293.

[67]  R. Dobrushin Prescribing a System of Random Variables by Conditional Distributions , 1970 .

[68]  S. Amari,et al.  Characteristics of Random Nets of Analog Neuron-Like Elements , 1972, IEEE Trans. Syst. Man Cybern..

[69]  M. Shelley,et al.  An effective kinetic representation of fluctuation-driven neuronal networks with application to simple and complex cells in visual cortex. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[70]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[71]  J. Touboul,et al.  Can Power-Law Scaling and Neuronal Avalanches Arise from Stochastic Dynamics? , 2009, PloS one.

[72]  M. Hp A class of markov processes associated with nonlinear parabolic equations. , 1966 .

[73]  Mireille Bossy,et al.  A stochastic particle method for the McKean-Vlasov and the Burgers equation , 1997, Math. Comput..

[74]  J. Cowan,et al.  Field-theoretic approach to fluctuation effects in neural networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[75]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[76]  Olivier D. Faugeras,et al.  Noise-Induced Behaviors in Neural Mean Field Dynamics , 2011, SIAM J. Appl. Dyn. Syst..