A Constructive Mean-Field Analysis of Multi-Population Neural Networks with Random Synaptic Weights and Stochastic Inputs

We deal with the problem of bridging the gap between two scales in neuronal modeling. At the first (microscopic) scale, neurons are considered individually and their behavior described by stochastic differential equations that govern the time variations of their membrane potentials. They are coupled by synaptic connections acting on their resulting activity, a nonlinear function of their membrane potential. At the second (mesoscopic) scale, interacting populations of neurons are described individually by similar equations. The equations describing the dynamical and the stationary mean-field behaviors are considered as functional equations on a set of stochastic processes. Using this new point of view allows us to prove that these equations are well-posed on any finite time interval and to provide a constructive method for effectively computing their unique solution. This method is proved to converge to the unique solution and we characterize its complexity and convergence rate. We also provide partial results for the stationary problem on infinite time intervals. These results shed some new light on such neural mass models as the one of Jansen and Rit (1995): their dynamics appears as a coarse approximation of the much richer dynamics that emerges from our analysis. Our numerical experiments confirm that the framework we propose and the numerical methods we derive from it provide a new and powerful tool for the exploration of neural behaviors at different scales.

[1]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[2]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[3]  Schuster,et al.  Suppressing chaos in neural networks by noise. , 1992, Physical review letters.

[4]  M. Samuelides,et al.  Random recurrent neural networks dynamics , 2006, math-ph/0612022.

[5]  Serafim Rodrigues,et al.  A comparative analysis of a firing-rate model and a conductance-based neural population model , 2007 .

[6]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[7]  W. Grassman Approximation and Weak Convergence Methods for Random Processes with Applications to Stochastic Systems Theory (Harold J. Kushner) , 1986 .

[8]  Xiongzhi Chen Brownian Motion and Stochastic Calculus , 2008 .

[9]  V. Bogachev Gaussian Measures on a , 2022 .

[10]  G. B. Arous,et al.  Large deviations for Langevin spin glass dynamics , 1995 .

[11]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[12]  G. B. Arous,et al.  Large deviations for Langevin spin glass dynamics , 1995 .

[13]  Harold J. Kushner,et al.  Approximation and Weak Convergence Methods for Random Processes , 1984 .

[14]  Prof. Dr. Dr. Valentino Braitenberg,et al.  Cortex: Statistics and Geometry of Neuronal Connectivity , 1998, Springer Berlin Heidelberg.

[15]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[16]  S. Amari,et al.  Characteristics of Random Nets of Analog Neuron-Like Elements , 1972, IEEE Trans. Syst. Man Cybern..

[17]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[18]  S. Amari,et al.  A Mathematical Foundation for Statistical Neurodynamics , 1977 .

[19]  Bruno Cessac,et al.  On Dynamics of Integrate-and-Fire Neural Networks with Conductance Based Synapses , 2007, Frontiers Comput. Neurosci..

[20]  G. B. Arous,et al.  Symmetric Langevin spin glass dynamics , 1997 .

[21]  Ben H. Jansen,et al.  Electroencephalogram and visual evoked potential generation in a mathematical model of coupled cortical columns , 1995, Biological Cybernetics.

[22]  M. Samuelides,et al.  Large deviations and mean-field theory for asymmetric random recurrent neural networks , 2002 .

[23]  A. J. Hermans,et al.  A model of the spatial-temporal characteristics of the alpha rhythm. , 1982, Bulletin of mathematical biology.

[24]  A. Houghton,et al.  Role of initial conditions in the mean-field theory of spin-glass dynamics , 1983 .

[25]  Olivier D. Faugeras,et al.  Bifurcation Analysis of Jansen's Neural Mass Model , 2006, Neural Computation.

[26]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[27]  Lyle J. Graham,et al.  Population model of hippocampal pyramidal neurons, linking a refractory density approach to conductance-based neurons. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Bruno Cessac,et al.  On Dynamics of Integrate-and-Fire Neural Networks with Adaptive Conductances , 2007 .

[29]  Abbott,et al.  Asynchronous states in networks of pulse-coupled oscillators. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[30]  J. Bellanger,et al.  Interictal to Ictal Transition in Human Temporal Lobe Epilepsy: Insights From a Computational Model of Intracerebral EEG , 2005, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[31]  H. Sompolinsky,et al.  Relaxational dynamics of the Edwards-Anderson model and the mean-field theory of spin-glasses , 1982 .

[32]  A. Guionnet Averaged and quenched propagation of chaos for spin glass dynamics , 1997 .

[33]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[34]  R. Jindra Mass action in the nervous system W. J. Freeman, Academic Press, New York (1975), 489 pp., (hard covers). $34.50 , 1976, Neuroscience.

[35]  B. Cessac A discrete time neural network model with spiking neurons , 2007, Journal of mathematical biology.

[36]  L. Garey Cortex: Statistics and Geometry of Neuronal Connectivity, 2nd edn. By V. BRAITENBERG and A. SCHÜZ. (Pp. xiii+249; 90 figures; ISBN 3 540 63816 4). Berlin: Springer. 1998. , 1999 .

[37]  B. Cessac Increase in Complexity in Random Neural Networks , 1995 .

[38]  A. Treves Mean-field analysis of neuronal spike dynamics , 1993 .

[39]  Sompolinsky,et al.  Dynamics of spin systems with randomly asymmetric bonds: Ising spins and Glauber dynamics. , 1988, Physical review. A, General physics.

[40]  Donald O. Walter,et al.  Mass action in the nervous system , 1975 .

[41]  M. Mattia,et al.  Population dynamics of interacting spiking neurons. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  Sompolinsky,et al.  Dynamics of spin systems with randomly asymmetric bonds: Langevin dynamics and a spherical model. , 1987, Physical review. A, General physics.