Extended Plefka expansion for stochastic dynamics

We propose an extension of the Plefka expansion, which is well known for the dynamics of discrete spins, to stochastic differential equations with continuous degrees of freedom and exhibiting generic nonlinearities. The scenario is sufficiently general to allow application to e.g. biochemical networks involved in metabolism and regulation. The main feature of our approach is to constrain in the Plefka expansion not just first moments akin to magnetizations, but also second moments, specifically two-time correlations and responses for each degree of freedom. The end result is an effective equation of motion for each single degree of freedom, where couplings to other variables appear as a self-coupling to the past (i.e. memory term) and a coloured noise. This constitutes a new mean field approximation that should become exact in the thermodynamic limit of a large network, for suitably long-ranged couplings. For the analytically tractable case of linear dynamics we establish this exactness explicitly by appeal to spectral methods of Random Matrix Theory, for Gaussian couplings with arbitrary degree of symmetry.

[1]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[2]  R. Palmer,et al.  Solution of 'Solvable model of a spin glass' , 1977 .

[3]  Sommers,et al.  Spectrum of large random asymmetric matrices. , 1988, Physical review letters.

[4]  A.C.C. Coolen,et al.  Chapter 15 Statistical mechanics of recurrent neural networks II — Dynamics , 2000, cond-mat/0006011.

[5]  Paul C. Martin,et al.  Statistical Dynamics of Classical Systems , 1973 .

[6]  David S. Dean,et al.  FULL DYNAMICAL SOLUTION FOR A SPHERICAL SPIN-GLASS MODEL , 1995 .

[7]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[8]  T. Plefka Convergence condition of the TAP equation for the infinite-ranged Ising spin glass model , 1982 .

[9]  Peter Sollich,et al.  Inference for dynamics of continuous variables: the extended Plefka expansion with hidden nodes , 2016, 1603.05538.

[10]  Manfred Opper,et al.  Variational perturbation and extended Plefka approaches to dynamics on random networks: the case of the kinetic Ising model , 2016, 1607.08379.

[11]  H. Westerhoff,et al.  Non-equilibrium thermodynamics of light absorption , 1999 .

[12]  M. Mavrovouniotis,et al.  Simplification of Mathematical Models of Chemical Reaction Systems. , 1998, Chemical reviews.

[13]  Ole Winther,et al.  Expectation Consistent Approximate Inference , 2005, J. Mach. Learn. Res..

[14]  G. Biroli Dynamical TAP approach to mean field glassy systems , 1999, cond-mat/9909415.

[15]  A. Coolen Statistical Mechanics of Recurrent Neural Networks I. Statics , 2000, cond-mat/0006010.

[16]  Yasser Roudi,et al.  Dynamical TAP equations for non-equilibrium Ising spin glasses , 2011, 1103.1044.

[17]  H. Sompolinsky,et al.  Relaxational dynamics of the Edwards-Anderson model and the mean-field theory of spin-glasses , 1982 .

[18]  M. Apri,et al.  Complexity reduction preserving dynamical behavior of biochemical networks. , 2012, Journal of theoretical biology.

[19]  Sompolinsky,et al.  Dynamics of spin systems with randomly asymmetric bonds: Langevin dynamics and a spherical model. , 1987, Physical review. A, General physics.

[20]  Opper,et al.  Mean-field Monte Carlo approach to the Sherrington-Kirkpatrick model with asymmetric couplings. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[21]  Vipul Periwal,et al.  System Modeling in Cellular Biology: From Concepts to Nuts and Bolts , 2006 .

[22]  Rainer Breitling,et al.  Dynamic Modelling under Uncertainty: The Case of Trypanosoma brucei Energy Metabolism , 2012, PLoS Comput. Biol..

[23]  S. Kirkpatrick,et al.  Solvable Model of a Spin-Glass , 1975 .

[24]  H. Callen,et al.  Irreversibility and Generalized Noise , 1951 .

[25]  C. Dominicis Dynamics as a substitute for replicas in systems with quenched random impurities , 1978 .

[26]  J. Ginibre Statistical Ensembles of Complex, Quaternion, and Real Matrices , 1965 .

[27]  H. Janssen,et al.  On a Lagrangean for classical field dynamics and renormalization group calculations of dynamical critical properties , 1976 .

[28]  Gregory Falkovich,et al.  Fluctuation relations in simple examples of non-equilibrium steady states , 2008, 0806.1875.

[29]  B. Mehlig,et al.  Statistical properties of eigenvectors in non-Hermitian Gaussian random matrix ensembles , 2000 .