Statistical physics approaches to subnetwork dynamics in biochemical systems

We apply a Gaussian variational approximation to model reduction in large biochemical networks of unary and binary reactions. We focus on a small subset of variables (subnetwork) of interest, e.g. because they are accessible experimentally, embedded in a larger network (bulk). The key goal is to write dynamical equations reduced to the subnetwork but still retaining the effects of the bulk. As a result, the subnetwork-reduced dynamics contains a memory term and an extrinsic noise term with non-trivial temporal correlations. We first derive expressions for this memory and noise in the linearized (Gaussian) dynamics and then use a perturbative power expansion to obtain first order nonlinear corrections. For the case of vanishing intrinsic noise, our description is explicitly shown to be equivalent to projection methods up to quadratic terms, but it is applicable also in the presence of stochastic fluctuations in the original dynamics. An example from the epidermal growth factor receptor signalling pathway is provided to probe the increased prediction accuracy and computational efficiency of our method.

[1]  A J Chorin,et al.  Optimal prediction and the Mori-Zwanzig representation of irreversible processes. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Paul C. Martin,et al.  Statistical Dynamics of Classical Systems , 1973 .

[3]  Manfred Opper,et al.  Variational perturbation and extended Plefka approaches to dynamics on random networks: the case of the kinetic Ising model , 2016, 1607.08379.

[4]  A. Coolen,et al.  Generating functional analysis of complex formation and dissociation in large protein interaction networks , 2009, 0910.0143.

[5]  P. Swain,et al.  Intrinsic and extrinsic contributions to stochasticity in gene expression , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Michael P H Stumpf,et al.  Multivariate moment closure techniques for stochastic kinetic models. , 2015, The Journal of chemical physics.

[7]  D. Saad,et al.  Emergence of equilibriumlike domains within nonequilibrium Ising spin systems , 2013 .

[8]  Philipp Thomas,et al.  Rigorous elimination of fast stochastic variables from the linear noise approximation using projection operators. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  P. Swain,et al.  Stochastic Gene Expression in a Single Cell , 2002, Science.

[10]  J. Ohkubo A field theoretic approach to master equations and a variational method beyond the Poisson ansatz , 2007, 0708.3713.

[11]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[12]  Philipp Thomas,et al.  How accurate are the nonlinear chemical Fokker-Planck and chemical Langevin equations? , 2011, The Journal of chemical physics.

[13]  Manfred Opper,et al.  The Variational Gaussian Approximation Revisited , 2009, Neural Computation.

[14]  M. Doi Stochastic theory of diffusion-controlled reaction , 1976 .

[15]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[16]  Hannah H. Chang,et al.  Transcriptome-wide noise controls lineage choice in mammalian progenitor cells , 2008, Nature.

[17]  Peter Sollich,et al.  Michaelis-Menten dynamics in protein subnetworks. , 2016, The Journal of chemical physics.

[18]  N. G. van Kampen,et al.  Itô versus Stratonovich , 1981 .

[19]  Philipp Thomas,et al.  The slow-scale linear noise approximation: an accurate, reduced stochastic description of biochemical networks under timescale separation conditions , 2012, BMC Systems Biology.

[20]  Victor H Hernandez,et al.  Nature Methods , 2007 .

[21]  C. Dominicis Dynamics as a substitute for replicas in systems with quenched random impurities , 1978 .

[22]  J. Elf,et al.  Fast evaluation of fluctuations in biochemical networks with the linear noise approximation. , 2003, Genome research.

[23]  Alexandre J. Chorin,et al.  Optimal prediction with memory , 2002 .

[24]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[25]  Alexandre J. Chorin,et al.  Prediction from Partial Data, Renormalization, and Averaging , 2006, J. Sci. Comput..

[26]  Peter Sollich,et al.  Memory effects in biochemical networks as the natural counterpart of extrinsic noise. , 2014, Journal of theoretical biology.

[27]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[28]  J. Ackermann,et al.  Reduction techniques for network validation in systems biology. , 2012, Journal of theoretical biology.

[29]  R. Seger,et al.  The MAPK cascades: signaling components, nuclear roles and mechanisms of nuclear translocation. , 2011, Biochimica et biophysica acta.

[30]  Heinz Koeppl,et al.  Uncoupled Analysis of Stochastic Reaction Networks in Fluctuating Environments , 2014, PLoS Comput. Biol..

[31]  M. Mavrovouniotis,et al.  Simplification of Mathematical Models of Chemical Reaction Systems. , 1998, Chemical reviews.

[32]  Peter G Wolynes,et al.  Stochastic gene expression as a many-body problem , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Andreas Ruttor,et al.  Efficient statistical inference for stochastic reaction processes. , 2009, Physical review letters.

[34]  Tobias J. Hagge,et al.  Physics , 1929, Nature.

[35]  L. Peliti Path integral approach to birth-death processes on a lattice , 1985 .

[36]  Mauricio Barahona,et al.  Linear models of activation cascades: analytical solutions and coarse-graining of delayed signal transduction , 2011, Journal of The Royal Society Interface.

[37]  M. Apri,et al.  Complexity reduction preserving dynamical behavior of biochemical networks. , 2012, Journal of theoretical biology.

[38]  Guido Sanguinetti,et al.  Comparison of different moment-closure approximations for stochastic chemical kinetics. , 2015, The Journal of chemical physics.

[39]  Guido Sanguinetti,et al.  Validity conditions for moment closure approximations in stochastic chemical kinetics. , 2014, The Journal of chemical physics.

[40]  E. Gaffney,et al.  Fock space, symbolic algebra, and analytical solutions for small stochastic systems. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  Barbara Bravi,et al.  Path integral approaches to subnetwork description and inference , 2016 .

[42]  Alexander N Gorban,et al.  Reduction of dynamical biochemical reactions networks in computational biology , 2012, Front. Gene..

[43]  G. Eyink,et al.  Action principle in nonequilibrium statistical dynamics. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[44]  Peter Sollich,et al.  Glassy dynamics of kinetically constrained models , 2002, cond-mat/0210382.

[45]  M. Doi Second quantization representation for classical many-particle system , 1976 .

[46]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[47]  Philipp Thomas,et al.  System size expansion using Feynman rules and diagrams , 2014, 1409.1439.

[48]  Ramon Grima,et al.  A study of the accuracy of moment-closure approximations for stochastic chemical kinetics. , 2012, The Journal of chemical physics.

[49]  Robert Zwanzig,et al.  Memory Effects in Irreversible Thermodynamics , 1961 .

[50]  C. Gardiner Handbook of Stochastic Methods , 1983 .

[51]  Julien F. Ollivier,et al.  Colored extrinsic fluctuations and stochastic gene expression , 2008, Molecular systems biology.

[52]  Riccardo Zecchina,et al.  Modelling Competing Endogenous RNA Networks , 2013, PloS one.

[53]  Noah A. Smith,et al.  Proceedings of NIPS , 2010, NIPS 2010.

[54]  Ilya Nemenman,et al.  Adiabatic coarse-graining and simulations of stochastic biochemical networks , 2009, Proceedings of the National Academy of Sciences.

[55]  A. J. Clifford,et al.  BIOCHIMICA ET BIOPHYSICA ACTA , 2022 .

[56]  H. Janssen,et al.  On a Lagrangean for classical field dynamics and renormalization group calculations of dynamical critical properties , 1976 .

[57]  M. Peter,et al.  Scalable inference of heterogeneous reaction kinetics from pooled single-cell recordings , 2013, Nature Methods.

[58]  B. Kholodenko,et al.  Quantification of Short Term Signaling by the Epidermal Growth Factor Receptor* , 1999, The Journal of Biological Chemistry.

[59]  L. Christophorou Science , 2018, Emerging Dynamics: Science, Energy, Society and Values.