Learning dynamic Boltzmann distributions as reduced models of spatial chemical kinetics.

Finding reduced models of spatially distributed chemical reaction networks requires an estimation of which effective dynamics are relevant. We propose a machine learning approach to this coarse graining problem, where a maximum entropy approximation is constructed that evolves slowly in time. The dynamical model governing the approximation is expressed as a functional, allowing a general treatment of spatial interactions. In contrast to typical machine learning approaches which estimate the interaction parameters of a graphical model, we derive Boltzmann-machine like learning algorithms to estimate directly the functionals dictating the time evolution of these parameters. By incorporating analytic solutions from simple reaction motifs, an efficient simulation method is demonstrated for systems ranging from toy problems to basic biologically relevant networks. The broadly applicable nature of our approach to learning spatial dynamics suggests promising applications to multiscale methods for spatial networks, as well as to further problems in machine learning.

[1]  Yiannis N. Kaznessis,et al.  A closure scheme for chemical master equations , 2013, Proceedings of the National Academy of Sciences.

[2]  M. Golumbic Annals of Mathematics and Artificial Intelligence , 2002, Annals of Mathematics and Artificial Intelligence.

[3]  J. Kirkwood,et al.  The Statistical Mechanical Theory of Transport Processes II. Transport in Gases , 1947 .

[4]  L. Onsager Crystal statistics. I. A two-dimensional model with an order-disorder transition , 1944 .

[5]  Eric Mjolsness,et al.  Stochastic process semantics for dynamical grammars , 2006, Annals of Mathematics and Artificial Intelligence.

[6]  Solving the 3D Ising Model with the Conformal Bootstrap , 2012, 1203.6064.

[7]  J. Kirkwood The Statistical Mechanical Theory of Transport Processes I. General Theory , 1946 .

[8]  D. Mattis,et al.  The uses of quantum field theory in diffusion-limited reactions , 1998 .

[9]  M. Doi Stochastic theory of diffusion-controlled reaction , 1976 .

[10]  K. McNeil,et al.  Correlations in stochastic theories of chemical reactions , 1976 .

[11]  Eric Mjolsness,et al.  Mathematics of small stochastic reaction networks: a boundary layer theory for eigenstate analysis. , 2013, The Journal of chemical physics.

[12]  Michael F. Singer,et al.  Formal Solutions of Differential Equations , 1990, J. Symb. Comput..

[13]  Erik De Schutter,et al.  Monte Carlo Methods for Simulating Realistic Synaptic Microphysiology Using MCell , 2000 .

[14]  Scott B. Baden,et al.  Fast Monte Carlo Simulation Methods for Biological Reaction-Diffusion Systems in Solution and on Surfaces , 2008, SIAM J. Sci. Comput..

[15]  L. Peliti Path integral approach to birth-death processes on a lattice , 1985 .

[16]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[17]  Marc Barthelemy,et al.  Spatial Networks , 2010, Encyclopedia of Social Network Analysis and Mining.

[18]  Tretyakov,et al.  Extinction, survival, and dynamical phase transition of branching annihilating random walk. , 1992, Physical review letters.

[19]  T. Sejnowski,et al.  Computational reconstitution of spine calcium transients from individual proteins , 2015, Front. Synaptic Neurosci..

[20]  Niles A. Pierce,et al.  An Introduction to the Adjoint Approach to Design , 2000 .

[21]  William L. Jorgensen,et al.  Journal of Chemical Information and Modeling , 2005, J. Chem. Inf. Model..

[22]  Cardy,et al.  Theory of Branching and Annihilating Random Walks. , 1996, Physical review letters.

[23]  David Basanta,et al.  Mean-field approach to evolving spatial networks, with an application to osteocyte network formation. , 2017, Physical review. E.

[24]  Eric Mjolsness,et al.  Towards Measurable Types for Dynamical Process Modeling Languages , 2010, MFPS.

[25]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[26]  Andreas Hellander,et al.  Perspective: Stochastic algorithms for chemical kinetics. , 2013, The Journal of chemical physics.

[27]  M. Doi Second quantization representation for classical many-particle system , 1976 .

[28]  Javier DeFelipe,et al.  A Machine Learning Method for the Prediction of Receptor Activation in the Simulation of Synapses , 2013, PloS one.

[29]  J. Herskowitz,et al.  Proceedings of the National Academy of Sciences, USA , 1996, Current Biology.

[30]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[31]  P. Lancaster On eigenvalues of matrices dependent on a parameter , 1964 .

[32]  Pierre Baldi,et al.  Learning to Predict Chemical Reactions , 2011, J. Chem. Inf. Model..

[33]  R. Durrett,et al.  The Importance of Being Discrete (and Spatial) , 1994 .

[34]  Eric Mjolsness,et al.  Time-ordered product expansions for computational stochastic system biology , 2012, Physical biology.

[35]  Eric Mjolsness,et al.  Model reduction for stochastic CaMKII reaction kinetics in synapses by graph-constrained correlation dynamics. , 2015, Physical biology.