Long-time analytic approximation of large stochastic oscillators: Simulation, analysis and inference

In order to analyse large complex stochastic dynamical models such as those studied in systems biology there is currently a great need for both analytical tools and also algorithms for accurate and fast simulation and estimation. We present a new stochastic approximation of biological oscillators that addresses these needs. Our method, called phase-corrected LNA (pcLNA) overcomes the main limitations of the standard Linear Noise Approximation (LNA) to remain uniformly accurate for long times, still maintaining the speed and analytically tractability of the LNA. As part of this, we develop analytical expressions for key probability distributions and associated quantities, such as the Fisher Information Matrix and Kullback-Leibler divergence and we introduce a new approach to system-global sensitivity analysis. We also present algorithms for statistical inference and for long-term simulation of oscillating systems that are shown to be as accurate but much faster than leaping algorithms and algorithms for integration of diffusion equations. Stochastic versions of published models of the circadian clock and NF-κB system are used to illustrate our results.

[1]  Stefano M. Iacus,et al.  Simulation and Inference for Stochastic Differential Equations: With R Examples , 2008 .

[2]  T. Kurtz.  Approximation of Population Processes , 1987 .

[3]  K. H. Lee,et al.  The statistical mechanics of complex signaling networks: nerve growth factor signaling , 2004, Physical biology.

[4]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[5]  K. S. Brown,et al.  Sloppy-model universality class and the Vandermonde matrix. , 2006, Physical review letters.

[6]  David F Anderson,et al.  Comparison of finite difference based methods to obtain sensitivities of stochastic chemical kinetic models. , 2013, The Journal of chemical physics.

[7]  J. Greene,et al.  The calculation of Lyapunov spectra , 1987 .

[8]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[9]  D. Gillespie.  The chemical Langevin equation , 2000 .

[10]  A. Goldbeter,et al.  A Model for Circadian Rhythms in Drosophila Incorporating the Formation of a Complex between the PER and TIM Proteins , 1998, Journal of biological rhythms.

[11]  D. Sherrington.  Stochastic Processes in Physics and Chemistry , 1983 .

[12]  Siglas de Palabras.  a. J. C. , 2013 .

[13]  Takao Ohta,et al.  Irreversible Circulation and Orbital Revolution Hard Mode Instability in Far-from-Equilibrium Situation , 1974 .

[14]  M. Khammash,et al.  Noise Induces the Population-Level Entrainment of Incoherent, Uncoupled Intracellular Oscillators. , 2016, Cell systems.

[15]  J. Guckenheimer,et al.  Isochrons and phaseless sets , 1975, Journal of mathematical biology.

[16]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[17]  F. Hayot,et al.  The linear noise approximation for molecular fluctuations within cells , 2004, Physical biology.

[18]  B. Ingalls,et al.  Estimations of intrinsic and extrinsic noise in models of nonlinear genetic networks. , 2006, Chaos.

[19]  D. Rand,et al.  Uncovering the design principles of circadian clocks: mathematical analysis of flexibility and evolutionary goals. , 2006, Journal of theoretical biology.

[20]  David F. Anderson,et al.  Continuous Time Markov Chain Models for Chemical Reaction Networks , 2011 .

[21]  P. Hartman.  Ordinary Differential Equations , 1965 .

[22]  Michael P H Stumpf,et al.  Sensitivity, robustness, and identifiability in stochastic chemical kinetics models , 2011, Proceedings of the National Academy of Sciences.

[23]  Kenko Uchida,et al.  Formulas for intrinsic noise evaluation in oscillatory genetic networks. , 2010, Journal of theoretical biology.

[24]  David A. Rand,et al.  Quantifying intrinsic and extrinsic noise in gene transcription using the linear noise approximation: An application to single cell data , 2013, 1401.1640.

[25]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[26]  B. Lindner,et al.  Asymptotic phase for stochastic oscillators. , 2014, Physical review letters.

[27]  D A Rand,et al.  Design principles underlying circadian clocks , 2004, Journal of The Royal Society Interface.

[28]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[29]  Linda R. Petzold,et al.  Improved leap-size selection for accelerated stochastic simulation , 2003 .

[30]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[31]  K. S. Brown,et al.  Statistical mechanical approaches to models with many poorly known parameters. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  David F. Anderson,et al.  An Efficient Finite Difference Method for Parameter Sensitivities of Continuous Time Markov Chains , 2011, SIAM J. Numer. Anal..

[33]  A. Pikovsky,et al.  Phase description of stochastic oscillations. , 2013, Physical review letters.

[34]  Richard P Boland,et al.  How limit cycles and quasi-cycles are related in systems with intrinsic noise , 2008, 0805.1607.

[35]  Davit A Potoyan,et al.  On the dephasing of genetic oscillators , 2013, Proceedings of the National Academy of Sciences.

[36]  D A Rand,et al.  Mapping global sensitivity of cellular network dynamics: sensitivity heat maps and a global summation law , 2008, Journal of The Royal Society Interface.

[37]  Darren J. Wilkinson.  Stochastic Modelling for Systems Biology , 2006 .

[38]  D. S. Broomhead,et al.  Pulsatile Stimulation Determines Timing and Specificity of NF-κB-Dependent Transcription , 2009, Science.

[39]  José Halloy,et al.  Stochastic models for circadian rhythms: effect of molecular noise on periodic and chaotic behaviour. , 2003, Comptes rendus biologies.

[40]  T. Kurtz.  Limit theorems for sequences of jump Markov processes approximating ordinary differential processes , 1971, Journal of Applied Probability.

[41]  D. Gillespie.  Approximate accelerated stochastic simulation of chemically reacting systems , 2001 .

[42]  H Koeppl,et al.  Deterministic characterization of phase noise in biomolecular oscillators , 2011, Physical biology.

[43]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.