Modeling delay in genetic networks: from delay birth-death processes to delay stochastic differential equations.

Delay is an important and ubiquitous aspect of many biochemical processes. For example, delay plays a central role in the dynamics of genetic regulatory networks as it stems from the sequential assembly of first mRNA and then protein. Genetic regulatory networks are therefore frequently modeled as stochastic birth-death processes with delay. Here, we examine the relationship between delay birth-death processes and their appropriate approximating delay chemical Langevin equations. We prove a quantitative bound on the error between the pathwise realizations of these two processes. Our results hold for both fixed delay and distributed delay. Simulations demonstrate that the delay chemical Langevin approximation is accurate even at moderate system sizes. It captures dynamical features such as the oscillatory behavior in negative feedback circuits, cross-correlations between nodes in a network, and spatial and temporal information in two commonly studied motifs of metastability in biochemical systems. Overall, these results provide a foundation for using delay stochastic differential equations to approximate the dynamics of birth-death processes with delay.

[1]  P. R. ten Wolde,et al.  Chemical models of genetic toggle switches. , 2004, The journal of physical chemistry. B.

[2]  Petros Koumoutsakos,et al.  D-leaping: Accelerating stochastic simulation algorithms for reactions with delays , 2009, J. Comput. Phys..

[3]  Per Lötstedt,et al.  Costs and constraints from time-delayed feedback in small gene regulatory motifs , 2010, Proceedings of the National Academy of Sciences.

[4]  Xiaodong Cai,et al.  K-leap method for accelerating stochastic simulation of coupled chemical reactions. , 2007, The Journal of chemical physics.

[5]  Matthew Scott Long delay times in reaction rates increase intrinsic fluctuations. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Amnon Amir,et al.  Damped oscillations in the adaptive response of the iron homeostasis network of E. coli , 2010, Molecular microbiology.

[7]  M. Gopinathan,et al.  A two variable delay model for the circadian rhythm of Neurospora crassa. , 2004, Journal of theoretical biology.

[8]  Kevin Burrage,et al.  Preface: Special issue on evolutionary problems , 2007 .

[9]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[10]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[11]  N. Kampen,et al.  a Power Series Expansion of the Master Equation , 1961 .

[12]  Peter Imkeller,et al.  Noise-Induced Resonance in Bistable Systems Caused by Delay Feedback , 2006 .

[13]  J. W.,et al.  The Journal of Physical Chemistry , 1900, Nature.

[14]  J. Collins,et al.  Construction of a genetic toggle switch in Escherichia coli , 2000, Nature.

[15]  Rikuhiro G. Yamada,et al.  Delay in Feedback Repression by Cryptochrome 1 Is Required for Circadian Clock Function , 2011, Cell.

[16]  Peter Imkeller,et al.  A two state model for noise-induced resonance in bistable systems with delay , 2005 .

[17]  B. Goodwin Oscillatory behavior in enzymatic control processes. , 1965, Advances in enzyme regulation.

[18]  S. Lowen The Biophysical Journal , 1960, Nature.

[19]  Tobias Galla,et al.  Intrinsic fluctuations in stochastic delay systems: theoretical description and application to a simple model of gene regulation. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  H. Kushner Robustness and Approximation of Escape Times and Large Deviations Estimates for Systems with Small Noise Effects , 1984 .

[21]  I. Ial,et al.  Nature Communications , 2010, Nature Cell Biology.

[22]  Khachik Sargsyan,et al.  Extinction Times for Birth-Death Processes: Exact Results, Continuum Asymptotics, and the Failure of the Fokker-Planck Approximation , 2004, Multiscale Model. Simul..

[23]  Linda R Petzold,et al.  Adaptive explicit-implicit tau-leaping method with automatic tau selection. , 2007, The Journal of chemical physics.

[24]  E. Kandel,et al.  Proceedings of the National Academy of Sciences of the United States of America. Annual subject and author indexes. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Somdatta Sinha,et al.  Delay-Induced Transient Increase and Heterogeneity in Gene Expression in Negatively Auto-Regulated Gene Circuits , 2008, PloS one.

[26]  D. Gillespie Approximate accelerated stochastic simulation of chemically reacting systems , 2001 .

[27]  Ertugrul M. Ozbudak,et al.  Multistability in the lactose utilization network of Escherichia coli , 2004, Nature.

[28]  N. Monk Oscillatory Expression of Hes1, p53, and NF-κB Driven by Transcriptional Time Delays , 2003, Current Biology.

[29]  John J. Tyson,et al.  A simple theoretical framework for understanding heterogeneous differentiation of CD4+ T cells , 2012, BMC Systems Biology.

[30]  Per Lötstedt,et al.  Delay-induced anomalous fluctuations in intracellular regulation. , 2011, Nature communications.

[31]  John J Tyson,et al.  System-level feedbacks make the anaphase switch irreversible , 2011, Proceedings of the National Academy of Sciences.

[32]  Ira B Schwartz,et al.  Noise-induced switching and extinction in systems with delay. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  K. Burrage,et al.  Stochastic delay differential equations for genetic regulatory networks , 2007 .

[34]  HighWire Press,et al.  American journal of physiology. Cell physiology , 1977 .

[35]  Linda R Petzold,et al.  Efficient step size selection for the tau-leaping simulation method. , 2006, The Journal of chemical physics.

[36]  J. Rawlings,et al.  Approximate simulation of coupled fast and slow reactions for stochastic chemical kinetics , 2002 .

[37]  Y. Lai,et al.  Engineering of regulated stochastic cell fate determination , 2013, Proceedings of the National Academy of Sciences.

[38]  Michael A. Gibson,et al.  Efficient Exact Stochastic Simulation of Chemical Systems with Many Species and Many Channels , 2000 .

[39]  L F Lafuerza,et al.  Role of delay in the stochastic creation process. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Katunori Suzuki,et al.  In: Advances in enzyme regulation , 1988 .

[41]  E. Hill Journal of Theoretical Biology , 1961, Nature.

[42]  S. Leibler,et al.  Bacterial Persistence as a Phenotypic Switch , 2004, Science.

[43]  Xiaodong Cai,et al.  Unbiased tau-leap methods for stochastic simulation of chemically reacting systems. , 2008, The Journal of chemical physics.

[44]  M. Manhart,et al.  Markov Processes , 2018, Introduction to Stochastic Processes and Simulation.

[45]  Journal of Chemical Physics , 1932, Nature.

[46]  Gábor Balázsi,et al.  Mapping the Environmental Fitness Landscape of a Synthetic Gene Circuit , 2012, PLoS Comput. Biol..

[47]  J. Stelling,et al.  A tunable synthetic mammalian oscillator , 2009, Nature.

[48]  Julian Lewis Autoinhibition with Transcriptional Delay A Simple Mechanism for the Zebrafish Somitogenesis Oscillator , 2003, Current Biology.

[49]  Andreas Hellander,et al.  Perspective: Stochastic algorithms for chemical kinetics. , 2013, The Journal of chemical physics.

[50]  T. Kepler,et al.  Stochasticity in transcriptional regulation: origins, consequences, and mathematical representations. , 2001, Biophysical journal.

[51]  D. Gillespie The chemical Langevin equation , 2000 .

[52]  Vassilios Sotiropoulos,et al.  Multiscale Hy3S: Hybrid stochastic simulation for supercomputers , 2006, BMC Bioinformatics.

[53]  Paul Smolen,et al.  Effects of macromolecular transport and stochastic fluctuations on dynamics of genetic regulatory systems. , 1999, American journal of physiology. Cell physiology.

[54]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[55]  M. Bennett,et al.  A fast, robust, and tunable synthetic gene oscillator , 2008, Nature.

[56]  D. Volfson,et al.  Delay-induced stochastic oscillations in gene regulation. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Peter Hänggi,et al.  Bistable systems: Master equation versus Fokker-Planck modeling , 1984 .

[58]  L. Tsimring,et al.  Noise-induced dynamics in bistable systems with delay. , 2001, Physical review letters.

[59]  Current Biology , 2012, Current Biology.

[60]  C Masoller Distribution of residence times of time-delayed bistable systems driven by noise. , 2003, Physical review letters.

[61]  Krešimir Josić,et al.  Transcriptional delay stabilizes bistable gene networks. , 2013, Physical review letters.

[62]  O. Bagasra,et al.  Proceedings of the National Academy of Sciences , 1914, Science.

[63]  Jeff Hasty,et al.  Delay-induced degrade-and-fire oscillations in small genetic circuits. , 2009, Physical review letters.

[64]  Desmond J. Higham,et al.  Modeling and Simulating Chemical Reactions , 2008, SIAM Rev..

[65]  D. A. Baxter,et al.  A reduced model clarifies the role of feedback loops and time delays in the Drosophila circadian oscillator. , 2002, Biophysical journal.

[66]  Tobias Galla,et al.  Stochastic processes with distributed delays: chemical Langevin equation and linear-noise approximation. , 2013, Physical review letters.

[67]  Wen Lea Pearn,et al.  (Journal of Computational and Applied Mathematics,228(1):274-278)Optimization of the T Policy M/G/1 Queue with Server Breakdowns and General Startup Times , 2009 .

[68]  Tianhai Tian,et al.  Oscillatory Regulation of Hes1: Discrete Stochastic Delay Modelling and Simulation , 2006, PLoS Comput. Biol..

[69]  Yiannis Kaznessis,et al.  Accurate hybrid stochastic simulation of a system of coupled chemical or biochemical reactions. , 2005, The Journal of chemical physics.

[70]  K. Sneppen,et al.  Epigenetics as a first exit problem. , 2001, Physical review letters.

[71]  R. Schlicht,et al.  A delay stochastic process with applications in molecular biology , 2008, Journal of mathematical biology.

[72]  LieJune Shiau,et al.  Stochastic Delay Accelerates Signaling in Gene Networks , 2011, PLoS Comput. Biol..