Modeling stochastic noise in gene regulatory systems

AbstractThe Master equation is considered the gold standard for modeling the stochastic mechanisms of gene regulation in molecular detail, but it is too complex to solve exactly in most cases, so approximation and simulation methods are essential. However, there is still a lack of consensus about the best way to carry these out. To help clarify the situation, we review Master equation models of gene regulation, theoretical approximations based on an expansion method due to N.G. van Kampen and R. Kubo, and simulation algorithms due to D.T. Gillespie and P. Langevin. Expansion of the Master equation shows that for systems with a single stable steady-state, the stochastic model reduces to a deterministic model in a first-order approximation. Additional theory, also due to van Kampen, describes the asymptotic behavior of multistable systems. To support and illustrate the theory and provide further insight into the complex behavior of multistable systems, we perform a detailed simulation study comparing the various approximation and simulation methods applied to synthetic gene regulatory systems with various qualitative characteristics. The simulation studies show that for large stochastic systems with a single steady-state, deterministic models are quite accurate, since the probability distribution of the solution has a single peak tracking the deterministic trajectory whose variance is inversely proportional to the system size. In multistable stochastic systems, large fluctuations can cause individual trajectories to escape from the domain of attraction of one steady-state and be attracted to another, so the system eventually reaches a multimodal probability distribution in which all stable steadystates are represented proportional to their relative stability. However, since the escape time scales exponentially with system size, this process can take a very long time in large systems.

[1]  L. Rayleigh,et al.  LIII. Dynamical problems in illustration of the theory of gases , 1891 .

[2]  C. J. Burden,et al.  A solver for the stochastic master equation applied to gene regulatory networks , 2007 .

[3]  Jeff Hasty,et al.  Engineered gene circuits , 2002, Nature.

[4]  P. Swain,et al.  Gene Regulation at the Single-Cell Level , 2005, Science.

[5]  T. Elston,et al.  Stochasticity in gene expression: from theories to phenotypes , 2005, Nature Reviews Genetics.

[6]  K. Burrage,et al.  Stochastic chemical kinetics and the total quasi-steady-state assumption: application to the stochastic simulation algorithm and chemical master equation. , 2008, The Journal of chemical physics.

[7]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[8]  T. Misteli,et al.  Transcription dynamics. , 2009, Molecular cell.

[9]  Ertugrul M. Ozbudak,et al.  Multistability in the lactose utilization network of Escherichia coli , 2004, Nature.

[10]  M. Elowitz,et al.  A synthetic oscillatory network of transcriptional regulators , 2000, Nature.

[11]  Gürol M. Süel,et al.  Biological role of noise encoded in a genetic network motif , 2010, Proceedings of the National Academy of Sciences.

[12]  R. Kubo,et al.  Fluctuation and relaxation of macrovariables , 1973 .

[13]  F. Eisenhaber,et al.  pkaPS: prediction of protein kinase A phosphorylation sites with the simplified kinase-substrate binding model , 2007, Biology Direct.

[14]  D. di Bernardo,et al.  How to infer gene networks from expression profiles , 2007, Molecular systems biology.

[15]  M. Thattai,et al.  Intrinsic noise in gene regulatory networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[16]  M. Smoluchowski Zur kinetischen Theorie der Brownschen Molekularbewegung und der Suspensionen , 1906 .

[17]  David A. Rand,et al.  Bayesian inference of biochemical kinetic parameters using the linear noise approximation , 2009, BMC Bioinformatics.

[18]  Jie Liang,et al.  Computational Cellular Dynamics Based on the Chemical Master Equation: A Challenge for Understanding Complexity , 2010, Journal of Computer Science and Technology.

[19]  Brian Munsky,et al.  Reduction and solution of the chemical master equation using time scale separation and finite state projection. , 2006, The Journal of chemical physics.

[20]  Ertugrul M. Ozbudak,et al.  Regulation of noise in the expression of a single gene , 2002, Nature Genetics.

[21]  P. Swain,et al.  Stochastic Gene Expression in a Single Cell , 2002, Science.

[22]  J. Collins,et al.  Large-Scale Mapping and Validation of Escherichia coli Transcriptional Regulation from a Compendium of Expression Profiles , 2007, PLoS biology.

[23]  C. Rao,et al.  Stochastic chemical kinetics and the quasi-steady-state assumption: Application to the Gillespie algorithm , 2003 .

[24]  J. A. Walker,et al.  Dynamical Systems and Evolution Equations , 1980 .

[25]  George Weiss,et al.  Fluctuation Phenomena in Solids , 1965 .

[26]  Terence Hwa,et al.  Transcriptional regulation by the numbers: models. , 2005, Current opinion in genetics & development.

[27]  Patrick Smadbeck,et al.  Stochastic model reduction using a modified Hill-type kinetic rate law. , 2012, The Journal of chemical physics.

[28]  T. Kepler,et al.  Stochasticity in transcriptional regulation: origins, consequences, and mathematical representations. , 2001, Biophysical journal.

[29]  Hana El-Samad,et al.  Cellular noise regulons underlie fluctuations in Saccharomyces cerevisiae. , 2012, Molecular cell.

[30]  A. Einstein Eine neue Bestimmung der Moleküldimensionen , 1905 .

[31]  P. Swain,et al.  Intrinsic and extrinsic contributions to stochasticity in gene expression , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[32]  A. Arkin,et al.  Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells. , 1998, Genetics.

[33]  J. Collins,et al.  Construction of a genetic toggle switch in Escherichia coli , 2000, Nature.

[34]  Desmond J. Higham,et al.  Chemical Master Equation and Langevin regimes for a gene transcription model , 2008, Theor. Comput. Sci..

[35]  C. Rao,et al.  Control, exploitation and tolerance of intracellular noise , 2002, Nature.

[36]  M. Elowitz,et al.  Regulatory activity revealed by dynamic correlations in gene expression noise , 2008, Nature Genetics.

[37]  M. A. Shea,et al.  The OR control system of bacteriophage lambda. A physical-chemical model for gene regulation. , 1985, Journal of molecular biology.

[38]  J. Collins,et al.  Chemogenomic profiling on a genome-wide scale using reverse-engineered gene networks , 2005, Nature Biotechnology.

[39]  Frank Allgöwer,et al.  Bridging time scales in cellular decision making with a stochastic bistable switch , 2010, BMC Systems Biology.

[40]  J. Collins,et al.  Inferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling , 2003, Science.

[41]  Wing Hung Wong,et al.  Learning a nonlinear dynamical system model of gene regulation: A perturbed steady-state approach , 2012, 1207.3137.

[42]  L. Diambra,et al.  Cooperative Binding of Transcription Factors Promotes Bimodal Gene Expression Response , 2012, PloS one.

[43]  N. G. van Kampen,et al.  Fluctuations in Nonlinear Systems , 2007 .

[44]  A. van Oudenaarden,et al.  Using Gene Expression Noise to Understand Gene Regulation , 2012, Science.

[45]  W. Fontana,et al.  The stochastic behavior of a molecular switching circuit with feedback , 2003, Biology Direct.

[46]  J. Paulsson Summing up the noise in gene networks , 2004, Nature.

[47]  A. Oudenaarden,et al.  Nature, Nurture, or Chance: Stochastic Gene Expression and Its Consequences , 2008, Cell.

[48]  Zhonghuai Hou,et al.  Small-number effects: a third stable state in a genetic bistable toggle switch. , 2012, Physical review letters.

[49]  Stephen P. Boyd,et al.  Inferring stable genetic networks from steady-state data , 2011, Autom..

[50]  A. van Oudenaarden,et al.  Noise Propagation in Gene Networks , 2005, Science.

[51]  D. Gillespie The chemical Langevin equation , 2000 .

[52]  G. K. Ackers,et al.  Quantitative model for gene regulation by lambda phage repressor. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[53]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[54]  Mads Kærn,et al.  Noise in eukaryotic gene expression , 2003, Nature.

[55]  A. Hill The Combinations of Haemoglobin with Oxygen and with Carbon Monoxide. I. , 1913, The Biochemical journal.

[56]  Joseph Klafter,et al.  Geometric versus Energetic Competition in Light Harvesting by Dendrimers , 1998 .

[57]  Brian Munsky,et al.  Listening to the noise: random fluctuations reveal gene network parameters , 2009, Molecular systems biology.

[58]  M. Planck,et al.  Physikalische Abhandlungen und Vorträge , 1958 .

[59]  Carsten Peterson,et al.  A Computational Model for Understanding Stem Cell, Trophectoderm and Endoderm Lineage Determination , 2008, PloS one.

[60]  Hernan G. Garcia,et al.  Transcriptional Regulation by the Numbers 2: Applications , 2004, q-bio/0412011.

[61]  J. Tyson,et al.  Modeling the control of DNA replication in fission yeast. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[62]  Yi Tao Intrinsic noise, gene regulation and steady-state statistics in a two-gene network. , 2004, Journal of theoretical biology.

[63]  J. M. Sancho,et al.  Asymmetric Stochastic Switching Driven by Intrinsic Molecular Noise , 2012, PloS one.