Stochastic approaches in systems biology

The discrete and random occurrence of chemical reactions far from thermodynamic equilibrium, and low copy numbers of chemical species, in systems biology necessitate stochastic approaches. This review is an effort to give the reader a flavor of the most important stochastic approaches relevant to systems biology. Notions of biochemical reaction systems and the relevant concepts of probability theory are introduced side by side. This leads to an intuitive and easy‐to‐follow presentation of a stochastic framework for modeling subcellular biochemical systems. In particular, we make an effort to show how the notion of propensity, the chemical master equation (CME), and the stochastic simulation algorithm arise as consequences of the Markov property. Most stochastic modeling reviews focus on stochastic simulation approaches—the exact stochastic simulation algorithm and its various improvements and approximations. We complement this with an outline of an analytical approximation. The most common formulation of stochastic models for biochemical networks is the CME. Although stochastic simulations are a practical way to realize the CME, analytical approximations offer more insight into the influence of randomness on system's behavior. Toward that end, we cover the chemical Langevin equation and the related Fokker–Planck equation and the two‐moment approximation (2MA). Throughout the text, two pedagogical examples are used to key illustrate ideas. With extensive references to the literature, our goal is to clarify key concepts and thereby prepare the reader for more advanced texts. Copyright © 2009 John Wiley & Sons, Inc.

[1]  S. Leibler,et al.  Physical aspects of the growth and regulation of microtubule structures. , 1993, Physical review letters.

[2]  K. Mallick,et al.  Noise-induced bifurcations, multiscaling and on–off intermittency , 2007, 0710.4066.

[3]  Brian Munsky,et al.  Reduction and solution of the chemical master equation using time scale separation and finite state projection. , 2006, The Journal of chemical physics.

[4]  D. Gillespie The chemical Langevin equation , 2000 .

[5]  J. Raser,et al.  Noise in Gene Expression: Origins, Consequences, and Control , 2005, Science.

[6]  A. Oudenaarden,et al.  Nature, Nurture, or Chance: Stochastic Gene Expression and Its Consequences , 2008, Cell.

[7]  John K. Goutsias,et al.  A hidden Markov model for transcriptional regulation in single cells , 2006, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[8]  Naama Barkai,et al.  Noise Propagation and Signaling Sensitivity in Biological Networks: A Role for Positive Feedback , 2007, PLoS Comput. Biol..

[9]  O. Wolkenhauer,et al.  Investigating the two-moment characterisation of subcellular biochemical networks. , 2008, Journal of theoretical biology.

[10]  M. Sasai,et al.  Testing the transition state theory in stochastic dynamics of a genetic switch , 2006, cond-mat/0608548.

[11]  Xiufeng Lang,et al.  Internal noise-sustained circadian rhythms in a Drosophila model. , 2008, Biophysical journal.

[12]  Johan Paulsson,et al.  Near-critical phenomena in intracellular metabolite pools. , 2003, Biophysical journal.

[13]  Masahiro Ueda,et al.  Noise generation, amplification and propagation in chemotactic signaling systems of living cells , 2008, Biosyst..

[14]  M. Ehrenberg,et al.  Noise in a minimal regulatory network: plasmid copy number control , 2001, Quarterly Reviews of Biophysics.

[15]  Friedrich Schl gl Chemical Reaction Models for Non-Equilibrium Phase Transitions , 2005 .

[16]  Konstantinos Michalodimitrakis,et al.  Noise in transcription negative feedback loops: simulation and experimental analysis , 2006, Molecular systems biology.

[17]  J. Elf,et al.  Fast evaluation of fluctuations in biochemical networks with the linear noise approximation. , 2003, Genome research.

[18]  Desmond J. Higham,et al.  An Algorithmic Introduction to Numerical Simulation of Stochastic Differential Equations , 2001, SIAM Rev..

[19]  G. Verghese,et al.  Mass fluctuation kinetics: capturing stochastic effects in systems of chemical reactions through coupled mean-variance computations. , 2007, The Journal of chemical physics.

[20]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[21]  Y. Tao,et al.  Stochastic fluctuations in gene expression far from equilibrium: Omega expansion and linear noise approximation. , 2005, The Journal of chemical physics.

[22]  Vipul Periwal,et al.  Stochastic Modeling of Intracellular Kinetics , 2006 .

[23]  M. Sasai,et al.  Roles of noise in single and coupled multiple genetic oscillators. , 2007, The Journal of chemical physics.

[24]  Kazuyuki Aihara,et al.  Noise-reduction through interaction in gene expression and biochemical reaction processes. , 2004, Journal of theoretical biology.

[25]  D. Wilkinson Stochastic modelling for quantitative description of heterogeneous biological systems , 2009, Nature Reviews Genetics.

[26]  Johan Paulsson,et al.  Summing up the noise , 2004 .

[27]  H. Qian From discrete protein kinetics to continuous Brownian dynamics: A new perspective , 2001, Protein science : a publication of the Protein Society.

[28]  M. Thattai,et al.  Attenuation of noise in ultrasensitive signaling cascades. , 2002, Biophysical journal.

[29]  A. E. Hirsh,et al.  Noise Minimization in Eukaryotic Gene Expression , 2004, PLoS biology.

[30]  D. Fell Understanding the Control of Metabolism , 1996 .

[31]  Johan Paulsson,et al.  Models of stochastic gene expression , 2005 .

[32]  Yuping Zhang,et al.  Nonequilibrium Model for Yeast Cell Cycle , 2006, ICIC.

[33]  C. Rao,et al.  Control, exploitation and tolerance of intracellular noise , 2002, Nature.

[34]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[35]  F. Hayot,et al.  The linear noise approximation for molecular fluctuations within cells , 2004, Physical biology.

[36]  M. Ehrenberg,et al.  Random signal fluctuations can reduce random fluctuations in regulated components of chemical regulatory networks. , 2000, Physical review letters.

[37]  Margaret Robson Wright,et al.  An Introduction to Chemical Kinetics: Wright/An Introduction to Chemical Kinetics , 2004 .

[38]  F. Schlögl Chemical reaction models for non-equilibrium phase transitions , 1972 .

[39]  M. Ehrenberg,et al.  Stochastic focusing: fluctuation-enhanced sensitivity of intracellular regulation. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[40]  A. van Oudenaarden,et al.  Noise Propagation in Gene Networks , 2005, Science.

[41]  M. Muir Physical Chemistry , 1888, Nature.

[42]  Kevin Burrage,et al.  Stochastic approaches for modelling in vivo reactions , 2004, Comput. Biol. Chem..

[43]  James E. Ferrell,et al.  Bistability in cell signaling: How to make continuous processes discontinuous, and reversible processes irreversible. , 2001, Chaos.

[44]  Kunihiko Kaneko,et al.  Switching dynamics in reaction networks induced by molecular discreteness , 2006, physics/0612060.

[45]  Clas Blomberg,et al.  Fluctuations for good and bad: The role of noise in living systems , 2006 .

[46]  M. Khammash,et al.  A reduced model solution for the chemical master equation arising in stochastic analyses of biological networks , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[47]  Benjamin B. Kaufmann,et al.  Contributions of low molecule number and chromosomal positioning to stochastic gene expression , 2005, Nature Genetics.

[48]  A. Rényi On the theory of order statistics , 1953 .

[49]  Daniel T. Gillespie,et al.  The multivariate Langevin and Fokker–Planck equations , 1996 .

[50]  Jayajit Das,et al.  Purely stochastic binary decisions in cell signaling models without underlying deterministic bistabilities , 2007, Proceedings of the National Academy of Sciences.

[51]  J. Paulsson Summing up the noise in gene networks , 2004, Nature.

[52]  G. Papoian,et al.  The interplay between discrete noise and nonlinear chemical kinetics in a signal amplification cascade. , 2006, The Journal of chemical physics.

[53]  Bor-Sen Chen,et al.  On the attenuation and amplification of molecular noise in genetic regulatory networks , 2006, BMC Bioinformatics.

[54]  Darren J. Wilkinson Stochastic Modelling for Systems Biology , 2006 .

[55]  Jürgen Pahle,et al.  Stochastic simulation and analysis of biochemical networks , 2008 .

[56]  J. Hasty,et al.  Noise-based switches and amplifiers for gene expression. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[57]  J. Levine,et al.  Intrinsic fluctuations, robustness, and tunability in signaling cycles. , 2006, Biophysical journal.

[58]  T. Elston,et al.  Stochasticity in gene expression: from theories to phenotypes , 2005, Nature Reviews Genetics.

[59]  Ertugrul M. Ozbudak,et al.  Multistability in the lactose utilization network of Escherichia coli , 2004, Nature.

[60]  M. Khammash,et al.  Intrinsic noise rejection in gene networks by regulation of stability , 2004, First International Symposium on Control, Communications and Signal Processing, 2004..

[61]  M. Ehrenberg,et al.  Fluctuations and quality of control in biological cells: zero-order ultrasensitivity reinvestigated. , 2000, Biophysical journal.

[62]  A. Arkin,et al.  Stochastic amplification and signaling in enzymatic futile cycles through noise-induced bistability with oscillations. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[63]  S. Leibler,et al.  Mechanisms of noise-resistance in genetic oscillators , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[64]  Gürol M. Süel,et al.  A genetic timer through noise-induced stabilization of an unstable state , 2008, Proceedings of the National Academy of Sciences.

[65]  R. Heinrich,et al.  The Regulation of Cellular Systems , 1996, Springer US.