Adaptively biased sequential importance sampling for rare events in reaction networks with comparison to exact solutions from finite buffer dCME method.

Critical events that occur rarely in biological processes are of great importance, but are challenging to study using Monte Carlo simulation. By introducing biases to reaction selection and reaction rates, weighted stochastic simulation algorithms based on importance sampling allow rare events to be sampled more effectively. However, existing methods do not address the important issue of barrier crossing, which often arises from multistable networks and systems with complex probability landscape. In addition, the proliferation of parameters and the associated computing cost pose significant problems. Here we introduce a general theoretical framework for obtaining optimized biases in sampling individual reactions for estimating probabilities of rare events. We further describe a practical algorithm called adaptively biased sequential importance sampling (ABSIS) method for efficient probability estimation. By adopting a look-ahead strategy and by enumerating short paths from the current state, we estimate the reaction-specific and state-specific forward and backward moving probabilities of the system, which are then used to bias reaction selections. The ABSIS algorithm can automatically detect barrier-crossing regions, and can adjust bias adaptively at different steps of the sampling process, with bias determined by the outcome of exhaustively generated short paths. In addition, there are only two bias parameters to be determined, regardless of the number of the reactions and the complexity of the network. We have applied the ABSIS method to four biochemical networks: the birth-death process, the reversible isomerization, the bistable Schlögl model, and the enzymatic futile cycle model. For comparison, we have also applied the finite buffer discrete chemical master equation (dCME) method recently developed to obtain exact numerical solutions of the underlying discrete chemical master equations of these problems. This allows us to assess sampling results objectively by comparing simulation results with true answers. Overall, ABSIS can accurately and efficiently estimate rare event probabilities for all examples, often with smaller variance than other importance sampling algorithms. The ABSIS method is general and can be applied to study rare events of other stochastic networks with complex probability landscape.

[1]  S. Kauffman,et al.  Cancer attractors: a systems view of tumors from a gene network dynamics and developmental perspective. , 2009, Seminars in cell & developmental biology.

[2]  S. Vajda Symposium on Monte Carlo Methods. Edited by H. A. Meyer pp. 382. 1956. 60s. (Wiley, New York; Chapman and Hall) , 1957 .

[3]  Jie Liang,et al.  Constrained proper sampling of conformations of transition state ensemble of protein folding. , 2011, The Journal of chemical physics.

[4]  D. Gillespie Approximate accelerated stochastic simulation of chemically reacting systems , 2001 .

[5]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]/Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[6]  Jie Liang,et al.  Probability landscape of heritable and robust epigenetic state of lysogeny in phage lambda , 2010, Proceedings of the National Academy of Sciences.

[7]  Min K Roh,et al.  State-dependent biasing method for importance sampling in the weighted stochastic simulation algorithm. , 2010, The Journal of chemical physics.

[8]  A. Arkin,et al.  Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells. , 1998, Genetics.

[9]  Hendrik B. Geyer,et al.  Journal of Physics A - Mathematical and General, Special Issue. SI Aug 11 2006 ?? Preface , 2006 .

[10]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[11]  F. Schlögl Chemical reaction models for non-equilibrium phase transitions , 1972 .

[12]  Peter A. Jones,et al.  The fundamental role of epigenetic events in cancer , 2002, Nature Reviews Genetics.

[13]  R. Elber,et al.  Computing time scales from reaction coordinates by milestoning. , 2004, The Journal of chemical physics.

[14]  Roger B. Sidje,et al.  Expokit: a software package for computing matrix exponentials , 1998, TOMS.

[15]  P. B. Warren Cells, cancer, and rare events: homeostatic metastability in stochastic nonlinear dynamical models of skin cell proliferation. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  K. Dill,et al.  The ultimate speed limit to protein folding is conformational searching. , 2007, Journal of the American Chemical Society.

[17]  K. Sneppen,et al.  . s of t ] 1 9 O ct 2 00 0 Stability Puzzles in Phage λ , 2008 .

[18]  L. Hood,et al.  Calculating biological behaviors of epigenetic states in the phage λ life cycle , 2004, Functional & Integrative Genomics.

[19]  Jin Wang,et al.  Potential Energy Landscape and Robustness of a Gene Regulatory Network: Toggle Switch , 2007, PLoS Comput. Biol..

[20]  Rosalind J Allen,et al.  Forward flux sampling for rare event simulations , 2009, Journal of physics. Condensed matter : an Institute of Physics journal.

[21]  Rong Chen,et al.  A Theoretical Framework for Sequential Importance Sampling with Resampling , 2001, Sequential Monte Carlo Methods in Practice.

[22]  Hiroyuki Kuwahara,et al.  An efficient and exact stochastic simulation method to analyze rare events in biochemical systems. , 2008, The Journal of chemical physics.

[23]  J. W. Little,et al.  Robustness of a gene regulatory circuit , 1999, The EMBO journal.

[24]  Jonathan Dushoff,et al.  Multi-Stability and Multi-Instability Phenomena in a Mathematical Model of Tumor-Immune-Virus Interactions , 2011, Bulletin of mathematical biology.

[25]  Linda R Petzold,et al.  Refining the weighted stochastic simulation algorithm. , 2009, The Journal of chemical physics.

[26]  Bernie J Daigle,et al.  Automated estimation of rare event probabilities in biochemical systems. , 2011, The Journal of chemical physics.

[27]  J. Herman,et al.  DNA hypermethylation in tumorigenesis: epigenetics joins genetics. , 2000, Trends in genetics : TIG.

[28]  H. Meirovitch A new method for simulation of real chains: scanning future steps , 1982 .

[29]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[30]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[31]  Min K. Roh,et al.  State-dependent doubly weighted stochastic simulation algorithm for automatic characterization of stochastic biochemical rare events. , 2011, The Journal of chemical physics.

[32]  C. Daub,et al.  BMC Systems Biology , 2007 .

[33]  K. Burrage,et al.  Stochastic models for regulatory networks of the genetic toggle switch. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Jie Liang,et al.  Statistical geometry of packing defects of lattice chain polymer from enumeration and sequential Monte Carlo method , 2002, physics/0203015.

[35]  G. Torrie,et al.  Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling , 1977 .

[36]  K. Sneppen,et al.  Epigenetics as a first exit problem. , 2001, Physical review letters.

[37]  D. Vvedensky,et al.  Non-equilibrium scaling in the Schlogl model , 1985 .

[38]  Hong Qian,et al.  Stochastic dynamics and non-equilibrium thermodynamics of a bistable chemical system: the Schlögl model revisited , 2009, Journal of The Royal Society Interface.

[39]  B. Bainbridge,et al.  Genetics , 1981, Experientia.

[40]  Marcel O. Vlad,et al.  Fluctuation–dissipation relations for chemical systems far from equilibrium , 1994 .

[41]  Jun S. Liu Lookahead Strategies for Sequential Monte Carlo , 2013 .

[42]  L. Hood,et al.  Cancer as robust intrinsic state of endogenous molecular-cellular network shaped by evolution. , 2008, Medical hypotheses.

[43]  Donald Gross,et al.  The Randomization Technique as a Modeling Tool and Solution Procedure for Transient Markov Processes , 1984, Oper. Res..

[44]  H. Meirovitch Statistical properties of the scanning simulation method for polymer chains , 1988 .

[45]  A. Arkin,et al.  Stochastic amplification and signaling in enzymatic futile cycles through noise-induced bistability with oscillations. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[46]  Jie Liang,et al.  Optimal enumeration of state space of finitely buffered stochastic molecular networks and exact computation of steady state landscape probability , 2008, BMC Systems Biology.