Probabilistic approximations of ODEs based bio-pathway dynamics

Bio-chemical networks are often modeled as systems of ordinary differential equations (ODEs). Such systems will not admit closed form solutions and hence numerical simulations will have to be used to perform analyses. However, the number of simulations required to carry out tasks such as parameter estimation can become very large. To get around this, we propose a discrete probabilistic approximation of the ODEs dynamics. We do so by discretizing the value and the time domain and assuming a distribution of initial states w.r.t. the discretization. Then we sample a representative set of initial states according to the assumed initial distribution and generate a corresponding set of trajectories through numerical simulations. Finally, using the structure of the signaling pathway we encode these trajectories compactly as a dynamic Bayesian network. This approximation of the signaling pathway dynamics has several advantages. First, the discretized nature of the approximation helps to bridge the gap between the accuracy of the results obtained by ODE simulation and the limited precision of experimental data used for model construction and verification. Second and more importantly, many interesting pathway properties can be analyzed efficiently through standard Bayesian inference techniques instead of resorting to a large number of ODE simulations. We have tested our method on ODE models of the EGF-NGF signaling pathway [1] and the segmentation clock pathway [2]. The results are very promising in terms of accuracy and efficiency.

[1]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[2]  Jane Hillston,et al.  A compositional approach to performance modelling , 1996 .

[3]  David Hsu,et al.  Probabilistic Approximations of Signaling Pathway Dynamics , 2009, CMSB.

[4]  Axel Kowald,et al.  Systems Biology in Practice: Concepts, Implementation and Application , 2005 .

[5]  C V Suresh Babu,et al.  Simulation and sensitivity analysis of phosphorylation of EGFR signal transduction pathway in PC12 cell model. , 2004, Systems biology.

[6]  R. Durrett Probability: Theory and Examples , 1993 .

[7]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[8]  Daphne Koller,et al.  Continuous Time Bayesian Networks , 2012, UAI.

[9]  Natal A. W. van Riel,et al.  Dynamic modelling and analysis of biochemical networks: mechanism-based models and model-based experiments , 2006, Briefings Bioinform..

[10]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[11]  김삼묘,et al.  “Bioinformatics” 특집을 내면서 , 2000 .

[12]  Marta Z. Kwiatkowska,et al.  Probabilistic model checking of complex biological pathways , 2008, Theor. Comput. Sci..

[13]  H. Amann,et al.  Ordinary Differential Equations: An Introduction to Nonlinear Analysis , 1990 .

[14]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[15]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[16]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[17]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[18]  Axel Legay,et al.  Statistical Model Checking in BioLab: Applications to the Automated Analysis of T-Cell Receptor Signaling Pathway , 2008, CMSB.

[19]  M. Page,et al.  Search for Steady States of Piecewise-Linear Differential Equation Models of Genetic Regulatory Networks , 2008, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[20]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[21]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[22]  Hidde de Jong,et al.  Search for Steady States of Piecewise-Linear Differential Equation Models of Genetic Regulatory Networks , 2008, IEEE/ACM Transactions on Computational Biology & Bioinformatics.

[23]  Kwang-Hyun Cho,et al.  In silico identification of the key components and steps in IFN‐γ induced JAK‐STAT signaling pathway , 2005, FEBS letters.

[24]  J. van Leeuwen,et al.  Theoretical Computer Science , 2003, Lecture Notes in Computer Science.

[25]  Nil Geisweiller,et al.  Relating continuous and discrete PEPA models of signalling pathways , 2008, Theor. Comput. Sci..

[26]  Alberto Policriti,et al.  XS-systems: eXtended S-Systems and Algebraic Differential Automata for Modeling Cellular Behavior , 2002, HiPC.

[27]  Marta Z. Kwiatkowska,et al.  PRISM: Probabilistic Symbolic Model Checker , 2002, Computer Performance Evaluation / TOOLS.

[28]  Atsushi Doi,et al.  Biopathways representation and simulation on hybrid functional Petri net , 2003, Silico Biol..

[29]  José Carlos Goulart de Siqueira,et al.  Differential Equations , 1919, Nature.

[30]  K. H. Lee,et al.  The statistical mechanics of complex signaling networks: nerve growth factor signaling , 2004, Physical biology.

[31]  F. Young Biochemistry , 1955, The Indian Medical Gazette.

[32]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[33]  Muffy Calder,et al.  Some Investigations Concerning the CTMC and the ODE Model Derived From Bio-PEPA , 2009, FBTC@ICALP.

[34]  D. Vere-Jones Markov Chains , 1972, Nature.

[35]  Sumit Kumar Jha,et al.  Temporal-logics as query languages for dynamic Bayesian networks: application to D. melanogaster embryo development , 2006 .

[36]  Jacky L. Snoep,et al.  BioModels Database: a free, centralized database of curated, published, quantitative kinetic models of biochemical and cellular systems , 2005, Nucleic Acids Res..

[37]  Kevin P. Murphy,et al.  The Factored Frontier Algorithm for Approximate Inference in DBNs , 2001, UAI.

[38]  Mudita Singhal,et al.  COPASI - a COmplex PAthway SImulator , 2006, Bioinform..

[39]  David K. Arrowsmith,et al.  Metric Spaces: Iteration and Application , 1986 .

[40]  Kwang-Hyun Cho,et al.  Experimental Design in Systems Biology, Based on Parameter Sensitivity Analysis Using a Monte Carlo Method: A Case Study for the TNFα-Mediated NF-κ B Signal Transduction Pathway , 2003, Simul..

[41]  Boris N. Kholodenko,et al.  Untangling the signalling wires , 2007, Nature Cell Biology.

[42]  David R. Gilbert,et al.  Analysis of Signalling Pathways Using Continuous Time Markov Chains , 2006, Trans. Comp. Sys. Biology.

[43]  Julio R. Banga,et al.  Optimization in computational systems biology , 2008, BMC Systems Biology.

[44]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[45]  Ben Lehner,et al.  A simple principle concerning the robustness of protein complex activity to changes in gene expression , 2008 .

[46]  Jie Chen,et al.  A Complex Oscillating Network of Signaling Genes Underlies the Mouse Segmentation Clock , 2006, Science.

[47]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[48]  Stephen Gilmore,et al.  Modelling the Influence of RKIP on the ERK Signalling Pathway Using the Stochastic Process Algebra PEPA , 2006, Trans. Comp. Sys. Biology.

[49]  Albert Goldbeter,et al.  Modeling the segmentation clock as a network of coupled oscillations in the Notch, Wnt and FGF signaling pathways. , 2008, Journal of theoretical biology.

[50]  D. Lauffenburger,et al.  Physicochemical modelling of cell signalling pathways , 2006, Nature Cell Biology.

[51]  C. Tomlin,et al.  Symbolic reachable set computation of piecewise affine hybrid automata and its application to biological modelling: Delta-Notch protein signalling. , 2004, Systems biology.

[52]  M. Hirsch,et al.  Differential Equations, Dynamical Systems, and an Introduction to Chaos , 2003 .