Exploring behaviors of stochastic differential equation models of biological systems using change of measures

Stochastic Differential Equations (SDE) are often used to model the stochastic dynamics of biological systems. Unfortunately, rare but biologically interesting behaviors (e.g., oncogenesis) can be difficult to observe in stochastic models. Consequently, the analysis of behaviors of SDE models using numerical simulations can be challenging. We introduce a method for solving the following problem: given a SDE model and a high-level behavioral specification about the dynamics of the model, algorithmically decide whether the model satisfies the specification. While there are a number of techniques for addressing this problem for discrete-state stochastic models, the analysis of SDE and other continuous-state models has received less attention. Our proposed solution uses a combination of Bayesian sequential hypothesis testing, non-identically distributed samples, and Girsanov's theorem for change of measures to examine rare behaviors. We use our algorithm to analyze two SDE models of tumor dynamics. Our use of non-identically distributed samples sampling contributes to the state of the art in statistical verification and model checking of stochastic models by providing an effective means for exposing rare events in SDEs, while retaining the ability to compute bounds on the probability that those events occur.

[1]  Leslie Lamport,et al.  Proving Liveness Properties of Concurrent Programs , 1982, TOPL.

[2]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[3]  Axel Legay,et al.  Statistical Model Checking in BioLab: Applications to the Automated Analysis of T-Cell Receptor Signaling Pathway , 2008, CMSB.

[4]  Marta Kwiatkowska,et al.  Advances and challenges of probabilistic model checking , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[5]  Axel Legay,et al.  A Bayesian Approach to Model Checking Biological Systems , 2009, CMSB.

[6]  John R. King,et al.  Stochastic and deterministic multiscale models for systems biology: an auxin-transport case study , 2010, BMC Systems Biology.

[7]  H. Jeffreys,et al.  Theory of probability , 1896 .

[8]  Thomas Hérault,et al.  Approximate Probabilistic Model Checking , 2004, VMCAI.

[9]  Håkan L. S. Younes,et al.  Probabilistic Verification of Discrete Event Systems Using Acceptance Sampling , 2002, CAV.

[10]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[11]  G. Uhlenbeck,et al.  On the Theory of the Brownian Motion II , 1945 .

[12]  A. Prasad Sistla,et al.  Monitoring the Full Range of omega-Regular Properties of Stochastic Systems , 2008, VMCAI.

[13]  E. Lehmann Testing Statistical Hypotheses , 1960 .

[14]  Kevin Burrage Stochastic Modelling for Systems Biology by Darren J. Wilkinson , 2006 .

[15]  R. Ramamoorthi,et al.  Remarks on consistency of posterior distributions , 2008, 0805.3248.

[16]  William S. Hlavacek,et al.  Rule-based modeling of biochemical networks: Research Articles , 2005 .

[17]  Sumit Kumar Jha,et al.  Synthesis and infeasibility analysis for stochastic models of biochemical systems using statistical model checking and abstraction refinement , 2011, Theor. Comput. Sci..

[18]  Nikos E. Mastorakis,et al.  Proceedings of the 1st WSEAS international conference on Biomedical electronics and biomedical informatics , 2008 .

[19]  Mahesh Viswanathan,et al.  Statistical Model Checking of Black-Box Probabilistic Systems , 2004, CAV.

[20]  Bernd Finkbeiner,et al.  Checking Finite Traces Using Alternating Automata , 2004, Formal Methods Syst. Des..

[21]  Sumit Kumar Jha,et al.  Exploring behaviors of SDE models of biological systems using change of measures , 2011, 2011 IEEE 1st International Conference on Computational Advances in Bio and Medical Sciences (ICCABS).

[22]  Gabriele B. Durrant,et al.  Journal of the Royal Statistical Society Series A (Statistics in Society). Special Issue on Paradata , 2013 .

[23]  Fernando Orejas,et al.  Relevance, Integration and Classification of Specification Formalisms and Formal Specification Techniques , 2007 .

[24]  Takis Konstantopoulos,et al.  Radon-Nikodým Theorem , 2011, International Encyclopedia of Statistical Science.

[25]  John Haigh Stochastic Modelling for Systems Biology by D. J. Wilkinson , 2007 .

[26]  Richard Lassaigne,et al.  Approximate Verification of Probabilistic Systems , 2002, PAPM-PROBMIV.

[27]  Dumitru Opris,et al.  The simulation of a stochastic model for tumour-immune system , 2009 .

[28]  I. J. Good,et al.  Theory of Probability Harold Jeffreys (Third edition, 447 + ix pp., Oxford Univ. Press, 84s.) , 1962 .

[29]  I. V. Girsanov On Transforming a Certain Class of Stochastic Processes by Absolutely Continuous Substitution of Measures , 1960 .

[30]  Fred Kröger,et al.  Temporal Logic of Programs , 1987, EATCS Monographs on Theoretical Computer Science.

[31]  Sumit Kumar Jha,et al.  When to stop verification?: Statistical trade-off between expected loss and simulation cost , 2011, 2011 Design, Automation & Test in Europe.

[32]  Håkan L. S. Younes,et al.  Numerical vs. Statistical Probabilistic Model Checking: An Empirical Study , 2004, TACAS.

[33]  Darren J. Wilkinson Stochastic Modelling for Systems Biology , 2006 .

[34]  Xiongzhi Chen Brownian Motion and Stochastic Calculus , 2008 .

[35]  Christian P. Robert,et al.  On Bayesian Data Analysis , 2010, 1001.4656.

[36]  Christopher J. Langmead,et al.  Generalized Queries and Bayesian Statistical Model Checking in Dynamic Bayesian Networks: Application to Personalized Medicine , 2009 .

[37]  Radu Grosu,et al.  Monte Carlo Model Checking , 2005, TACAS.

[38]  William S. Hlavacek,et al.  Rule-based modeling of biochemical networks , 2005, Complex..

[39]  Gerald A. Edgar,et al.  Disintegration of measures and the vector-valued Radon-Nikodym theorem , 1975 .

[40]  Marta Z. Kwiatkowska,et al.  Stochastic Model Checking , 2007, SFM.

[41]  A. Perelson,et al.  Nonlinear dynamics of immunogenic tumors: parameter estimation and global bifurcation analysis. , 1994, Bulletin of mathematical biology.

[42]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[43]  N. MacDonald,et al.  Biomathematics and cell kinetics , 1978, Nature.

[44]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[45]  M. Iosifescu,et al.  Stochastic processes and applications in biology and medicine , 1975 .

[46]  Sumit Kumar Jha,et al.  Predicting Protein Folding Kinetics Via Temporal Logic Model Checking , 2007, WABI.

[47]  Bernd Finkbeiner,et al.  Checking Finite Traces using Alternating Automata , 2001, Electron. Notes Theor. Comput. Sci..