Formal Modeling and Simulation of Biological Systems with Delays

Delays in biological systems may be used to model events for which the underlying dynamics cannot be precisely observed, or to provide abstraction of some behavior of the system resulting in more compact models. Historically, deterministic modeling of biological systems with delays is based on Delay Differential Equations (DDes), an extension of ordinary ones where the derivative of the unknown function depends on past-states of the system. More recently, stochastic modeling was addressed by using non-Markovian stochastic processes, i.e. processes whose sojourn time in a state and the transition probabilities are not necessarily exponentially distributed. To generate a statistically correct trajectory of such processes Delay Stochastic Simulation Algorithms (DSSas), based on a well-known Stochastic Simulation Algorithm (SSa) for delay-free systems, have been proposed. In the first part of the thesis we study different DSSas. The first two algorithms treat delays according to the “delays as durations” (DDa) and the “purely delayed” (PDa) scheduling strategies. Numerical simulations of a model of the cell cycle with a delay suggest that the PDa, even in its naive definition, is the more suitable approach to model systems in which species involved in a delayed interaction can be involved, at the same time, in other interactions. We provide a strong mathematical foundation for both the approaches by deriving two different Delay Chemical Master Equations (Dcmes), the analogous of the Chemical Master Equation (Cme) for delay-free systems. This rigorously proves the difference between the algorithms. Improvements of the naive PDa result in the PDa with markings, a more precise algorithm finally combined with the DDa to have a unique DSSa with both approaches. In the last algorithm we propose, the DSSa with Delayed Propensity Functions (Dpf), delays are treated as in DDes: changes in the current state of the system are affected by the history of the system, rather than by any scheduling strategy. We prove this algorithm to be correct, and we show that the Dcme for the PDa holds also for the Dpf, thus proving the equivalence between the algorithms. In the second part of the thesis we study formal languages for modeling biological systems with delays. Initially, we start adding delays to actions in the Calculus of Concurrent Systems (CCS) process algebra. This leads to two new qualitative algebras, CCSd and CCSp, the former where actions follow the DDa, the latter where actions follow the PDa. We provide both the algebras a Structural Operational Semantics (SOS) in the Starting-Terminating (ST) style, meaning that the start and the completion of an action are observed as two separate events, as desired when actions with delays require scheduling. To compare processes, we define bisimulation relations in both CCSd and CCSp, and we prove them to be congruences, thus extending standard results on CCS. Finally, we enrich the bio-inspired stochastic process algebra Bio-PEPA with actions following the DDa, yielding a new non-Markovian stochastic process algebra: Bio-PEPAd. This is a conservative extension meaning that the original syntax of Bio-PEPA is retained, hence adding delays to existing Bio-PEPA models is straightforward. We provide Bio-PEPAd with a SOS, again in the ST-style. To analyze Bio-PEPAd models, we formally define their encoding in Generalized semi-Markov Processes (GSMPs), a class of non-Markovian processes, directly at the semantic level. Moreover, we define translation of models in input for the DDa and in sets of DDes. Finally, we investigate the relation between Bio-PEPA and Bio-PEPAd models, outlining a clear connection at their semantic level, as it happens for the corresponding stochastic processes.

[1]  Daniel Le Métayer,et al.  Gamma and the chemical reaction model: ten years after , 1996 .

[2]  Corrado Priami,et al.  Modelling and simulation of biological processes in BlenX , 2008, PERV.

[3]  Ami Radunskaya,et al.  A delay differential equation model for tumor growth , 2003, Journal of mathematical biology.

[4]  Matthew Hennessy,et al.  Axiomatising Finite Concurrent Processes , 1988, SIAM J. Comput..

[5]  Q. Ouyang,et al.  The yeast cell-cycle network is robustly designed. , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Flavio Corradini Absolute versus relative time in process algebras , 1997, EXPRESS.

[7]  R. D. Driver Existence and stability of solutions of a delay-differential system , 1962 .

[8]  Luca Cardelli,et al.  BioAmbients: an abstraction for biological compartments , 2004, Theor. Comput. Sci..

[9]  Paolo Milazzo,et al.  Compositional semantics and behavioral equivalences for P Systems , 2008, Theor. Comput. Sci..

[10]  Vincent Danos,et al.  Rule-Based Modelling of Cellular Signalling , 2007, CONCUR.

[11]  R. V. Glabbeek The Linear Time - Branching Time Spectrum II: The Semantics of Sequential Systems with Silent Moves , 1993 .

[12]  Peter W. Glynn,et al.  On the role of generalized semi-Markov processes in simulation output analysis , 1983, WSC '83.

[13]  Robin Milner,et al.  Definition of standard ML , 1990 .

[14]  V. Volterra Fluctuations in the Abundance of a Species considered Mathematically , 1926, Nature.

[15]  André Leier,et al.  Stochastic Modelling and Simulation of Coupled Autoregulated Oscillators in a Multicellular Environment: The her1/her7 Genes , 2007, International Conference on Computational Science.

[16]  Hiroaki Kitano,et al.  1 Systems Biology : Toward System-levelUnderstanding of Biological Systems , 2001 .

[17]  Feng Zhang,et al.  Global stability of an SIR epidemic model with constant infectious period , 2008, Appl. Math. Comput..

[18]  D. O’Regan,et al.  An Introduction to Ordinary Differential Equations , 2008 .

[19]  Marco Ajmone Marsan,et al.  Stochastic Petri nets: an elementary introduction , 1988, European Workshop on Applications and Theory in Petri Nets.

[20]  Attila Csikász-Nagy,et al.  Analysis of a generic model of eukaryotic cell-cycle regulation. , 2006, Biophysical journal.

[21]  Jan A. Bergstra,et al.  Discrete Time Process Algebra: Absolute Time, Relative Time and Parametric Time , 1997, Fundam. Informaticae.

[22]  Robin Milner,et al.  Stochastic Bigraphs , 2008, MFPS.

[23]  Rob J. van Glabbeek The Refinement Theorem for ST-bisimulation Semantics , 1990, Programming Concepts and Methods.

[24]  Vincent Danos,et al.  A Language for the Cell , 2008 .

[25]  I. H. Segel Enzyme Kinetics: Behavior and Analysis of Rapid Equilibrium and Steady-State Enzyme Systems , 1975 .

[26]  Jane Hillston,et al.  Formal Methods for Computational Systems Biology , 2008 .

[27]  Wil M. P. van der Aalst Interval Timed Coloured Petri Nets and their Analysis , 1993, Application and Theory of Petri Nets.

[28]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[29]  Giulio Caravagna,et al.  Modeling biological systems with delays in Bio-PEPA , 2010, MeCBIC.

[30]  Robert de Simone,et al.  Higher-Level Synchronising Devices in Meije-SCCS , 1985, Theor. Comput. Sci..

[31]  Frits W. Vaandrager,et al.  Expressive Results for Process Algebras , 1992, REX Workshop.

[32]  Gordon D. Plotkin,et al.  The origins of structural operational semantics , 2004, J. Log. Algebraic Methods Program..

[33]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[34]  W. O. Kermack,et al.  A contribution to the mathematical theory of epidemics , 1927 .

[35]  R. Schlicht,et al.  A delay stochastic process with applications in molecular biology , 2008, Journal of mathematical biology.

[36]  D. Cox The analysis of non-Markovian stochastic processes by the inclusion of supplementary variables , 1955, Mathematical Proceedings of the Cambridge Philosophical Society.

[37]  Roberto Barbuti,et al.  Spatial Calculus of Looping Sequences , 2009, FBTC@ICALP.

[38]  Pascal Fradet,et al.  Gamma and the Chemical Reaction Model: Fifteen Years After , 2000, WMP.

[39]  Paolo Milazzo,et al.  Foundational aspects of multiscale modeling of biological systems with process algebras , 2012, Theor. Comput. Sci..

[40]  T. Ideker,et al.  A new approach to decoding life: systems biology. , 2001, Annual review of genomics and human genetics.

[41]  Mario Bravetti,et al.  Axiomatizing St Bisimulation for a Process Algebra with Recursion and Action Reenement (extended Abstract) , 1999 .

[42]  David F Anderson,et al.  A modified next reaction method for simulating chemical systems with time dependent propensities and delays. , 2007, The Journal of chemical physics.

[43]  Jacky L. Snoep,et al.  BioModels Database: a free, centralized database of curated, published, quantitative kinetic models of biochemical and cellular systems , 2005, Nucleic Acids Res..

[44]  Luca Cardelli,et al.  Brane Calculi , 2004, CMSB.

[45]  A. Jansen Monte Carlo simulations of chemical reactions on a surface with time-dependent reaction-rate constants , 1995 .

[46]  Matthew Hennessy,et al.  A Process Algebra for Timed Systems , 1995, Inf. Comput..

[47]  J. Tyson Some further studies of nonlinear oscillations in chemical systems , 1973 .

[48]  Luca Cardelli,et al.  An universality result for a (mem)brane calculus based on mate/drip operations , 2006, Int. J. Found. Comput. Sci..

[49]  Sebastian Bonhoeffer,et al.  Stochastic or deterministic: what is the effective population size of HIV-1? , 2006, Trends in microbiology.

[50]  Luca Cardelli,et al.  A Process Model of Rho GTP-binding Proteins in the Context of Phagocytosis , 2009, FBTC@CONCUR.

[51]  Maria Luisa Guerriero,et al.  Modelling Biological Clocks with Bio-PEPA: Stochasticity and Robustness for the Neurospora crassa Circadian Network , 2009, CMSB.

[52]  Rob J. van Glabbeek,et al.  Petri Net Models for Algebraic Theories of Concurrency , 1987, PARLE.

[53]  Wolfgang Reisig Petri Nets: An Introduction , 1985, EATCS Monographs on Theoretical Computer Science.

[54]  P. Milazzo,et al.  Qualitative and Quantitative Formal Modeling of Biological Systems , 2007 .

[55]  Tianhai Tian,et al.  Oscillatory Regulation of Hes1: Discrete Stochastic Delay Modelling and Simulation , 2006, PLoS Comput. Biol..

[56]  Paolo Milazzo,et al.  An intermediate language for the stochastic simulation of biological systems , 2008, Theor. Comput. Sci..

[57]  Kurt Jensen Coloured Petri Nets , 1992, EATCS Monographs in Theoretical Computer Science.

[58]  Robin Milner,et al.  A Calculus of Communicating Systems , 1980, Lecture Notes in Computer Science.

[59]  Rui Zhu,et al.  Validation of an algorithm for delay stochastic simulation of transcription and translation in prokaryotic gene expression , 2006, Physical biology.

[60]  Aviv Regev,et al.  Representation and Simulation of Biochemical Processes Using the pi-Calculus Process Algebra , 2000, Pacific Symposium on Biocomputing.

[61]  Hiroshi Momiji,et al.  Dissecting the dynamics of the Hes1 genetic oscillator. , 2008, Journal of theoretical biology.

[62]  Daniel T. Gillespie,et al.  Numerical Simulation for Biochemical Kinetics , 2008 .

[63]  Robin Milner,et al.  A Calculus of Mobile Processes, II , 1992, Inf. Comput..

[64]  Giulio Caravagna,et al.  Bio-PEPAd: A non-Markovian extension of Bio-PEPA , 2012, Theor. Comput. Sci..

[65]  Jane Hillston,et al.  A semantic equivalence for Bio-PEPA based on discretisation of continuous values , 2011, Theor. Comput. Sci..

[66]  Andre S Ribeiro,et al.  Studying genetic regulatory networks at the molecular level: delayed reaction stochastic models. , 2007, Journal of theoretical biology.

[67]  I. Györi,et al.  Oscillation criteria in delay equations , 1984 .

[68]  Muruhan Rathinam,et al.  Stiffness in stochastic chemically reacting systems: The implicit tau-leaping method , 2003 .

[69]  Rob J. van Glabbeek,et al.  The Linear Time - Branching Time Spectrum II , 1993, CONCUR.

[70]  Joost-Pieter Katoen,et al.  A Stochastic Automata Model and its Algebraic Approach , 1997 .

[71]  Christel Baier,et al.  Approximate Symbolic Model Checking of Continuous-Time Markov Chains , 1999, CONCUR.

[72]  Mario Bravetti,et al.  Deciding and axiomatizing weak ST bisimulation for a process algebra with recursion and action refinement , 2002, TOCL.

[73]  Joseph Sifakis,et al.  The Algebra of Timed Processes, ATP: Theory and Application , 1994, Inf. Comput..

[74]  Antti Häkkinen,et al.  Delayed Stochastic Model of Transcription at the Single Nucleotide Level , 2009, J. Comput. Biol..

[75]  R. V. Glabbeek The Linear Time-Branching Time Spectrum I The Semantics of Concrete , Sequential ProcessesR , 2007 .

[76]  Wlodzimierz M. Zuberek,et al.  Timed Petri nets and preliminary performance evaluation , 1980, ISCA '80.

[77]  D. Gillespie Approximate accelerated stochastic simulation of chemically reacting systems , 2001 .

[78]  Shigui Ruan,et al.  On Nonlinear Dynamics of Predator-Prey Models with Discrete Delay ⁄ , 2009 .

[79]  Gordon D. Plotkin,et al.  A Language for Biochemical Systems: Design and Formal Specification , 2010, Trans. Comp. Sys. Biology.

[80]  Gheorghe Paun,et al.  DNA Computing: New Computing Paradigms , 1998 .

[81]  Frits W. Vaandrager,et al.  Expressiveness results for process algebras , 1993 .

[82]  K. Burrage,et al.  Stochastic delay differential equations for genetic regulatory networks , 2007 .

[83]  Joseph Sifakis,et al.  Use of Petri nets for performance evaluation , 1977, Acta Cybern..

[84]  D. Gillespie A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[85]  Roberto Barbuti,et al.  An Overview on Operational Semantics in Membrane Computing , 2011, Int. J. Found. Comput. Sci..

[86]  Jane Hillston,et al.  A compositional approach to performance modelling , 1996 .

[87]  I. Győri,et al.  Necessary and sufficient condition for oscillation of a neutral differential system with several delays , 1989 .

[88]  Gordon D. Plotkin,et al.  A structural approach to operational semantics , 2004, J. Log. Algebraic Methods Program..

[89]  Mario Bravetti,et al.  The theory of interactive generalized semi-Markov processes , 2002, Theor. Comput. Sci..

[90]  Jane Hillston,et al.  Bio-PEPA: A framework for the modelling and analysis of biological systems , 2009, Theor. Comput. Sci..

[91]  Paolo Milazzo,et al.  Aspects of multiscale modelling in a process algebra for biological systems , 2010, MeCBIC.

[92]  S. Ruan,et al.  Predator-prey models with delay and prey harvesting , 2001, Journal of mathematical biology.

[93]  Julien F. Ollivier,et al.  Colored extrinsic fluctuations and stochastic gene expression , 2008, Molecular systems biology.

[94]  Katherine C. Chen,et al.  Integrative analysis of cell cycle control in budding yeast. , 2004, Molecular biology of the cell.

[95]  A. J. Lotka UNDAMPED OSCILLATIONS DERIVED FROM THE LAW OF MASS ACTION. , 1920 .

[96]  P. Manfredi,et al.  Vaccinating behaviour, information, and the dynamics of SIR vaccine preventable diseases. , 2007, Theoretical population biology.

[97]  Hal L. Smith,et al.  An introduction to delay differential equations with applications to the life sciences / Hal Smith , 2010 .

[98]  Marta Z. Kwiatkowska,et al.  Probabilistic model checking of complex biological pathways , 2008, Theor. Comput. Sci..

[99]  D. Volfson,et al.  Delay-induced stochastic oscillations in gene regulation. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[100]  Paolo Milazzo,et al.  Compositional semantics of spiking neural P systems , 2010, J. Log. Algebraic Methods Program..

[101]  Tatiana T. Marquez-Lago,et al.  Probability distributed time delays: integrating spatial effects into temporal models , 2010, BMC Systems Biology.

[102]  Vincent Danos,et al.  Rule-Based Modelling and Model Perturbation , 2009, Trans. Comp. Sys. Biology.

[103]  R. D. Driver,et al.  Ordinary and Delay Differential Equations , 1977 .

[104]  Ian Stark,et al.  The Continuous pi-Calculus: A Process Algebra for Biochemical Modelling , 2008, CMSB.

[105]  Michael L. Mavrovouniotis,et al.  Petri Net Representations in Metabolic Pathways , 1993, ISMB.

[106]  Sunwon Park,et al.  Colored Petri net modeling and simulation of signal transduction pathways. , 2006, Metabolic engineering.

[107]  Corrado Priami,et al.  Stochastic pi-Calculus , 1995, Comput. J..

[108]  David Park,et al.  Concurrency and Automata on Infinite Sequences , 1981, Theoretical Computer Science.

[109]  Paolo Milazzo,et al.  On the Interpretation of Delays in Delay Stochastic Simulation of Biological Systems , 2009, COMPMOD.

[110]  Yifei Wang,et al.  Accelerated stochastic simulation algorithm for coupled chemical reactions with delays , 2008, Comput. Biol. Chem..

[111]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[112]  Xiaodong Cai,et al.  Exact stochastic simulation of coupled chemical reactions with delays. , 2007, The Journal of chemical physics.

[113]  Paolo Milazzo,et al.  The Calculus of Looping Sequences , 2008, SFM.

[114]  Darren J. Wilkinson Stochastic Modelling for Systems Biology , 2006 .

[115]  D. Herries Enzyme Kinetics: Behaviour and Analysis of Rapid Equilibrium and Steady-State Enzyme Systems: By Irwin H. Segel. John Wiley & Sons, 1975. pp xxii + 957. Boards, £15.00 , 1976 .

[116]  Roberto Barbuti,et al.  Tumour suppression by immune system through stochastic oscillations. , 2010, Journal of theoretical biology.

[117]  Corrado Priami,et al.  An Automated Translation from a Narrative Language for Biological Modelling into Process Algebra , 2007, CMSB.

[118]  Stephen Gilmore,et al.  Modelling the Influence of RKIP on the ERK Signalling Pathway Using the Stochastic Process Algebra PEPA , 2006, Trans. Comp. Sys. Biology.

[119]  Paolo Milazzo,et al.  A P Systems Flat Form Preserving Step-by-step Behaviour , 2008, Fundam. Informaticae.

[120]  Wanbiao Ma,et al.  Permanence of an SIR epidemic model with distributed time delays , 2001 .

[121]  Faron Moller,et al.  A Temporal Calculus of Communicating Systems , 1990, CONCUR.

[122]  Linda R Petzold,et al.  The slow-scale stochastic simulation algorithm. , 2005, The Journal of chemical physics.

[123]  U. Sauer,et al.  Getting Closer to the Whole Picture , 2007, Science.

[124]  Rajeev Alur,et al.  Verifying Automata Specifications of Probabilistic Real-time Systems , 1991, REX Workshop.

[125]  Michael A. Gibson,et al.  Efficient Exact Stochastic Simulation of Chemical Systems with Many Species and Many Channels , 2000 .

[126]  Tadao Murata,et al.  Petri nets: Properties, analysis and applications , 1989, Proc. IEEE.

[127]  Christos G. Cassandras,et al.  Stochastic Timed Automata , 1999 .

[128]  Marta Z. Kwiatkowska,et al.  Stochastic Model Checking , 2007, SFM.

[129]  Mario Bravetti,et al.  Towards Performance Evaluation with General Distributions in Process Algebras , 1998, CONCUR.

[130]  N. Monk Oscillatory Expression of Hes1, p53, and NF-κB Driven by Transcriptional Time Delays , 2003, Current Biology.

[131]  Paolo Milazzo,et al.  Delay Stochastic Simulation of Biological Systems: A Purely Delayed Approach , 2011, Trans. Comp. Sys. Biology.

[132]  G. A. Bocharovy A Report on the Use of Delay Di erential Equationsin Numerical Modelling in the BiosciencesC , 1999 .

[133]  Gheorghe Paun,et al.  Membrane Computing , 2002, Natural Computing Series.

[134]  Corrado Priami,et al.  Beta Binders for Biological Interactions , 2004, CMSB.

[135]  Robert K. Brayton,et al.  Verifying Continuous Time Markov Chains , 1996, CAV.

[136]  Jan A. Bergstra,et al.  Real time process algebra , 1991, Formal Aspects of Computing.

[137]  Catuscia Palamidessi,et al.  Comparing the expressive power of the synchronous and asynchronous $pi$-calculi , 2003, Mathematical Structures in Computer Science.