Fluid passage-time calculation in large Markov models

Recent developments in the analysis of large Markov models facilitate the fast approximation of transient characteristics of the underlying stochastic process. So-called fluid analysis makes it possible to consider previously intractable models whose underlying discrete state space grows exponentially as model components are added. In this work, we show how fluid approximation techniques may be used to extract passage-time measures from performance models. We focus on two types of passage measure: passage-times involving individual components; as well as passage-times which capture the time taken for a population of components to evolve. Specifically, we show that for models of sufficient scale, passage-time distributions can be well approximated by a deterministic fluid-derived passage-time measure. Where models are not of sufficient scale, we are able to generate approximate bounds for the entire cumulative distribution function of these passage-time random variables, using moment-based techniques. Finally, we show that for some passage-time measures involving individual components the cumulative distribution function can be directly approximated by fluid techniques.

[1]  Jane Hillston,et al.  Process algebras for quantitative analysis , 2005, 20th Annual IEEE Symposium on Logic in Computer Science (LICS' 05).

[2]  Nil Geisweiller,et al.  Relating continuous and discrete PEPA models of signalling pathways , 2008, Theor. Comput. Sci..

[3]  Peter G. Harrison,et al.  Uniformization and hypergraph partitioning for the distributed computation of response time densities in very large Markov models , 2004, J. Parallel Distributed Comput..

[4]  Fabrice Valois,et al.  Performance modelling of hierarchical cellular networks using PEPA , 2002, Performance evaluation (Print).

[5]  J. Norris,et al.  Differential equation approximations for Markov chains , 2007, 0710.3269.

[6]  R. W. R. Darling Fluid Limits of Pure Jump Markov Processes: a Practical Guide , 2002 .

[7]  O. Kallenberg Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[8]  Jeremy T. Bradley,et al.  A fluid analysis framework for a Markovian process algebra , 2010, Theor. Comput. Sci..

[9]  Luca Cardelli,et al.  From Processes to ODEs by Chemistry , 2008, IFIP TCS.

[10]  Jeremy T. Bradley,et al.  Fluid semantics for passive stochastic process algebra cooperation , 2008, Valuetools 2008.

[11]  Howard Bowman,et al.  Analysis of a Multimedia Stream using Stochastic Process Algebra , 2001, Comput. J..

[12]  Alberto Policriti,et al.  Stochastic Concurrent Constraint Programming and Differential Equations , 2007, QAPL.

[13]  Jane Hillston,et al.  Fluid flow approximation of PEPA models , 2005, Second International Conference on the Quantitative Evaluation of Systems (QEST'05).

[14]  Jeremy T. Bradley,et al.  Stochastic analysis of scheduling strategies in a Grid-based resource model , 2004, IEE Proc. Softw..

[15]  L. Recalde,et al.  On observability in timed continuous Petri net systems , 2004, First International Conference on the Quantitative Evaluation of Systems, 2004. QEST 2004. Proceedings..

[16]  Adam Duguid Coping with the Parallelism of BitTorrent: Conversion of PEPA to ODEs in Dealing with State Space Explosion , 2006, FORMATS.

[17]  Stephen Gilmore,et al.  Analysing distributed Internet worm attacks using continuous state-space approximation of process algebra models , 2008, J. Comput. Syst. Sci..

[18]  Stephen Gilmore,et al.  Derivation of passage-time densities in PEPA models using ipc: the imperial PEPA compiler , 2003, 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems, 2003. MASCOTS 2003..

[19]  Jane Hillston,et al.  A compositional approach to performance modelling , 1996 .

[20]  Jeremy T. Bradley,et al.  Extracting Response Times from Fluid Analysis of Performance Models , 2008, SIPEW.

[21]  Robert Holton,et al.  A PEPA Specification of an Industrial Production Cell , 1995, Comput. J..