Non-Markovian Analysis

If in stochastic modeling the idealized assumption of exponential distributions is removed, the resulting stochastic process is non-Markovian. In this tutorial paper we give an overview of possible analytic approaches for such non-Markovian models. The modeling framework of stochastic Petri nets is used, but the ideas are applicable to other frameworks as well, if a state space can be constructed. We give a detailed presentation of one analysis approach which is based on the method of supplementary variables and give a brief review of another analysis approach which is based on embedding. A model of a timer for holding a connection is used as a tutorial example and a model for a medium access mechanism in wireless networks is used as a more complex example.

[1]  Reinhard German Iterative Analysis of Markov Regenerative Models , 2000, Computer Performance Evaluation / TOOLS.

[2]  Aldo Cumani,et al.  ESP - A Package for the Evaluation of Stochastic Petri Nets with Phase-Type Distributed Transition Times , 1985, PNPM.

[3]  Marco Ajmone Marsan,et al.  On Petri nets with deterministic and exponentially distributed firing times , 1986, European Workshop on Applications and Theory of Petri Nets.

[4]  Giovanni Chiola,et al.  Efficient Handling of Phase-Type Distributions in Generalized Stochastic Petri Nets , 1997, ICATPN.

[5]  Christoph Lindemann,et al.  DSPNexpress: A Software Package for the Efficient Solution of Deterministic and Stochastic Petri Nets , 1993, Perform. Evaluation.

[6]  Christoph Lindemann,et al.  Performance Modelling with Deterministic and Stochastic Petri Nets , 1998, PERV.

[7]  Kishor S. Trivedi,et al.  Steady State Analysis of Markov Regenerative SPN with Age Memory Policy , 1995, MMB.

[8]  Gerald S. Shedler,et al.  Numerical Analysis of Deterministic and Stochastic Petri Nets with Concurrent Deterministic Transitions , 1996, Perform. Evaluation.

[9]  Miklós Telek,et al.  Markov Regenerative Stochastic Petri Nets with Age Type General Transitions , 1995, Application and Theory of Petri Nets.

[10]  Andrea Bobbio,et al.  Markov regenerative SPN with non-overlapping activity cycles , 1995, Proceedings of 1995 IEEE International Computer Performance and Dependability Symposium.

[11]  Gianfranco Balbo,et al.  Introduction to Stochastic Petri Nets , 2002, European Educational Forum: School on Formal Methods and Performance Analysis.

[12]  Grzegorz Rozenberg,et al.  Advances in Petri Nets 1985 , 1985, Lecture Notes in Computer Science.

[13]  A. Bobbio,et al.  Kronecker representation of stochastic Petri nets with discrete PH distributions , 1998, Proceedings. IEEE International Computer Performance and Dependability Symposium. IPDS'98 (Cat. No.98TB100248).

[14]  Jörn Freiheit,et al.  Petri Net Modelling and Performability Evaluation with TimeNET 3.0 , 2000, Computer Performance Evaluation / TOOLS.

[15]  Kishor S. Trivedi,et al.  Recent Developments in Non-Markovian Stochastic Petri Nets , 1998, J. Circuits Syst. Comput..

[16]  Antonio Puliafito,et al.  Steady state solution of MRSPN with mixed preemption policies , 1996, Proceedings of IEEE International Computer Performance and Dependability Symposium.

[17]  Kishor S. Trivedi,et al.  Performance and Reliability Analysis of Computer Systems , 1996, Springer US.

[18]  Kishor S. Trivedi,et al.  Petri Nets with k Simultaneously Enabled Generally Distributed Timed Transitions , 1998, Perform. Evaluation.

[19]  B. R. Haverkort Matrix-geometric solution of infinite stochastic Petri nets , 1995, Proceedings of 1995 IEEE International Computer Performance and Dependability Symposium.

[20]  Richard R. Muntz,et al.  Performance/Availability Modeling with te TANGRAM-II Modeling Environment , 1998, Perform. Evaluation.

[21]  Kishor S. Trivedi,et al.  Performance And Reliability Analysis Of Computer Systems (an Example-based Approach Using The Sharpe Software , 1997, IEEE Transactions on Reliability.

[22]  Boudewijn R. Haverkort,et al.  Markovian Models for Performance and Dependability Evaluation , 2002, European Educational Forum: School on Formal Methods and Performance Analysis.

[23]  Gianfranco Balbo Performance Modeling with Deterministic and Stochastic Petri Nets , 2000 .

[24]  Gianfranco Ciardo,et al.  SMART: simulation and Markovian analyzer for reliability and timing , 1996, Proceedings of IEEE International Computer Performance and Dependability Symposium.

[25]  Hoon Choi,et al.  Markov Regenerative Stochastic Petri Nets , 1994, Perform. Evaluation.

[26]  Kishor S. Trivedi,et al.  Preemptive repeat identical transitions in Markov regenerative stochastic Petri nets , 1995, Proceedings 6th International Workshop on Petri Nets and Performance Models.

[27]  William H. Sanders,et al.  Performability modeling with UltraSAN , 1991, IEEE Software.

[28]  Günter Hommel,et al.  TimeNET: A Toolkit for Evaluating Non-Markovian Stochastic Petri Nets , 1995, Perform. Evaluation.

[29]  Reinhard German,et al.  Analysis of Stochastic Petri Nets by the Method of Supplementary Variables , 1994, Perform. Evaluation.

[30]  B. Conolly Structured Stochastic Matrices of M/G/1 Type and Their Applications , 1991 .

[31]  G. Ciardo,et al.  DISCRETE-TIME MARKOVIAN STOCHASTIC PETRI NETS , 1995 .

[32]  William H. Sanders,et al.  Möbius : An Extensible Framework For Performance and Dependability Modeling , 1910 .

[33]  William H. Sanders,et al.  Möbius: An Extensible Tool for Performance and Dependability Modeling , 2000, Computer Performance Evaluation / TOOLS.

[34]  L Jones Robert,et al.  Analysis of Phase-Type Stochastic Petri Nets With Discrete and Continuous Timing , 2000 .

[35]  Boudewijn R. Haverkort,et al.  Performance and reliability analysis of computer systems: An example-based approach using the sharpe software package , 1998 .

[36]  Leonard Kleinrock,et al.  Theory, Volume 1, Queueing Systems , 1975 .

[37]  Falko Bause,et al.  Quantitative Evaluation of Computing and Communication Systems , 1995, Lecture Notes in Computer Science.

[38]  Boudewijn R. Haverkort,et al.  Performance of computer communication systems - a model-based approach , 1998 .

[39]  Reinhard German,et al.  Markov regenerative stochastic Petri nets with general execution policies: supplementary variable analysis and a prototype tool , 1998, Perform. Evaluation.

[40]  A. Horvath,et al.  Supplementary variable approach applied to the transient analysis of age-MRSPNs , 1998, Proceedings. IEEE International Computer Performance and Dependability Symposium. IPDS'98 (Cat. No.98TB100248).

[41]  Antonio Puliafito,et al.  Analysis and Evaluation of Non-Markovian Stochastic Petri Nets , 2000, Computer Performance Evaluation / TOOLS.

[42]  S. Wells,et al.  IDEAS : an Integrated Design Environment for Assessment of Computer Systems and Communication Networks , 1996 .

[43]  Wolfgang Reisig,et al.  Application and Theory of Petri Nets , 1982, Informatik-Fachberichte.

[44]  Miklós Telek,et al.  Formal relation of Markov renewal theory and supplementary variables in the analysis of stochastic Petri nets , 1999, Proceedings 8th International Workshop on Petri Nets and Performance Models (Cat. No.PR00331).

[45]  Reinhard German,et al.  Performance analysis of communication systems - modelling with non-Markovian stochastic Petri nets , 2000, Wiley-Interscience series in systems and optimization.

[46]  Hoon Choi,et al.  Performance evaluation: Erratum to “Markov regenerative stochastic Petri nets” [20 (1994) 337–357] , 1995 .

[47]  Marco Ajmone Marsan,et al.  Modelling with Generalized Stochastic Petri Nets , 1995, PERV.

[48]  Marcel F. Neuts,et al.  Matrix-Geometric Solutions in Stochastic Models , 1981 .

[49]  Reinhard German,et al.  Performance modeling of IEEE 802.11 wireless LANs with stochastic Petri nets , 2001, Perform. Evaluation.

[50]  M.A. Qureshi,et al.  The UltraSAN Modeling Environment , 1995, Perform. Evaluation.