DEVS markov modeling and simulation: formal definition and implementation

Markov Modeling is among the most commonly used forms of model expression and Markov concepts of states and state transitions are fully compatible with the DEVS characterization of discrete event systems. Besides their general usefulness, the Markov concepts of stochastic modeling are implicitly at the heart of most forms of discrete event simulation and are a natural basis for the extended and integrated Markov modeling facility discussed in this paper. DEVS Markov models are full-fledged DEVS models and can be coupled with other DEVS components in hierarchical compositions. Due to their explicit transition and time advance structure, DEVS Markov models can be individualized with specific transition probabilities and transition times/rates which can be changed during model execution for dynamic structural change. This paper presents the formal concepts underlying DEVS Markov models and how they are implemented in MS4 Me, also discussing how the facilities differ from other Markov M&S tools.

[1]  Bernard P. Zeigler,et al.  Integrating web-based simulation on IT systems with finite probabilistic DEVS , 2015, SpringSim.

[2]  Bernard P. Zeigler,et al.  DEVS modeling and simulation methodology with MS4 Me software tool , 2013, SpringSim.

[3]  Bernard P. Zeigler,et al.  Guide to Modeling and Simulation of Systems of Systems , 2012, SpringerBriefs in Computer Science.

[4]  Gabriel A. Wainer,et al.  A formal framework for stochastic DEVS modeling and simulation , 2008, SpringSim '08.

[5]  Nikolaos Limnios,et al.  Semi-Markov Chains and Hidden Semi-Markov Models toward Applications: Their Use in Reliability and DNA Analysis , 2008 .

[6]  Nikolaos Limnios,et al.  Semi-Markov Chains , 2008 .

[7]  Bernard P. Zeigler,et al.  System Entity Structures for Suites of simulation Models , 2013, Int. J. Model. Simul. Sci. Comput..

[8]  Sven Banisch,et al.  Markov Chain Aggregation for Agent-Based Models , 2015 .

[9]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[10]  Frode B. Nilson,et al.  GMSim: a tool for compositional GSMP modeling , 1998, WSC '98.

[11]  F. B. Nilsen,et al.  GMSim: a tool for compositional GSMP modeling , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[12]  Tugrul Dayar,et al.  Analyzing Markov Chains using Kronecker Products: Theory and Applications , 2012 .

[13]  Håkan L. S. Younes,et al.  Solving Generalized Semi-Markov Decision Processes Using Continuous Phase-Type Distributions , 2004, AAAI.

[14]  U. Rieder,et al.  Markov Decision Processes , 2010 .

[15]  Patrick Fabiani,et al.  A Simulation-based Approach for Solving Generalized Semi-Markov Decision Processes , 2008, ECAI.

[16]  Sven Banisch,et al.  Agent-Based Models as Markov Chains , 2016 .

[17]  Tugrul Dayar,et al.  Analyzing Markov Chains using Kronecker Products , 2012 .

[18]  P. Glynn.  A GSMP formalism for discrete event systems , 1989, Proc. IEEE.

[19]  Bernard P. Zeigler,et al.  Reachability Graph of Finite and Deterministic DEVS Networks , 2009, IEEE Transactions on Automation Science and Engineering.

[20]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[21]  Gabriel A. Wainer,et al.  A Formal Framework for Stochastic Discrete Event System Specification Modeling and Simulation , 2010, Simul..

[22]  Mauro Iacono,et al.  Markovian Agent Models: A Dynamic Population of Interdependent Markovian Agents , 2016 .

[23]  William H. Sanders,et al.  "On-the-Fly'' Solution Techniques for Stochastic Petri Nets and Extensions , 1998, IEEE Trans. Software Eng..

[24]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .