Memory Efficient Iterative Methods for Stochastic Automata Networks

We present new algorithms for computing the solution of large Markov chain models whose generators can be represented in the form of a generalized tensor algebra, such as networks of stochastic automata. The tensorial structure implies to work on a product space. Inside this product space, the reachable state space can be much smaller. For these cases, we propose two improvements of the standard numerical algorithm (based on tensor products), called «shuffle algorithm», that take as input-output only data structures of the size of the reachable state space. One of the improveme- nts allows a gain on the computation time, and the other one on the memory requirements. With those contributions, the numerical algorithms based on tensor products can deal with larger models.

[1]  Peter Kemper Numerical Analysis of Superposed GSPNs , 1996, IEEE Trans. Software Eng..

[2]  Susanna Donatelli,et al.  Superposed Stochastic Automata: A Class of Stochastic Petri Nets with Parallel Solution and Distributed State Space , 1993, Perform. Evaluation.

[3]  Jean-Michel Fourneau,et al.  PEPS: A Package for Solving Complex Markov Models of Parallel Systems , 1989 .

[4]  Paulo Fernandes,et al.  Optimizing tensor product computations in stochastic automata networks , 1998 .

[5]  William J. Stewart,et al.  Introduction to the numerical solution of Markov Chains , 1994 .

[6]  Peter Buchholz,et al.  Complexity of Memory-Efficient Kronecker Operations with Applications to the Solution of Markov Models , 2000, INFORMS J. Comput..

[7]  Paulo Fernandes,et al.  Efficient descriptor-vector multiplications in stochastic automata networks , 1998, JACM.

[8]  Susanna Donatelli,et al.  Superposed Generalized Stochastic Petri Nets: Definition and Efficient Solution , 1994, Application and Theory of Petri Nets.

[9]  Brigitte Plateau On the stochastic structure of parallelism and synchronization models for distributed algorithms , 1985, SIGMETRICS 1985.

[10]  Paulo Fernandes Méthodes numériques pour la solution de systèmes Markoviens à grand espace d'états. (Numerical methods to solve Markovian systems with large state space) , 1998 .

[11]  Peter Buchholz,et al.  Hierarchical structuring of superposed GSPNs , 1997, Proceedings of the Seventh International Workshop on Petri Nets and Performance Models.

[12]  Gianfranco Ciardo,et al.  A data structure for the efficient Kronecker solution of GSPNs , 1999, Proceedings 8th International Workshop on Petri Nets and Performance Models (Cat. No.PR00331).

[13]  Peter Kemper Reachability Analysis Based on Structured Representations , 1996, Application and Theory of Petri Nets.

[14]  M. Siegle,et al.  Multi Terminal Binary Decision Diagrams to Represent and Analyse Continuous Time Markov Chains , 1999 .