Improving Stochastic Model Checking with Stochastic Bounds

Stochastic model checking requires the computation of steady-state or transient distribution for finite or infinite Markov chains for the evaluation of some formulas implying probabilities. However the numerical analysis of Markov chains is much less efficient than the sophisticated algorithmic techniques such as MTBDD developed for the deterministic model checking. We propose to simplify the numerical evaluation of probabilities using stochastic bounds. We show that this approach can be used to bound transient, steady-state and cumulative rewards and may help to evaluate efficiently formulas based on these rewards.

[1]  Christel Baier,et al.  Model checking performability properties , 2002, Proceedings International Conference on Dependable Systems and Networks.

[2]  Ward Whitt,et al.  Comparison methods for queues and other stochastic models , 1986 .

[3]  William J. Stewart,et al.  Introduction to the numerical solution of Markov Chains , 1994 .

[4]  Robert K. Brayton,et al.  Verifying Continuous Time Markov Chains , 1996, CAV.

[5]  N. M. Van Dijk.  Error bound analysis for queueing networks , 1994 .

[6]  Bengt Jonsson,et al.  A logic for reasoning about time and reliability , 1990, Formal Aspects of Computing.

[7]  Holger Hermanns,et al.  Discrete-time rewards model-checked (to appear) , 2003 .

[8]  Jean-Michel Fourneau,et al.  An algorithmic and numerical approach to bound the performance of high speed networks , 2002, Proceedings. 10th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems.

[9]  Marta Z. Kwiatkowska,et al.  PRISM: Probabilistic Symbolic Model Checker , 2002, Computer Performance Evaluation / TOOLS.

[10]  Pierre Semal,et al.  Computable Bounds for Conditional Steady-State Probabilities in Large Markov Chains and Queueing Models , 1986, IEEE J. Sel. Areas Commun..

[11]  Jean-Michel Fourneau,et al.  An Algorithmic Approach to Stochastic Bounds , 2002, Performance.

[12]  J. Fourneau,et al.  Algorithms for an irreducible and lumpable strong stochastic bound , 2004 .