Reliable sequential testing for statistical model checking

We introduce a framework for comparing statistical model checking (SMC) techniques and propose a new, more reliable, SMC technique. Statistical model checking has recently been implemented in tools like UPPAAL and PRISM to be able to handle models which are too complex for numerical analysis. However, these techniques turn out to have shortcomings, most notably that the validity of their outcomes depends on parameters that must be chosen a priori. Our new technique does not have this problem; we prove its correctness, and numerically compare its performance to existing techniques.

[1]  Marta Z. Kwiatkowska,et al.  PRISM: Probabilistic Symbolic Model Checker , 2002, Computer Performance Evaluation / TOOLS.

[2]  H. Robbins,et al.  Some nonparametric sequential tests with power one. , 1968, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Thomas Hérault,et al.  Approximate Probabilistic Model Checking , 2004, VMCAI.

[4]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[5]  Boudewijn R. Haverkort,et al.  On hypothesis testing for statistical model checking , 2015, International Journal on Software Tools for Technology Transfer.

[6]  Axel Legay,et al.  Statistical Model Checking: An Overview , 2010, RV.

[7]  Håkan L. S. Younes,et al.  Probabilistic Verification of Discrete Event Systems Using Acceptance Sampling , 2002, CAV.

[8]  Axel Legay,et al.  A Bayesian Approach to Model Checking Biological Systems , 2009, CMSB.

[9]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.