Faster Statistical Model Checking for Unbounded Temporal Properties

We present a new algorithm for the statistical model checking of Markov chains with respect to unbounded temporal properties, including full linear temporal logic. The main idea is that we monitor each simulation run on the fly, in order to detect quickly if a bottom strongly connected component is entered with high probability, in which case the simulation run can be terminated early. As a result, our simulation runs are often much shorter than required by termination bounds that are computed a priori for a desired level of confidence on a large state space. In comparison to previous algorithms for statistical model checking our method is not only faster in many cases but also requires less information about the system, namely, only the minimum transition probability that occurs in the Markov chain. In addition, our method can be generalised to unbounded quantitative properties such as mean-payoff bounds.

[1]  Cyrille Jégourel,et al.  A Platform for High Performance Statistical Model Checking - PLASMA , 2012, TACAS.

[2]  Håkan L. S. Younes,et al.  Statistical Verification of Probabilistic Properties with Unbounded Until , 2010, SBMF.

[3]  Axel Legay,et al.  A Bayesian Approach to Model Checking Biological Systems , 2009, CMSB.

[4]  Alain Denise,et al.  Uniform Monte-Carlo Model Checking , 2011, FASE.

[5]  Samik Basu,et al.  A bounded statistical approach for model checking of unbounded until properties , 2010, ASE.

[6]  Christel Baier,et al.  Principles of Model Checking (Representation and Mind Series) , 2008 .

[7]  Krishnendu Chatterjee,et al.  Verification of Markov Decision Processes Using Learning Algorithms , 2014, ATVA.

[8]  Richard Lassaigne,et al.  Probabilistic verification and approximation , 2008, Ann. Pure Appl. Log..

[9]  Krishnendu Chatterjee,et al.  Robustness of Structurally Equivalent Concurrent Parity Games , 2011, FoSSaCS.

[10]  Thomas Hérault,et al.  Approximate Probabilistic Model Checking , 2004, VMCAI.

[11]  Christel Baier,et al.  Principles of model checking , 2008 .

[12]  Thomas A. Henzinger,et al.  Faster Statistical Model Checking for Unbounded Temporal Properties , 2015, TACAS.

[13]  Kim G. Larsen,et al.  UPPAAL-SMC: Statistical Model Checking for Priced Timed Automata , 2012, QAPL.

[14]  Håkan L. S. Younes.  Planning and Verification for Stochastic Processes with Asynchronous Events , 2004, AAAI.

[15]  Håkan L. S. Younes,et al.  Statistical probabilistic model checking with a focus on time-bounded properties , 2006, Inf. Comput..

[16]  Marta Z. Kwiatkowska,et al.  The PRISM Benchmark Suite , 2012, 2012 Ninth International Conference on Quantitative Evaluation of Systems.

[17]  Mahesh Viswanathan,et al.  Statistical Model Checking of Black-Box Probabilistic Systems , 2004, CAV.

[18]  Eilon Solan.  Continuity of the Value of Competitive Markov Decision Processes , 2003 .

[19]  Mahesh Viswanathan,et al.  On Statistical Model Checking of Stochastic Systems , 2005, CAV.

[20]  Amir Pnueli,et al.  The temporal logic of programs , 1977, 18th Annual Symposium on Foundations of Computer Science (sfcs 1977).

[21]  Nihal Pekergin,et al.  Statistical Model Checking Using Perfect Simulation , 2009, ATVA.

[22]  Radu Grosu,et al.  Monte Carlo Model Checking , 2005, TACAS.

[23]  D. Vere-Jones.  Markov Chains , 1972, Nature.

[24]  Thomas A. Henzinger,et al.  Linear Distances between Markov Chains , 2016, CONCUR.

[25]  Håkan L. S. Younes,et al.  Numerical vs. statistical probabilistic model checking , 2006, International Journal on Software Tools for Technology Transfer.

[26]  Håkan L. S. Younes,et al.  Probabilistic Verification of Discrete Event Systems Using Acceptance Sampling , 2002, CAV.

[27]  M. Siegle,et al.  Multi Terminal Binary Decision Diagrams to Represent and Analyse Continuous Time Markov Chains , 1999 .

[28]  Kim G. Larsen,et al.  Uppaal SMC tutorial , 2015, International Journal on Software Tools for Technology Transfer.

[29]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[30]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.