A two-phase approximation for model checking probabilistic unbounded until properties of probabilistic systems

We have developed a new approximate probabilistic model-checking method for untimed properties in probabilistic systems, expressed in a probabilistic temporal logic (PCTL, CSL). This method, in contrast to the existing ones, does not require the untimed until properties to be bounded a priori, where the bound refers to the number of discrete steps in the system required to verify the until property. The method consists of two phases. In the first phase, a suitable system- and property-dependent bound k0 is obtained automatically. In the second phase, the probability of satisfying the k0-bounded until property is computed as the estimate of the probability of satisfying the original unbounded until property. Both phases require only verification of bounded until properties, which can be effectively performed by simulation-based methods. We prove the correctness of the proposed two-phase method and present its optimized implementation in the widely used PRISM model-checking engine. We compare this implementation with sampling-based model-checking techniques implemented in two tools: PRISM and MRMC. We show that for several models these existing tools fail to compute the result, while the two-phase method successfully computes the result efficiently with respect to time and space.

[1]  Lars Grunske,et al.  Specification patterns for probabilistic quality properties , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[2]  Marta Z. Kwiatkowska,et al.  Using probabilistic model checking in systems biology , 2008, PERV.

[3]  Christel Baier,et al.  Model-Checking Algorithms for Continuous-Time Markov Chains , 2002, IEEE Trans. Software Eng..

[4]  Mihalis Yannakakis,et al.  The complexity of probabilistic verification , 1995, JACM.

[5]  Mahesh Viswanathan,et al.  On Statistical Model Checking of Stochastic Systems , 2005, CAV.

[6]  Michael K. Reiter,et al.  Crowds: anonymity for Web transactions , 1998, TSEC.

[7]  Håkan L. S. Younes,et al.  Numerical vs. statistical probabilistic model checking , 2006, International Journal on Software Tools for Technology Transfer.

[8]  Andrew Hinton,et al.  PRISM: A Tool for Automatic Verification of Probabilistic Systems , 2006, TACAS.

[9]  Håkan L. S. Younes,et al.  Statistical probabilistic model checking with a focus on time-bounded properties , 2006, Inf. Comput..

[10]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[11]  Håkan L. S. Younes,et al.  Probabilistic Verification of Discrete Event Systems Using Acceptance Sampling , 2002, CAV.

[12]  Joost-Pieter Katoen,et al.  A Markov reward model checker , 2005, Second International Conference on the Quantitative Evaluation of Systems (QEST'05).

[13]  Thomas Hérault,et al.  Approximate Probabilistic Model Checking , 2004, VMCAI.

[14]  Joost-Pieter Katoen,et al.  How Fast and Fat Is Your Probabilistic Model Checker? An Experimental Performance Comparison , 2007, Haifa Verification Conference.

[15]  Marie Duflot,et al.  A formal analysis of bluetooth device discovery , 2006, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[16]  Ivan S. Zapreev Model checking Markov chains : techniques and tools , 2008 .

[17]  Robert K. Brayton,et al.  Verifying Continuous Time Markov Chains , 1996, CAV.

[18]  R. Khan,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[19]  Marta Z. Kwiatkowska,et al.  Stochastic Model Checking , 2007, SFM.

[20]  Samik Basu,et al.  A bounded statistical approach for model checking of unbounded until properties , 2010, ASE.

[21]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[22]  Giovanni Denaro,et al.  ACM Transactions on Software Engineering and Methodology : Volume 22, Nomor 4, 2013 , 2014 .

[23]  Bengt Jonsson,et al.  A logic for reasoning about time and reliability , 1990, Formal Aspects of Computing.

[24]  Robert K. Brayton,et al.  Model-checking continuous-time Markov chains , 2000, TOCL.

[25]  Vitaly Shmatikov,et al.  Analysis of probabilistic contract signing , 2002, J. Comput. Secur..

[26]  A. Wald Sequential Tests of Statistical Hypotheses , 1945 .

[27]  Andrea Bianco,et al.  Model Checking of Probabalistic and Nondeterministic Systems , 1995, FSTTCS.

[28]  Joost-Pieter Katoen,et al.  Simulation-Based CTMC Model Checking: An Empirical Evaluation , 2009, 2009 Sixth International Conference on the Quantitative Evaluation of Systems.

[29]  P. Massart The Tight Constant in the Dvoretzky-Kiefer-Wolfowitz Inequality , 1990 .

[30]  Håkan L. S. Younes Ymer: A Statistical Model Checker , 2005, CAV.

[31]  Nihal Pekergin,et al.  Statistical Model Checking Using Perfect Simulation , 2009, ATVA.

[32]  Radu Grosu,et al.  Monte Carlo Model Checking , 2005, TACAS.

[33]  Mahesh Viswanathan,et al.  Statistical Model Checking of Black-Box Probabilistic Systems , 2004, CAV.

[34]  Axel Legay,et al.  Statistical Model Checking: An Overview , 2010, RV.

[35]  Vitaly Shmatikov,et al.  Analysis of probabilistic contract signing , 2006 .

[36]  K. Gopinath,et al.  Improved Probabilistic Models for 802.11 Protocol Verification , 2005, CAV.