Advances in Probabilistic Model Checking

Probabilistic model checking is an automated verification method that aims to establish the correctness of probabilistic systems. Probability may arise, for example, due to failures of unreliable components, communication across lossy media, or through the use of randomisation in distributed protocols. Probabilistic model checking enables a range of exhaustive, quantitative analyses of properties such as "the probability of a message being delivered within 5ms is at least 0.89". In the last ten years, probabilistic model checking has been successfully applied to numerous real-world case studies, and is now a highly active field of research. This tutorial gives an introduction to probabilistic model checking, as well as presenting material on selected recent advances. The first half of the tutorial concerns two classical probabilistic models, discrete-time Markov chains and Markov decision processes, explaining the underlying theory and model checking algorithms for the temporal logic PCTL. The second half discusses two advanced topics: quantitative abstraction refinement and model checking for probabilistic timed automata. We also briefly summarise the functionality of the probabilistic model checker PRISM, the leading tool in the area.

[1]  J. Kemeny,et al.  Denumerable Markov chains , 1969 .

[2]  Luca de Alfaro,et al.  Symbolic Model Checking of Probabilistic Processes Using MTBDDs and the Kronecker Representation , 2000, TACAS.

[3]  Edmund M. Clarke,et al.  Design and Synthesis of Synchronization Skeletons Using Branching-Time Temporal Logic , 1981, Logic of Programs.

[4]  Hongyang Qu,et al.  Assume-Guarantee Verification for Probabilistic Systems , 2010, TACAS.

[5]  Moshe Y. Vardi Automatic verification of probabilistic concurrent finite state programs , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[6]  Pedro R. D'Argenio,et al.  Partial order reduction on concurrent probabilistic programs , 2004, First International Conference on the Quantitative Evaluation of Systems, 2004. QEST 2004. Proceedings..

[7]  Marta Z. Kwiatkowska,et al.  Game-Based Probabilistic Predicate Abstraction in PRISM , 2008, QAPL.

[8]  Marta Z. Kwiatkowska,et al.  Symbolic model checking for probabilistic timed automata , 2007, Inf. Comput..

[9]  Holger Hermanns,et al.  A Modest Approach to Checking Probabilistic Timed Automata , 2009, 2009 Sixth International Conference on the Quantitative Evaluation of Systems.

[10]  Christel Baier,et al.  Symbolic Model Checking for Probabilistic Processes , 1997, ICALP.

[11]  Christel Baier,et al.  Model checking for a probabilistic branching time logic with fairness , 1998, Distributed Computing.

[12]  Lubos Brim,et al.  ProbDiVinE-MC: Multi-core LTL Model Checker for Probabilistic Systems , 2008, 2008 Fifth International Conference on Quantitative Evaluation of Systems.

[13]  Christel Baier,et al.  Partial order reduction for probabilistic systems , 2004, First International Conference on the Quantitative Evaluation of Systems, 2004. QEST 2004. Proceedings..

[14]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[15]  Marta Z. Kwiatkowska,et al.  Game-based Abstraction for Markov Decision Processes , 2006, Third International Conference on the Quantitative Evaluation of Systems - (QEST'06).

[16]  Marta Z. Kwiatkowska,et al.  Symmetry Reduction for Probabilistic Model Checking , 2006, CAV.

[17]  Joost-Pieter Katoen,et al.  Approximate Parameter Synthesis for Probabilistic Time-Bounded Reachability , 2008, 2008 Real-Time Systems Symposium.

[18]  Andrea Bianco,et al.  Model Checking of Probabalistic and Nondeterministic Systems , 1995, FSTTCS.

[19]  Marta Z. Kwiatkowska,et al.  Probabilistic model checking in practice: case studies with PRISM , 2005, PERV.

[20]  Lijun Zhang,et al.  Probabilistic reachability for parametric Markov models , 2010, International Journal on Software Tools for Technology Transfer.

[21]  Marta Kwiatkowska,et al.  Verification of Real‐Time Probabilistic Systems , 2010 .

[22]  Thomas A. Henzinger,et al.  Hybrid numerical solution of the chemical master equation , 2010, CMSB '10.

[23]  Marta Z. Kwiatkowska,et al.  Automated Verification Techniques for Probabilistic Systems , 2011, SFM.

[24]  Mahesh Viswanathan,et al.  A counterexample-guided abstraction-refinement framework for markov decision processes , 2008, TOCL.

[25]  Lijun Zhang,et al.  Game-based Abstraction and Controller Synthesis for Probabilistic Hybrid Systems , 2011, 2011 Eighth International Conference on Quantitative Evaluation of SysTems.

[26]  Bengt Jonsson,et al.  A logic for reasoning about time and reliability , 1990, Formal Aspects of Computing.

[27]  Håkan L. S. Younes,et al.  Probabilistic Verification of Discrete Event Systems Using Acceptance Sampling , 2002, CAV.

[28]  Thomas Hérault,et al.  Approximate Probabilistic Model Checking , 2004, VMCAI.

[29]  Joost-Pieter Katoen,et al.  The Ins and Outs of the Probabilistic Model Checker MRMC , 2009, 2009 Sixth International Conference on the Quantitative Evaluation of Systems.

[30]  Pedro R. D'Argenio,et al.  Significant Diagnostic Counterexamples in Probabilistic Model Checking , 2008, Haifa Verification Conference.

[31]  Lijun Zhang,et al.  Probabilistic CEGAR , 2008, CAV.

[32]  Luca de Alfaro,et al.  Magnifying-Lens Abstraction for Markov Decision Processes , 2007, CAV.

[33]  Henrik Ejersbo Jensen,et al.  Reachability Analysis of Probabilistic Systems by Successive Refinements , 2001, PAPM-PROBMIV.

[34]  Marta Z. Kwiatkowska,et al.  A game-based abstraction-refinement framework for Markov decision processes , 2010, Formal Methods Syst. Des..

[35]  Edmund M. Clarke,et al.  Counterexample-guided abstraction refinement , 2003, 10th International Symposium on Temporal Representation and Reasoning, 2003 and Fourth International Conference on Temporal Logic. Proceedings..

[36]  Hans A. Hansson Time and probability in formal design of distributed systems , 1991, DoCS.

[37]  Mihalis Yannakakis,et al.  Verifying temporal properties of finite-state probabilistic programs , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[38]  Marta Z. Kwiatkowska,et al.  Performance analysis of probabilistic timed automata using digital clocks , 2003, Formal Methods Syst. Des..

[39]  T. Henzinger,et al.  Quantitative Synthesis for Concurrent Programs , 2011, CAV.

[40]  Nancy A. Lynch,et al.  Probabilistic Simulations for Probabilistic Processes , 1994, Nord. J. Comput..

[41]  Christel Baier,et al.  Quantitative Analysis under Fairness Constraints , 2009, ATVA.

[42]  Marta Z. Kwiatkowska,et al.  Probabilistic symbolic model checking with PRISM: a hybrid approach , 2004, International Journal on Software Tools for Technology Transfer.

[43]  Christel Baier,et al.  LiQuor: A tool for Qualitative and Quantitative Linear Time analysis of Reactive Systems , 2006, Third International Conference on the Quantitative Evaluation of Systems - (QEST'06).

[44]  Henrik Ejersbo Jensen Model Checking Probabilistic Real Time Systems , 1996 .

[45]  Marta Z. Kwiatkowska,et al.  Stochastic Games for Verification of Probabilistic Timed Automata , 2009, FORMATS.

[46]  R. Segala,et al.  Automatic Verification of Real-Time Systems with Discrete Probability Distributions , 1999, ARTS.

[47]  David Eisenstat,et al.  A Simple Population Protocol for Fast Robust Approximate Majority , 2007, DISC.

[48]  Lijun Zhang,et al.  PASS: Abstraction Refinement for Infinite Probabilistic Models , 2010, TACAS.

[49]  Micha Sharir,et al.  Termination of Probabilistic Concurrent Program , 1983, TOPL.

[50]  Christel Baier,et al.  Model-Checking Algorithms for Continuous-Time Markov Chains , 2002, IEEE Trans. Software Eng..

[51]  Husain Aljazzar,et al.  Directed Explicit State-Space Search in the Generation of Counterexamples for Stochastic Model Checking , 2010, IEEE Transactions on Software Engineering.

[52]  Javier Esparza,et al.  Probabilistic Abstractions with Arbitrary Domains , 2011, SAS.

[53]  Jasper Berendsen,et al.  Fortuna: Model Checking Priced Probabilistic Timed Automata , 2010, 2010 Seventh International Conference on the Quantitative Evaluation of Systems.

[54]  Marta Z. Kwiatkowska,et al.  Abstraction Refinement for Probabilistic Software , 2008, VMCAI.

[55]  Thomas A. Henzinger,et al.  Solving the chemical master equation using sliding windows , 2010, BMC Systems Biology.

[56]  Alastair F. Donaldson,et al.  Symmetry Reduction for Probabilistic Model Checking Using Generic Representatives , 2006, ATVA.

[57]  Roberto Segala,et al.  Modeling and verification of randomized distributed real-time systems , 1996 .

[58]  Joost-Pieter Katoen,et al.  Probably on Time and within BudgetOn Reachability in Priced Probabilistic Timed Automata , 2006, Third International Conference on the Quantitative Evaluation of Systems - (QEST'06).

[59]  Holger Hermanns,et al.  A Markov Chain Model Checker , 2000, TACAS.

[60]  S. Hart,et al.  Termination of Probabilistic Concurrent Programs. , 1982 .

[61]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[62]  Joost-Pieter Katoen,et al.  Counterexample Generation in Probabilistic Model Checking , 2009, IEEE Transactions on Software Engineering.

[63]  Krishnendu Chatterjee,et al.  Measuring and Synthesizing Systems in Probabilistic Environments , 2010, CAV.

[64]  Christel Baier,et al.  Principles of model checking , 2008 .

[65]  Stephan Merz,et al.  Modeling and verification of real-time systems : formalisms and software tools , 2008 .

[66]  Joost-Pieter Katoen,et al.  Bisimulation Minimisation Mostly Speeds Up Probabilistic Model Checking , 2007, TACAS.

[67]  Marta Z. Kwiatkowska,et al.  Stochastic Model Checking , 2007, SFM.