Probabilistic Hyperproperties of Markov Decision Processes

Hyperproperties are properties that describe the correctness of a system as a relation between multiple executions. Hyperproperties generalize trace properties and include information-flow security requirements, like noninterference, as well as requirements like symmetry, partial observation, robustness, and fault tolerance. We initiate the study of the specification and verification of hyperproperties of Markov decision processes (MDPs). We introduce the temporal logic PHL (Probabilistic Hyper Logic), which extends classic probabilistic logics with quantification over schedulers and traces. PHL can express a wide range of hyperproperties for probabilistic systems, including both classical applications, such as probabilistic noninterference, and novel applications in areas such as robotics and planning. While the model checking problem for PHL is in general undecidable, we provide methods both for proving and for refuting formulas from a fragment of the logic. The fragment includes many probabilistic hyperproperties of interest.

[1]  Tomás Brázdil,et al.  Stochastic games with branching-time winning objectives , 2006, 21st Annual IEEE Symposium on Logic in Computer Science (LICS'06).

[2]  Bernd Finkbeiner,et al.  Synthesizing Reactive Systems from Hyperproperties , 2018, CAV.

[3]  Geoffrey Smith,et al.  Probabilistic noninterference in a concurrent language , 1998, Proceedings. 11th IEEE Computer Security Foundations Workshop (Cat. No.98TB100238).

[4]  David Sands,et al.  Probabilistic noninterference for multi-threaded programs , 2000, Proceedings 13th IEEE Computer Security Foundations Workshop. CSFW-13.

[5]  Cynthia Dwork,et al.  Differential Privacy , 2006, ICALP.

[6]  Erika Ábrahám,et al.  HyperPCTL: A Temporal Logic for Probabilistic Hyperproperties , 2018, QEST.

[7]  Bernd Finkbeiner,et al.  EAHyper: Satisfiability, Implication, and Equivalence Checking of Hyperproperties , 2017, CAV.

[8]  Christel Baier,et al.  Stochastic game logic , 2007, Fourth International Conference on the Quantitative Evaluation of Systems (QEST 2007).

[9]  Ezio Bartocci,et al.  Probabilistic Hyperproperties with Nondeterminism , 2020, ATVA.

[10]  Bernd Finkbeiner,et al.  Temporal Logics for Hyperproperties , 2013, POST.

[11]  Yu Wang,et al.  Statistical Model Checking for Probabilistic Hyperproperties , 2019, ArXiv.

[12]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[13]  Fred Kröger,et al.  Temporal Logic of Programs , 1987, EATCS Monographs on Theoretical Computer Science.

[14]  Christel Baier,et al.  Principles of model checking , 2008 .

[15]  Michael R. Clarkson,et al.  Information-flow security for interactive programs , 2006, 19th IEEE Computer Security Foundations Workshop (CSFW'06).

[16]  Bernd Finkbeiner,et al.  Algorithms for Model Checking HyperLTL and HyperCTL ^* , 2015, CAV.

[17]  Christopher Hahn,et al.  Constraint-Based Monitoring of Hyperproperties , 2019, TACAS.

[18]  Aniello Murano,et al.  Probabilistic Strategy Logic , 2019, IJCAI.

[19]  Umair Siddique,et al.  Rewriting-Based Runtime Verification for Alternation-Free HyperLTL , 2017, TACAS.

[20]  J. Meseguer,et al.  Security Policies and Security Models , 1982, 1982 IEEE Symposium on Security and Privacy.

[21]  John G. R. Jefferys,et al.  The Bionode , 2019, ACM Trans. Embed. Comput. Syst..

[22]  Marta Kwiatkowska,et al.  Probabilistic model checking: advances and applications , 2018 .

[23]  Christel Baier,et al.  On Model Checking Techniques for Randomized Distributed Systems , 2010, IFM.

[24]  Christel Baier,et al.  On Decision Problems for Probabilistic Büchi Automata , 2008, FoSSaCS.

[25]  James W. Gray,et al.  Toward a mathematical foundation for information flow security , 1991, Proceedings. 1991 IEEE Computer Society Symposium on Research in Security and Privacy.

[26]  Bernd Finkbeiner,et al.  Model Checking Quantitative Hyperproperties , 2018, CAV.

[27]  Michael R. Clarkson,et al.  Hyperproperties , 2008, 2008 21st IEEE Computer Security Foundations Symposium.

[28]  Yu Wang,et al.  Statistical Verification of Hyperproperties for Cyber-Physical Systems , 2019, ACM Trans. Embed. Comput. Syst..

[29]  Bernd Finkbeiner,et al.  Verifying Hyperliveness , 2020, CAV.