Minimizing Expected Cost Under Hard Boolean Constraints, with Applications to Quantitative Synthesis

In Boolean synthesis, we are given an LTL specification, and the goal is to construct a transducer that realizes it against an adversarial environment. Often, a specification contains both Boolean requirements that should be satisfied against an adversarial environment, and multi-valued components that refer to the quality of the satisfaction and whose expected cost we would like to minimize with respect to a probabilistic environment. In this work we study, for the first time, mean-payoff games in which the system aims at minimizing the expected cost against a probabilistic environment, while surely satisfying an $\omega$-regular condition against an adversarial environment. We consider the case the $\omega$-regular condition is given as a parity objective or by an LTL formula. We show that in general, optimal strategies need not exist, and moreover, the limit value cannot be approximated by finite-memory strategies. We thus focus on computing the limit-value, and give tight complexity bounds for synthesizing $\epsilon$-optimal strategies for both finite-memory and infinite-memory strategies. We show that our game naturally arises in various contexts of synthesis with Boolean and multi-valued objectives. Beyond direct applications, in synthesis with costs and rewards to certain behaviors, it allows us to compute the minimal sensing cost of $\omega$-regular specifications -- a measure of quality in which we look for a transducer that minimizes the expected number of signals that are read from the input.

[1]  Amir Pnueli,et al.  On the synthesis of a reactive module , 1989, POPL '89.

[2]  Krishnendu Chatterjee,et al.  Energy and Mean-Payoff Parity Markov Decision Processes , 2011, MFCS.

[3]  Krishnendu Chatterjee,et al.  Unifying Two Views on Multiple Mean-Payoff Objectives in Markov Decision Processes , 2015, 2015 30th Annual ACM/IEEE Symposium on Logic in Computer Science.

[4]  Oleg Rokhlenko,et al.  SAT-based synthesis of clock gating functions using 3-valued abstraction , 2009, 2009 Formal Methods in Computer-Aided Design.

[5]  Orna Kupferman,et al.  Formalizing and Reasoning about Quality , 2013, ICALP.

[6]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[7]  Cindy Eisner,et al.  Functional verification of power gated designs by compositional reasoning , 2009, Formal Methods Syst. Des..

[8]  Krishnendu Chatterjee,et al.  Perfect-Information Stochastic Mean-Payoff Parity Games , 2014, FoSSaCS.

[9]  Pierre Wolper,et al.  Reasoning About Infinite Computations , 1994, Inf. Comput..

[10]  Véronique Bruyère,et al.  Meet Your Expectations With Guarantees: Beyond Worst-Case Synthesis in Quantitative Games , 2013, STACS.

[11]  Thomas A. Henzinger,et al.  Model checking discounted temporal properties , 2005, Theor. Comput. Sci..

[12]  Krishnendu Chatterjee,et al.  Efficient and Dynamic Algorithms for Alternating Büchi Games and Maximal End-Component Decomposition , 2014, J. ACM.

[13]  A. Pnueli The Temporal Semantics of Concurrent Programs , 1979, Theor. Comput. Sci..

[14]  Lorenzo Clemente,et al.  Multidimensional beyond Worst-Case and Almost-Sure Problems for Mean-Payoff Objectives , 2015, 2015 30th Annual ACM/IEEE Symposium on Logic in Computer Science.

[15]  W. Marsden I and J , 2012 .

[16]  Bernd Finkbeiner,et al.  Synthesis of Reactive Systems , 2016, Dependable Software Systems Engineering.

[17]  Orna Kupferman,et al.  The Sensing Cost of Monitoring and Synthesis , 2015, FSTTCS.

[18]  Orna Kupfermant,et al.  Synthesis with Incomplete Informatio , 2000 .

[19]  Orna Kupferman,et al.  Regular Sensing , 2014, FSTTCS.

[20]  M. Raj Mohan,et al.  Averaging in LTL , 2014, CONCUR.