STL Robustness Risk over Discrete-Time Stochastic Processes

We present a framework to interpret signal temporal logic (STL) formulas over discretetime stochastic processes in terms of the induced risk. Each realization of a stochastic process either satisfies or violates an STL formula. In fact, we can assign a robustness value to each realization that indicates how robustly this realization satisfies an STL formula. We then define the risk of a stochastic process not satisfying an STL formula robustly, referred to as the STL robustness risk. In our definition, we permit general classes of risk measures such as, but not limited to, the conditional value-at-risk. While in general hard to compute, we propose an approximation of the STL robustness risk. This approximation has the desirable property of being an upper bound of the STL robustness risk when the chosen risk measure is monotone, a property satisfied by most risk measures. Motivated by the interest in data-driven approaches, we present a sampling-based method for estimating the approximate STL robustness risk from data for the value-at-risk. While we consider the value-at-risk, we highlight that such samplingbased methods are viable for other risk measures.

[1]  Ezio Bartocci,et al.  System design of stochastic models using robustness of temporal properties , 2015, Theor. Comput. Sci..

[2]  Frank Allgöwer,et al.  Learning an Approximate Model Predictive Controller With Guarantees , 2018, IEEE Control Systems Letters.

[3]  Dejan Nickovic,et al.  Temporal Logic as Filtering , 2016, HSCC.

[4]  Jyotirmoy V. Deshmukh,et al.  Specification Mining and Robust Design under Uncertainty , 2019, ACM Trans. Embed. Comput. Syst..

[5]  Sanjay P. Bhat,et al.  Concentration of risk measures: A Wasserstein distance approach , 2019, NeurIPS.

[6]  Calin Belta,et al.  Control from Signal Temporal Logic Specifications with Smooth Cumulative Quantitative Semantics , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[7]  Panagiotis Patrinos,et al.  Learning-Based Distributionally Robust Model Predictive Control of Markovian Switching Systems with Guaranteed Stability and Recursive Feasibility , 2020, 2020 59th IEEE Conference on Decision and Control (CDC).

[8]  Kevin M. Smith,et al.  A Risk-Sensitive Finite-Time Reachability Approach for Safety of Stochastic Dynamic Systems , 2019, 2019 American Control Conference (ACC).

[9]  David B. Brown,et al.  Large deviations bounds for estimating conditional value-at-risk , 2007, Oper. Res. Lett..

[10]  Calin Belta,et al.  Control in belief space with Temporal Logic specifications , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[11]  R. Rockafellar,et al.  Optimization of conditional value-at risk , 2000 .

[12]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[13]  Calin Belta,et al.  Metrics for Signal Temporal Logic Formulae , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[14]  George J. Pappas,et al.  Control Barrier Functions for Nonholonomic Systems under Risk Signal Temporal Logic Specifications , 2020, 2020 59th IEEE Conference on Decision and Control (CDC).

[15]  Eyke Hüllermeier,et al.  Qualitative Multi-Armed Bandits: A Quantile-Based Approach , 2015, ICML.

[16]  Rupak Majumdar,et al.  Shrinking Horizon Model Predictive Control With Signal Temporal Logic Constraints Under Stochastic Disturbances , 2017, IEEE Transactions on Automatic Control.

[17]  George J. Pappas,et al.  Robustness of temporal logic specifications for continuous-time signals , 2009, Theor. Comput. Sci..

[18]  Calin Belta,et al.  Formal Verification and Synthesis for Discrete-Time Stochastic Systems , 2015, IEEE Trans. Autom. Control..

[19]  Luke Fletcher,et al.  Probabilistic Risk Metrics for Navigating Occluded Intersections , 2019, IEEE Robotics and Automation Letters.

[20]  Philip S. Thomas,et al.  Concentration Inequalities for Conditional Value at Risk , 2019, ICML.

[21]  Ashish Kapoor,et al.  Safe Control under Uncertainty with Probabilistic Signal Temporal Logic , 2016, Robotics: Science and Systems.

[22]  Michael M. Zavlanos,et al.  Probabilistic Motion Planning Under Temporal Tasks and Soft Constraints , 2017, IEEE Transactions on Automatic Control.

[23]  R. Rockafellar,et al.  Conditional Value-at-Risk for General Loss Distributions , 2001 .

[24]  Fredrik Heintz,et al.  Incremental reasoning in probabilistic Signal Temporal Logic , 2020, Int. J. Approx. Reason..

[25]  Ezio Bartocci,et al.  On the Robustness of Temporal Properties for Stochastic Models , 2013, HSB.

[26]  Insoon Yang,et al.  Safety-Aware Optimal Control of Stochastic Systems Using Conditional Value-at-Risk , 2018, 2018 Annual American Control Conference (ACC).

[27]  Oded Maler,et al.  Robust Satisfaction of Temporal Logic over Real-Valued Signals , 2010, FORMATS.

[28]  Youngki Kim,et al.  Fast Risk-Sensitive Model Predictive Control for Systems with Time-Series Forecasting Uncertainties , 2020, 2020 59th IEEE Conference on Decision and Control (CDC).

[29]  Sanjit A. Seshia,et al.  Safe Autonomy Under Perception Uncertainty Using Chance-Constrained Temporal Logic , 2017, Journal of Automated Reasoning.

[30]  Aaron D. Ames,et al.  Risk-Averse Planning Under Uncertainty , 2019, 2020 American Control Conference (ACC).

[31]  George J. Pappas,et al.  Better Safe Than Sorry: Risk-Aware Nonlinear Bayesian Estimation , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  Alberto L. Sangiovanni-Vincentelli,et al.  Stochastic contracts for cyber-physical system design under probabilistic requirements , 2017, MEMOCODE.

[33]  O. Kallenberg Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[34]  Ichiro Hasuo,et al.  Time Robustness in MTL and Expressivity in Hybrid System Falsification , 2015, CAV.

[35]  P. Malliavin Infinite dimensional analysis , 1993 .

[36]  Marco Pavone,et al.  How Should a Robot Assess Risk? Towards an Axiomatic Theory of Risk in Robotics , 2017, ISRR.

[37]  Calin Belta,et al.  Arithmetic-Geometric Mean Robustness for Control from Signal Temporal Logic Specifications , 2019, 2019 American Control Conference (ACC).

[38]  Ufuk Topcu,et al.  Synthesis of Surveillance Strategies via Belief Abstraction , 2017, 2018 IEEE Conference on Decision and Control (CDC).

[39]  Marco Pavone,et al.  A Framework for Time-Consistent, Risk-Sensitive Model Predictive Control: Theory and Algorithms , 2019, IEEE Transactions on Automatic Control.

[40]  Dimos V. Dimarogonas,et al.  On Robustness Metrics for Learning STL Tasks , 2020, 2020 American Control Conference (ACC).

[41]  Tyler H. Summers,et al.  Control Design for Risk-Based Signal Temporal Logic Specifications , 2020, IEEE Control Systems Letters.

[42]  P. Massart The Tight Constant in the Dvoretzky-Kiefer-Wolfowitz Inequality , 1990 .

[43]  Robert C. Williamson,et al.  PAC-Bayesian Bound for the Conditional Value at Risk , 2020, NeurIPS.