Temporal Logic Verification of Stochastic Systems Using Barrier Certificates

This paper presents a methodology for temporal logic verification of discrete-time stochastic systems. Our goal is to find a lower bound on the probability that a complex temporal property is satisfied by finite traces of the system. Desired temporal properties of the system are expressed using a fragment of linear temporal logic, called safe LTL over finite traces. We propose to use barrier certificates for computations of such lower bounds, which is computationally much more efficient than the existing discretization-based approaches. The new approach is discretization-free and does not suffer from the curse of dimensionality caused by discretizing state sets. The proposed approach relies on decomposing the negation of the specification into a union of sequential reachabilities and then using barrier certificates to compute upper bounds for these reachability probabilities. We demonstrate the effectiveness of the proposed approach on case studies with linear and polynomial dynamics.

[1]  Vijay Kumar,et al.  Automated composition of motion primitives for multi-robot systems from safe LTL specifications , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  John S. Baras,et al.  Motion planning in dynamic environments with bounded time temporal logic specifications , 2015, 2015 23rd Mediterranean Conference on Control and Automation (MED).

[3]  Majid Zamani,et al.  QUEST: A Tool for State-Space Quantization-Free Synthesis of Symbolic Controllers , 2017, QEST.

[4]  T. Vincent,et al.  Control of a chaotic system , 1991 .

[5]  H. Kushner.  ON THE STABILITY OF STOCHASTIC DYNAMICAL SYSTEMS. , 1965, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Giuseppe De Giacomo,et al.  Linear Temporal Logic and Linear Dynamic Logic on Finite Traces , 2013, IJCAI.

[7]  Alexandre Duret-Lutz,et al.  Spot 2.0 - A Framework for LTL and \omega -Automata Manipulation , 2016, ATVA.

[8]  Rupak Majumdar,et al.  Dynamic Bayesian Networks as Formal Abstractions of Structured Stochastic Processes , 2015, CONCUR.

[9]  Alessandro Abate,et al.  Adaptive and Sequential Gridding Procedures for the Abstraction and Verification of Stochastic Processes , 2013, SIAM J. Appl. Dyn. Syst..

[10]  Paulo Tabuada.  Exact symbolic models for verification , 2009 .

[11]  Paulo Tabuada,et al.  Verification and Control of Hybrid Systems - A Symbolic Approach , 2009 .

[12]  Rupak Majumdar,et al.  Deductive control synthesis for alternating-time logics , 2014, 2014 International Conference on Embedded Software (EMSOFT).

[13]  S. Russel and P. Norvig,et al.  “Artificial Intelligence – A Modern Approach”, Second Edition, Pearson Education, 2003. , 2015 .

[14]  Dragan Nesic,et al.  Time-triggered control of nonlinear discrete-time systems , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[15]  Alessandro Abate,et al.  Formula-free finite abstractions for linear temporal verification of stochastic hybrid systems , 2013, HSCC '13.

[16]  Orna Kupferman,et al.  Model Checking of Safety Properties , 1999, CAV.

[17]  Pablo A. Parrilo,et al.  Semidefinite programming relaxations for semialgebraic problems , 2003, Math. Program..

[18]  Alessandro Abate,et al.  FAUST 2 : Formal Abstractions of Uncountable-STate STochastic Processes , 2014, TACAS.

[19]  Giuseppe De Giacomo,et al.  Synthesis for LTL and LDL on Finite Traces , 2015, IJCAI.

[20]  Russ Tedrake,et al.  Finite-time regional verification of stochastic non-linear systems , 2011, Int. J. Robotics Res..

[21]  Calin Belta,et al.  Probabilistic control from time-bounded temporal logic specifications in dynamic environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  C. Baier,et al.  Experiments with Deterministic ω-Automata for Formulas of Linear Temporal Logic , 2005 .

[23]  George J. Pappas,et al.  A Framework for Worst-Case and Stochastic Safety Verification Using Barrier Certificates , 2007, IEEE Transactions on Automatic Control.

[24]  Rafael Wisniewski,et al.  Stochastic safety analysis of stochastic hybrid systems , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[25]  Pablo A. Parrilo,et al.  Introducing SOSTOOLS: a general purpose sum of squares programming solver , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[26]  Alessandro Abate,et al.  Precise Approximations of the Probability Distribution of a Markov Process in Time: An Application to Probabilistic Invariance , 2014, TACAS.

[27]  Xin Chen,et al.  Probabilistic Safety Verification of Stochastic Hybrid Systems Using Barrier Certificates , 2017, ACM Trans. Embed. Comput. Syst..

[28]  Calin Belta,et al.  Formal Verification and Synthesis for Discrete-Time Stochastic Systems , 2015, IEEE Trans. Autom. Control..

[29]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[30]  Christel Baier,et al.  Principles of model checking , 2008 .

[31]  Joost-Pieter Katoen,et al.  Quantitative automata model checking of autonomous stochastic hybrid systems , 2011, HSCC '11.

[32]  Majid Zamani,et al.  From Dissipativity Theory to Compositional Construction of Finite Markov Decision Processes , 2017, HSCC.

[33]  Ufuk Topcu,et al.  Automata Theory Meets Barrier Certificates: Temporal Logic Verification of Nonlinear Systems , 2014, IEEE Transactions on Automatic Control.

[34]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[35]  Nils Klarlund,et al.  MONA: Monadic Second-Order Logic in Practice , 1995 .