A Barrier Function Approach to Finite-Time Stochastic System Verification and Control

This paper studies the problem of enforcing safety of a stochastic dynamical system over a finite-time horizon. We use stochastic control barrier functions as a means to quantify the probability that a system exits a given safe region of the state space in finite time. A barrier certificate condition that bounds the expected value of the barrier function over the time horizon is recast as a sum-of-squares optimization problem for efficient numerical computation. Unlike prior works, the proposed certificate condition includes a state-dependent upper bound on the evolution of the expectation. We present formulations for both continuous-time and discrete-time systems. Moreover, for systems for which the drift dynamics are affine-in-control, we propose a method for synthesizing polynomial state feedback controllers that achieve a specified probability of safety. Several case studies are presented which benchmark and illustrate the performance of our verification and control method in the continuous-time and discrete-time domains.

[1]  B. Øksendal Stochastic differential equations : an introduction with applications , 1987 .

[2]  M. Iannelli,et al.  An Introduction to Mathematical Population Dynamics: Along the trail of Volterra and Lotka , 2014 .

[3]  Aaron D. Ames,et al.  Input-to-State Safety With Control Barrier Functions , 2018, IEEE Control Systems Letters.

[4]  Kim-Chuan Toh,et al.  SDPT3 -- A Matlab Software Package for Semidefinite Programming , 1996 .

[5]  Aaron D. Ames,et al.  Control barrier function based quadratic programs with application to bipedal robotic walking , 2015, 2015 American Control Conference (ACC).

[6]  H. Kushner Stochastic Stability and Control , 2012 .

[7]  H. Kushner Finite time stochastic stability and the analysis of tracking systems , 1966 .

[8]  George J. Pappas,et al.  Stochastic safety verification using barrier certificates , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[9]  Russ Tedrake,et al.  Finite-time regional verification of stochastic non-linear systems , 2011, Int. J. Robotics Res..

[10]  Paulo Tabuada,et al.  Control Barrier Function Based Quadratic Programs for Safety Critical Systems , 2016, IEEE Transactions on Automatic Control.

[11]  Majid Zamani,et al.  Temporal Logic Verification of Stochastic Systems Using Barrier Certificates , 2018, ATVA.

[12]  Alessandro Abate,et al.  FAUST 2 : Formal Abstractions of Uncountable-STate STochastic Processes , 2014, TACAS.

[13]  Majid Zamani,et al.  Formal Synthesis of Stochastic Systems via Control Barrier Certificates , 2019, IEEE Transactions on Automatic Control.

[14]  Peter J Seiler,et al.  SOSTOOLS: Sum of squares optimization toolbox for MATLAB , 2002 .

[15]  K. Chung,et al.  Stochastic Stability and Control, Mathematics in Science and Engineering , 1972 .

[16]  Li Wang,et al.  Formally Correct Composition of Coordinated Behaviors Using Control Barrier Certificates , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Kim-Chuan Toh,et al.  Solving semidefinite-quadratic-linear programs using SDPT3 , 2003, Math. Program..

[18]  George J. Pappas,et al.  A Framework for Worst-Case and Stochastic Safety Verification Using Barrier Certificates , 2007, IEEE Transactions on Automatic Control.

[19]  Meeko M. K. Oishi,et al.  SReachTools: a MATLAB stochastic reachability toolbox , 2019, HSCC.

[20]  Aaron D. Ames,et al.  Safety Barrier Certificates for Collisions-Free Multirobot Systems , 2017, IEEE Transactions on Robotics.

[21]  Paulo Tabuada,et al.  Control barrier function based quadratic programs with application to adaptive cruise control , 2014, 53rd IEEE Conference on Decision and Control.

[22]  Joel W. Burdick,et al.  Safe Policy Synthesis in Multi-Agent POMDPs via Discrete-Time Barrier Functions , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[23]  H. Kushner Introduction to stochastic control , 1971 .

[24]  Samuel Coogan,et al.  Verification and Control for Finite-Time Safety of Stochastic Systems via Barrier Functions , 2019, 2019 IEEE Conference on Control Technology and Applications (CCTA).

[25]  Koushil Sreenath,et al.  Discrete Control Barrier Functions for Safety-Critical Control of Discrete Systems with Application to Bipedal Robot Navigation , 2017, Robotics: Science and Systems.

[26]  Paulo Tabuada,et al.  Control Barrier Functions: Theory and Applications , 2019, 2019 18th European Control Conference (ECC).

[27]  Frank Allgöwer,et al.  CONSTRUCTIVE SAFETY USING CONTROL BARRIER FUNCTIONS , 2007 .