Automated Formal Synthesis of Neural Barrier Certificates for Dynamical Models

We introduce an automated, formal, counterexample-based approach to synthesise Barrier Certificates (BC) for the safety verification of continuous and hybrid dynamical models. The approach is underpinned by an inductive framework: this is structured as a sequential loop between a learner, which manipulates a candidate BC as a neural network, and a sound verifier, which either certifies through algorithmic proofs the candidate's validity or generates counter-examples to further guide the learner. We compare the approach against state-of-the-art techniques, over polynomial and non-polynomial dynamical models: the outcomes show that we can synthesise sound BCs up to two orders of magnitude faster, with in particular a stark speedup on the verification engine (up to five orders less), whilst needing a far smaller data set (up to three orders less) for the learning part. Beyond the state of the art, we further challenge the (verification side of the) approach on a hybrid dynamical model.

[1]  S. Sastry Nonlinear Systems: Analysis, Stability, and Control , 1999 .

[2]  Sanjit A. Seshia,et al.  Combinatorial sketching for finite programs , 2006, ASPLOS XII.

[3]  Russ Tedrake,et al.  Safety verification of reactive controllers for UAV flight in cluttered environments using barrier certificates , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  André Platzer,et al.  Vector Barrier Certificates and Comparison Systems , 2018, FM.

[5]  Edmund M. Clarke,et al.  δ-Complete Decision Procedures for Satisfiability over the Reals , 2012, IJCAR.

[6]  Xia Zeng,et al.  Darboux-type barrier certificates for safety verification of nonlinear hybrid systems , 2016, 2016 International Conference on Embedded Software (EMSOFT).

[7]  Edmund M. Clarke,et al.  Computing differential invariants of hybrid systems as fixedpoints , 2008, Formal Methods Syst. Des..

[8]  Alessandro Abate,et al.  Automated and Sound Synthesis of Lyapunov Functions with SMT Solvers , 2020, TACAS.

[9]  Edmund M. Clarke,et al.  dReal: An SMT Solver for Nonlinear Theories over the Reals , 2013, CADE.

[10]  Stephen Prajna Barrier certificates for nonlinear model validation , 2006, Autom..

[11]  Paulo Tabuada,et al.  Sum-of-Squares methods for controlled invariant sets with applications to model-predictive control , 2020 .

[12]  Ali Jadbabaie,et al.  Safety Verification of Hybrid Systems Using Barrier Certificates , 2004, HSCC.

[13]  Hui Kong,et al.  Exponential-Condition-Based Barrier Certificate Generation for Safety Verification of Hybrid Systems , 2013, CAV.

[14]  George J. Pappas,et al.  A Framework for Worst-Case and Stochastic Safety Verification Using Barrier Certificates , 2007, IEEE Transactions on Automatic Control.

[15]  Sriram Sankaranarayanan,et al.  Robust controller synthesis of switched systems using counterexample guided framework , 2016, 2016 International Conference on Embedded Software (EMSOFT).

[16]  Alessandro Abate,et al.  Automated Formal Synthesis of Lyapunov Neural Networks , 2020, ArXiv.

[17]  Sriram Sankaranarayanan,et al.  Learning control lyapunov functions from counterexamples and demonstrations , 2018, Autonomous Robots.

[18]  Andreas Krause,et al.  The Lyapunov Neural Network: Adaptive Stability Certification for Safe Learning of Dynamical Systems , 2018, CoRL.

[19]  Li Wang,et al.  Control Barrier Certificates for Safe Swarm Behavior , 2015, ADHS.

[20]  Sriram Sankaranarayanan,et al.  Counter-Example Guided Synthesis of control Lyapunov functions for switched systems , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[21]  Liang Zou,et al.  Abstraction of Elementary Hybrid Systems by Variable Transformation , 2014, FM.

[22]  Daniel Kroening,et al.  Unbounded-Time Safety Verification of Guarded LTI Models with Inputs by Abstract Acceleration , 2020, Journal of Automated Reasoning.

[23]  Daniel Kroening,et al.  Counterexample Guided Inductive Synthesis Modulo Theories , 2018, CAV.

[24]  Aaron D. Ames,et al.  Safety Barrier Certificates for Collisions-Free Multirobot Systems , 2017, IEEE Transactions on Robotics.

[25]  Taolue Chen,et al.  Synthesizing barrier certificates using neural networks , 2020, HSCC.

[26]  Nikolaj Bjørner,et al.  Z3: An Efficient SMT Solver , 2008, TACAS.

[27]  Rafael Wisniewski,et al.  Compositional safety analysis using barrier certificates , 2012, HSCC '12.

[28]  Xin Chen,et al.  Lyapunov Function Synthesis Using Handelman Representations , 2013, NOLCOS.

[29]  Alessandro Abate,et al.  Formal Synthesis of Lyapunov Neural Networks , 2021, IEEE Control Systems Letters.

[30]  Sicun Gao,et al.  Neural Lyapunov Control , 2020, NeurIPS.

[31]  Liyun Dai,et al.  Barrier certificates revisited , 2013, J. Symb. Comput..

[32]  Daniel Kroening,et al.  Decision Procedures - An Algorithmic Point of View , 2008, Texts in Theoretical Computer Science. An EATCS Series.