Efficient Verification of Control Systems with Neural Network Controllers

Recently, many state-of-art machine learning methods have been applied to Autonomous cyber-physical systems (CPS) which need high safe insurance. This paper develops an effective way to approximate the reachable set of a closed-loop discrete linear dynamic system with a Neural network(NN) controller, whose activation function is Rectified Linear Unit(ReLU). In our method, we choose SHERLOCK, a valid NN verification tool, to estimate the output set of NN and adopt initial state set partitioning to improve the total performance. The approach is evaluated on numerical examples and shows evident superiority to the method before refined.

[1]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[2]  Weiming Xiang,et al.  Reachability Analysis and Safety Verification for Neural Network Control Systems , 2018, ArXiv.

[3]  Xin Chen,et al.  Flow*: An Analyzer for Non-linear Hybrid Systems , 2013, CAV.

[4]  Mykel J. Kochenderfer,et al.  Policy compression for aircraft collision avoidance systems , 2016, 2016 IEEE/AIAA 35th Digital Avionics Systems Conference (DASC).

[5]  Mykel J. Kochenderfer,et al.  Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks , 2017, CAV.

[6]  Xiaowei Huang,et al.  Reachability Analysis of Deep Neural Networks with Provable Guarantees , 2018, IJCAI.

[7]  Ashish Tiwari,et al.  Output Range Analysis for Deep Neural Networks , 2017, ArXiv.

[8]  Luca Pulina,et al.  An Abstraction-Refinement Approach to Verification of Artificial Neural Networks , 2010, CAV.

[9]  Antoine Girard,et al.  SpaceEx: Scalable Verification of Hybrid Systems , 2011, CAV.

[10]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[11]  Min Wu,et al.  Safety Verification of Deep Neural Networks , 2016, CAV.

[12]  Weiming Xiang,et al.  Reachable Set Estimation and Verification for Neural Network Models of Nonlinear Dynamic Systems , 2018, Safe, Autonomous and Intelligent Vehicles.

[13]  Weiming Xiang,et al.  Reachable Set Estimation and Safety Verification for Piecewise Linear Systems with Neural Network Controllers , 2018, 2018 Annual American Control Conference (ACC).

[14]  Antonio Criminisi,et al.  Measuring Neural Net Robustness with Constraints , 2016, NIPS.