Reachable Set Estimation and Safety Verification for Piecewise Linear Systems with Neural Network Controllers

In this work, the reachable set estimation and safety verification problems for a class of piecewise linear systems equipped with neural network controllers are addressed. The neural network is considered to consist of Rectified Linear Unit (ReLU) activation functions. A layer-by-layer approach is developed for the output reachable set computation of ReLU neural networks. The computation is formulated in the form of a set of manipulations for a union of polytopes. Based on the output reachable set for neural network controllers, the output reachable set for a piecewise linear feedback control system can be estimated iteratively for a given finite-time interval. With the estimated output reachable set, the safety verification for piecewise linear systems with neural network controllers can be performed by checking the existence of intersections of unsafe regions and output reach set. A numerical example is presented to illustrate the effectiveness of our approach.

[1]  James Lam,et al.  Estimation and synthesis of reachable set for switched linear systems , 2016, Autom..

[2]  Weiming Xiang,et al.  Output Reachable Set Estimation and Verification for Multilayer Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Weiming Xiang,et al.  Output Reachable Set Estimation for Switched Linear Systems and Its Application in Safety Verification , 2017, IEEE Transactions on Automatic Control.

[4]  Yijing Wang,et al.  A non-ellipsoidal reachable set estimation for uncertain neural networks with time-varying delay , 2014, Commun. Nonlinear Sci. Numer. Simul..

[5]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[6]  Min Wu,et al.  Safety Verification of Deep Neural Networks , 2016, CAV.

[7]  James Lam,et al.  Stability analysis and L1-gain characterization for switched positive systems under dwell-time constraint , 2017, Autom..

[8]  Tao Zhang,et al.  Adaptive neural network control of nonlinear systems by state and output feedback , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Weiming Xiang,et al.  Robust Exponential Stability and Disturbance Attenuation for Discrete-Time Switched Systems Under Arbitrary Switching , 2018, IEEE Transactions on Automatic Control.

[10]  R. Decarlo,et al.  Perspectives and results on the stability and stabilizability of hybrid systems , 2000, Proceedings of the IEEE.

[11]  Hai Lin,et al.  Stability and Stabilizability of Switched Linear Systems: A Survey of Recent Results , 2009, IEEE Transactions on Automatic Control.

[12]  Weiming Xiang Necessary and Sufficient Condition for Stability of Switched Uncertain Linear Systems Under Dwell-Time Constraint , 2016, IEEE Transactions on Automatic Control.

[13]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[14]  Mykel J. Kochenderfer,et al.  Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks , 2017, CAV.

[15]  Zheng-Guang Wu,et al.  Reachable Set Estimation for Markovian Jump Neural Networks With Time-Varying Delays , 2017, IEEE Transactions on Cybernetics.

[16]  Weiming Xiang,et al.  Parameter-memorized Lyapunov functions for discrete-time systems with time-varying parametric uncertainties , 2018, Autom..

[17]  Daniel Liberzon,et al.  Switching in Systems and Control , 2003, Systems & Control: Foundations & Applications.

[18]  Weiming Xiang,et al.  On reachable set estimation for discrete-time switched linear systems under arbitrary switching , 2017, 2017 American Control Conference (ACC).

[19]  Luca Pulina,et al.  An Abstraction-Refinement Approach to Verification of Artificial Neural Networks , 2010, CAV.

[20]  Weiming Xiang,et al.  Reachable Set Computation and Safety Verification for Neural Networks with ReLU Activations , 2017, ArXiv.

[21]  Weiming Xiang,et al.  Mode-identifying time estimation and switching-delay tolerant control for switched systems: An elementary time unit approach , 2016, Autom..