Learning to falsify automated driving vehicles with prior knowledge

While automated driving technology has achieved a tremendous progress, the scalable and rigorous testing and verification of safe automated and autonomous driving vehicles remain challenging. This paper proposes a learning-based falsification framework for testing the implementation of an automated or self-driving function in simulation. We assume that the function specification is associated with a violation metric on possible scenarios. Prior knowledge is incorporated to limit the scenario parameter variance and in a model-based falsifier to guide and improve the learning process. For an exemplary adaptive cruise controller, the presented framework yields non-trivial falsifying scenarios with higher reward, compared to scenarios obtained by purely learning-based or purely model-based falsification approaches.

[1]  Andreas Eggers,et al.  Constraint Systems from Traffic Scenarios for the Validation of Autonomous Driving (Extended Abstract) , 2018 .

[2]  Vladislav Nenchev,et al.  Layer-Stabilizing Deep Learning , 2019, IFAC-PapersOnLine.

[3]  Thomas A. Henzinger,et al.  Logics and Models of Real Time: A Survey , 1991, REX Workshop.

[4]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[5]  Matthias Althoff,et al.  Computationally Efficient Safety Falsification of Adaptive Cruise Control Systems , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[6]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[7]  George J. Pappas,et al.  Robustness of temporal logic specifications for continuous-time signals , 2009, Theor. Comput. Sci..

[8]  Matthias Althoff,et al.  Automatic Generation of Safety-Critical Test Scenarios for Collision Avoidance of Road Vehicles , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[9]  Georgios E. Fainekos,et al.  Functional gradient descent optimization for automatic test case generation for vehicle controllers , 2017, 2017 13th IEEE Conference on Automation Science and Engineering (CASE).

[10]  Russ Tedrake,et al.  Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulation , 2018, NeurIPS.

[11]  Sanjit A. Seshia,et al.  VerifAI: A Toolkit for the Formal Design and Analysis of Artificial Intelligence-Based Systems , 2019, CAV.

[12]  Shinichi Shiraishi,et al.  Testing Autonomous Vehicle Software in the Virtual Prototyping Environment , 2017, IEEE Embedded Systems Letters.

[13]  Stefan Kowalewski,et al.  Verification of Cooperative Vehicle Behavior using Temporal Logic , 2019 .

[14]  Ying-Chang Liang,et al.  Applications of Deep Reinforcement Learning in Communications and Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[15]  Paulo Tabuada,et al.  Correct-by-Construction Adaptive Cruise Control: Two Approaches , 2016, IEEE Transactions on Control Systems Technology.

[16]  Emilio Frazzoli,et al.  Liability, Ethics, and Culture-Aware Behavior Specification using Rulebooks , 2019, 2019 International Conference on Robotics and Automation (ICRA).