Salus: A Novel Data-Driven Monitor that Enables Real-Time Safety in Autonomous Driving Systems

This paper proposes Salus, a data-driven real-time safety monitor, that detects and mitigates safety violations of an autonomous vehicle (AV). The key insight is that traffic situations that lead to AV safety violations fall into patterns and can be identified by learning from the safety violations of the AV. Our approach is to use machine learning (ML) techniques to model the traffic behaviors that result in safety violations in the AV, characterize their early symptoms for training a preemptive model, hence deploy and detect real-time safety violations before the actual crashes happen to the AV. In order to train our ML model, we leverage a pipeline of fuzzing techniques to tailor AV-specific safety violation symptoms and generate the training data via data argumentation techniques. Our evaluation demonstrates our proposed technique is effective in reducing over 97.2% of safety violations in industry-level autonomous driving systems, such as Baidu Apollo, with no more than 0.018 false positive values.

[1]  C. Laugier,et al.  Using Formal Conformance Testing to Generate Scenarios for Autonomous Vehicles , 2022, 2022 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[2]  T. Jaakkola,et al.  Conformal Prediction Sets with Limited False Positives , 2022, ICML.

[3]  Jun Sun,et al.  Route Coverage Testing for Autonomous Vehicles via Map Modeling , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Zahra Ghodsi,et al.  Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehicles , 2021, 2021 IEEE Intelligent Vehicles Symposium (IV).

[5]  Saurabh Jha,et al.  AV-FUZZER: Finding Safety Violations in Autonomous Driving Systems , 2020, 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE).

[6]  Cen Zhang,et al.  MUZZ: Thread-aware Grey-box Fuzzing for Effective Bug Hunting in Multithreaded Programs , 2020, USENIX Security Symposium.

[7]  Alaa Tharwat,et al.  Classification assessment methods , 2020, Applied Computing and Informatics.

[8]  Joshua Garcia,et al.  A Comprehensive Study of Autonomous Vehicle Bugs , 2020, 2020 IEEE/ACM 42nd International Conference on Software Engineering (ICSE).

[9]  Yang Liu,et al.  Cerebro: context-aware adaptive fuzzing for effective vulnerability detection , 2019, ESEC/SIGSOFT FSE.

[10]  Peng Li,et al.  SAVIOR: Towards Bug-Driven Hybrid Testing , 2019, 2020 IEEE Symposium on Security and Privacy (SP).

[11]  Ravishankar K. Iyer,et al.  ML-Based Fault Injection for Autonomous Vehicles: A Case for Bayesian Fault Injection , 2019, 2019 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN).

[12]  Christof Fetzer,et al.  SpecFuzz: Bringing Spectre-type vulnerabilities to the surface , 2019, USENIX Security Symposium.

[13]  Ole J. Mengshoel,et al.  Adaptive Stress Testing: Finding Failure Events with Reinforcement Learning , 2018, ArXiv.

[14]  Robyn R. Lutz,et al.  Safe-AR: Reducing Risk While Augmenting Reality , 2018, 2018 IEEE 29th International Symposium on Software Reliability Engineering (ISSRE).

[15]  Daniel J. Fremont,et al.  Scenic: a language for scenario specification and scene generation , 2018, PLDI.

[16]  Xin Xu,et al.  Baidu Apollo Auto-Calibration System - An Industry-Level Data-Driven and Learning based Vehicle Longitude Dynamic Calibrating Algorithm , 2018, ArXiv.

[17]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[18]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[19]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[20]  Barton P. Miller,et al.  An empirical study of the reliability of UNIX utilities , 1990, Commun. ACM.

[21]  Wassim G. Najm,et al.  Pre-Crash Scenario Typology for Crash Avoidance Research , 2007 .