Learning-Based Stochastic Driving Model for Autonomous Vehicle Testing

In the simulation-based testing and evaluation of autonomous vehicles (AVs), how background vehicles (BVs) drive directly influences the AV’s driving behavior and further affects the test results. Most existing simulation platforms use either predetermined trajectories or deterministic driving models to model BV behaviors. However, predetermined BV trajectories cannot react to AV maneuvers, and deterministic models are different from real human drivers because of the lack of stochastic components and errors. Both methods lead to unrealistic traffic scenarios. This paper presents a learning-based stochastic driving model that meets the unique needs of AV testing (i.e., interactive and human-like stochasticity). The model is built based on the long short-term memory architecture. By incorporating the concept of quantile regression into the loss function of the model, the stochastic behaviors are reproduced without prior assumption of human drivers. The model is trained with the large-scale naturalistic driving data (NDD) from the Safety Pilot Model Deployment project and compared with a stochastic intelligent driving model (IDM). Analysis of individual trajectories shows that the proposed model can reproduce more similar trajectories of human drivers than IDM. To validate the ability of the proposed model in generating a naturalistic driving environment, traffic simulation experiments are implemented. The results show that traffic flow parameters such as speed, range, and time headway distribution match closely with the NDD, which is of significant importance for AV testing and evaluation.

[1]  D. W. Scott,et al.  Variable Kernel Density Estimation , 1992 .

[2]  R. Jiang,et al.  Full velocity difference model for a car-following theory. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Jiheng Huang,et al.  Physics Informed Deep Learning for Traffic State Estimation , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[4]  Dirk Helbing,et al.  Understanding widely scattered traffic flows, the capacity drop, and platoons as effects of variance-driven time gaps. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Shandian Zhe,et al.  Macroscopic Traffic Flow Modeling with Physics Regularized Gaussian Process: A New Insight into Machine Learning Applications , 2020, Transportation Research Part B: Methodological.

[6]  Jorge A. Laval,et al.  A parsimonious model for the formation of oscillations in car-following models , 2014 .

[7]  W. Sievert European New Car Assessment Programme (Euro NCAP) , 2000 .

[8]  Nakayama,et al.  Dynamical model of traffic congestion and numerical simulation. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[9]  Gordon F. Newell,et al.  A simplified car-following theory: a lower order model , 2002 .

[10]  Li Li,et al.  A Theoretical Foundation of Intelligence Testing and Its Application for Intelligent Vehicles , 2021, IEEE Transactions on Intelligent Transportation Systems.

[11]  Victor Chernozhukov,et al.  Quantile regression , 2019, Journal of Econometrics.

[12]  Yiheng Feng,et al.  Testing Scenario Library Generation for Connected and Automated Vehicles, Part II: Case Studies , 2019, IEEE Transactions on Intelligent Transportation Systems.

[13]  Yiheng Feng,et al.  Testing Scenario Library Generation for Connected and Automated Vehicles: An Adaptive Framework , 2020 .

[14]  Seungwuk Moon,et al.  Design, tuning, and evaluation of a full-range adaptive cruise control system with collision avoidance , 2009 .

[15]  Yi Zhang,et al.  Testing Scenario Library Generation for Connected and Automated Vehicles, Part I: Methodology , 2019, IEEE Transactions on Intelligent Transportation Systems.

[16]  Ali Ghaffari,et al.  A Modified Car-Following Model Based on a Neural Network Model of the Human Driver Effects , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[17]  Yiheng Feng,et al.  Safety assessment of highly automated driving systems in test tracks: A new framework. , 2020, Accident; analysis and prevention.

[18]  Xiaobo Qu,et al.  A recurrent neural network based microscopic car following model to predict traffic oscillation , 2017 .

[19]  Meixin Zhu,et al.  Human-Like Autonomous Car-Following Model with Deep Reinforcement Learning , 2018, Transportation Research Part C: Emerging Technologies.

[20]  Alberto Arcidiacono ADAS virtual validation: ACC and AEB case study with IPG CarMaker , 2018 .

[21]  Huei Peng,et al.  Development of an errorable car-following driver model , 2010 .

[22]  Li Li,et al.  Vehicle headway modeling and its inferences in macroscopic/microscopic traffic flow theory: A survey , 2017 .

[23]  Li Li,et al.  Long memory is important: A test study on deep-learning based car-following model , 2019, Physica A: Statistical Mechanics and its Applications.

[24]  P. G. Gipps,et al.  A behavioural car-following model for computer simulation , 1981 .

[25]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[26]  D. Manocha,et al.  AADS: Augmented autonomous driving simulation using data-driven algorithms , 2019, Science Robotics.

[27]  Nanning Zheng,et al.  Parallel testing of vehicle intelligence via virtual-real interaction , 2019, Science Robotics.

[28]  R. Koenker,et al.  Regression Quantiles , 2007 .

[29]  Henry X. Liu,et al.  Intelligent driving intelligence test for autonomous vehicles with naturalistic and adversarial environment , 2021, Nature Communications.

[30]  Eric Thorn,et al.  A Framework for Automated Driving System Testable Cases and Scenarios , 2018 .

[31]  Nidhi Kalra,et al.  Driving to Safety , 2016 .

[32]  Juan Zhicai,et al.  Develop a car-following model using data collected by "five-wheel system" , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[33]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[34]  Ding Zhao,et al.  Accelerated Evaluation of Automated Vehicles in Car-Following Maneuvers , 2016, IEEE Transactions on Intelligent Transportation Systems.