Backpropagation through Simulation: A Training Method for Neural Network-based Car-following

Learning human’s car-following behavior needs not only well-designed models but also effective training or calibration methods. Comparing with the vast amount of efforts on car-following modeling in literature, training methods are less studied. This research proposes a training method (BPTS - Backpropagation through Simulation) to reduce the long-term error of neural network-based car-following models, with multiple experimental validations. The training method uses a recurrent framework with simulation to generate long-term predictions for generic car-following models, and use gradient backpropagation to reduce accumulative error. The proposed training method can also calibrate other car-following models besides neural network-based models. In experimental validation, our studies yielded more than 30% error reduction in long-term (20 s) prediction for feed-forward Artificial Neural Network (ANN) and Long short-term memory (LSTM) models, and reduces the error on vehicle position by more than 1.0 meters, at the cost of that short-term (0.2 s) prediction error slightly increases. The proposed training method dramatically reduces the long-term prediction error of neural network-based car-following models.

[1]  Hussein Dia,et al.  Neural Agent Car-Following Models , 2007, IEEE Transactions on Intelligent Transportation Systems.

[2]  Ali Ghaffari,et al.  A Modified Car-Following Model Based on a Neural Network Model of the Human Driver Effects , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[3]  Kenneth L Campbell The SHRP 2 Naturalistic Driving Study: Addressing Driver Performance and Behavior in Traffic Safety , 2012 .

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Mohan M. Trivedi,et al.  Trajectories and Maneuvers of Surrounding Vehicles With Panoramic Camera Arrays , 2016, IEEE Transactions on Intelligent Vehicles.

[6]  Martin Treiber,et al.  Calibrating Car-Following Models by Using Trajectory Data , 2008, 0803.4063.

[7]  Mike McDonald,et al.  Car-following: a historical review , 1999 .

[8]  Kazuya Takeda,et al.  Modeling and adaptation of stochastic driver-behavior model with application to car following , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  Mykel J. Kochenderfer,et al.  Analysis of Recurrent Neural Networks for Probabilistic Modeling of Driver Behavior , 2017, IEEE Transactions on Intelligent Transportation Systems.

[11]  Christian Laugier,et al.  Comparison of parametric and non-parametric approaches for vehicle speed prediction , 2014, 2014 American Control Conference.

[12]  Peter Wagner,et al.  Calibration and Validation of Microscopic Traffic Flow Models , 2004, SimVis.

[13]  Yunsi Fei,et al.  Vehicle Speed Prediction by Two-Level Data Driven Models in Vehicular Networks , 2017, IEEE Transactions on Intelligent Transportation Systems.

[14]  Raphael H. Grzebieta,et al.  The Australian 400-car Naturalistic Driving Study: innovation in road safety research and policy , 2013 .

[15]  Gaetano Fusco,et al.  Artificial Neural Network Models for Car Following: Experimental Analysis and Calibration Issues , 2014, J. Intell. Transp. Syst..

[16]  Tatsuya Suzuki,et al.  Analysis of Vehicle Following Behavior of Human Driver Based on Hybrid Dynamical System Model , 2007, 2007 IEEE International Conference on Control Applications.

[17]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[18]  Mohan Manubhai Trivedi,et al.  Dynamics of Driver's Gaze: Explorations in Behavior Modeling and Maneuver Prediction , 2018, IEEE Transactions on Intelligent Vehicles.

[19]  P J Webros BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[20]  Huijing Zhao,et al.  On-Road Vehicle Trajectory Collection and Scene-Based Lane Change Analysis: Part II , 2017, IEEE Trans. Intell. Transp. Syst..

[21]  Motohiro Fujita,et al.  Evaluation of Car-following Models Using Trajectory Data from Real Traffic , 2012 .

[22]  M. Mulder,et al.  Motivation for continuous haptic gas pedal feedback to support car following , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[23]  John H. L. Hansen,et al.  International Large-Scale Vehicle Corpora for Research on Driver Behavior on the Road , 2011, IEEE Transactions on Intelligent Transportation Systems.

[24]  Mohan M. Trivedi,et al.  Convolutional Social Pooling for Vehicle Trajectory Prediction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[25]  Peter Wagner,et al.  Calibration of car-following models with single- and multi-step approaches , 2012, Proceedings Title: Proceedings of the 2012 Winter Simulation Conference (WSC).

[26]  Liang Zheng,et al.  A simple nonparametric car-following model driven by field data , 2015 .

[27]  Huijing Zhao,et al.  On-Road Vehicle Trajectory Collection and Scene-Based Lane Change Analysis: Part I , 2017, IEEE Transactions on Intelligent Transportation Systems.

[28]  Fei-Yue Wang,et al.  Capturing Car-Following Behaviors by Deep Learning , 2018, IEEE Transactions on Intelligent Transportation Systems.

[29]  K. Hasebe,et al.  Analysis of optimal velocity model with explicit delay , 1998, patt-sol/9805002.

[30]  Huijing Zhao,et al.  Scene-aware driver state understanding in car-following behaviors , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[31]  Álvaro Seco,et al.  Calibration of the Gipps Car-following Model Using Trajectory Data , 2014 .

[32]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[33]  Vincenzo Punzo,et al.  Analysis and Comparison of Microscopic Traffic Flow Models with Real Traffic Microscopic Data , 2005 .

[34]  Constantinos Antoniou,et al.  Towards data-driven car-following models , 2015 .

[35]  Martin Treiber,et al.  Calibrating the Local and Platoon Dynamics of Car-Following Models on the Reconstructed NGSIM Data , 2016 .

[36]  Marcello Montanino,et al.  Can Results of car-following Model Calibration Based on Trajectory Data be Trusted? , 2012 .

[37]  Yvonne Barnard,et al.  UDRIVE: the European naturalistic driving study , 2014 .

[38]  E. Montroll,et al.  Traffic Dynamics: Studies in Car Following , 1958 .

[39]  Constantinos Antoniou,et al.  Simulation Optimization of Car-Following Models Using Flexible Techniques , 2015 .

[40]  Martin Treiber,et al.  Microscopic Calibration and Validation of Car-Following Models – A Systematic Approach , 2013, 1403.4990.

[41]  Hussein Dia,et al.  Comparative evaluation of microscopic car-following behavior , 2005, IEEE Transactions on Intelligent Transportation Systems.

[42]  C. Micchelli,et al.  Approximation by superposition of sigmoidal and radial basis functions , 1992 .

[43]  Jianxiong Xiao,et al.  DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[44]  Thomas A. Dingus,et al.  An overview of the 100-car naturalistic study and findings , 2005 .

[45]  Tatsuya Suzuki,et al.  Evaluation of driver-behavior models in real-world car-following task , 2009, 2009 IEEE International Conference on Vehicular Electronics and Safety (ICVES).