Deep neural networks for Markovian interactive scene prediction in highway scenarios

In this paper, we compare different deep neural network approaches for motion prediction within a highway entrance scenario. The focus of our work lies on models that operate on limited history of data in order to fulfill the Markov property1 and be usable within an integrated prediction and motion planning framework for automated vehicles. We examine different model structures and feature combinations in order to find a model with a good tradeoff between accuracy and computational performance. We evaluate all models with standard metrics like the negative log-likelihood (NLL) and evaluate the performance of each model within a closed-loop simulation. We find a neural network only operating on spatial features of the current state to have the best closed-loop prediction performance, despite the NLL suggesting otherwise.

[1]  Martin Buss,et al.  Interactive scene prediction for automotive applications , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[2]  Mathias Perrollaz,et al.  Learning-based approach for online lane change intention prediction , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[3]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[4]  M. Treiber,et al.  Estimating Acceleration and Lane-Changing Dynamics from Next Generation Simulation Trajectory Data , 2008, 0804.0108.

[5]  Rüdiger Dillmann,et al.  A probabilistic model for estimating driver behaviors and vehicle trajectories in traffic environments , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[6]  Franz Kummert,et al.  Behavior prediction at multiple time-scales in inner-city scenarios , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[7]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[8]  Mykel J. Kochenderfer,et al.  Analysis of Recurrent Neural Networks for Probabilistic Modeling of Driver Behavior , 2017, IEEE Transactions on Intelligent Transportation Systems.

[9]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[10]  Rüdiger Dillmann,et al.  Learning Driver Behavior Models from Traffic Observations for Decision Making and Planning , 2015, IEEE Intelligent Transportation Systems Magazine.

[11]  Rüdiger Dillmann,et al.  Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[12]  Alex Pentland,et al.  Graphical models for driver behavior recognition in a SmartCar , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[13]  Thierry Fraichard,et al.  Motion prediction for moving objects: a statistical approach , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[14]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[15]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  A. Lambert,et al.  Path Planning using a Dynamic Vehicle Model , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[17]  M. Treiber,et al.  Estimating Acceleration and Lane-Changing Dynamics Based on NGSIM Trajectory Data , 2007 .

[18]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[19]  Andreas Lawitzky,et al.  A Combined Model- and Learning-Based Framework for Interaction-Aware Maneuver Prediction , 2016, IEEE Transactions on Intelligent Transportation Systems.

[20]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[21]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[22]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[23]  Anup Doshi,et al.  Lane change intent prediction for driver assistance: On-road design and evaluation , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[24]  Mykel J. Kochenderfer,et al.  Analysis of microscopic behavior models for probabilistic modeling of driver behavior , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[25]  Gerd Wanielik,et al.  Comparison and evaluation of advanced motion models for vehicle tracking , 2008, 2008 11th International Conference on Information Fusion.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.