Machine Learning-Based Vehicle Trajectory Prediction Using V2V Communications and On-Board Sensors

Predicting the trajectories of surrounding vehicles is important to avoid or mitigate collision with traffic participants. However, due to limited past information and the uncertainty in future driving maneuvers, trajectory prediction is a challenging task. Recently, trajectory prediction models using machine learning algorithms have been addressed solve to this problem. In this paper, we present a trajectory prediction method based on the random forest (RF) algorithm and the long short term memory (LSTM) encoder-decoder architecture. An occupancy grid map is first defined for the region surrounding the target vehicle, and then the row and the column that will be occupied by the target vehicle at future time steps are determined using the RF algorithm and the LSTM encoder-decoder architecture, respectively. For the collection of training data, the test vehicle was equipped with a camera and LIDAR sensors along with vehicular wireless communication devices, and the experiments were conducted under various driving scenarios. The vehicle test results demonstrate that the proposed method provides more robust trajectory prediction compared with existing trajectory prediction methods.

[1]  A. Galip Ulsoy,et al.  Vehicle dynamics and external disturbance estimation for vehicle path prediction , 2000, IEEE Trans. Control. Syst. Technol..

[2]  Jonas Sjöberg,et al.  Model-Based Threat Assessment for Avoiding Arbitrary Vehicle Collisions , 2010, IEEE Transactions on Intelligent Transportation Systems.

[3]  Han-Shue Tan,et al.  DGPS-Based Vehicle-to-Vehicle Cooperative Collision Warning: Engineering Feasibility Viewpoints , 2006, IEEE Transactions on Intelligent Transportation Systems.

[4]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Jianqiang Wang,et al.  Vehicle Trajectory Prediction by Integrating Physics- and Maneuver-Based Approaches Using Interactive Multiple Models , 2018, IEEE Transactions on Industrial Electronics.

[7]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[8]  Denise Dettmering,et al.  Networked Transport of RTCM via Internet Protocol (NTRIP) , 2005 .

[9]  Praveen Edara,et al.  Modeling Mandatory Lane Changing Using Bayes Classifier and Decision Trees , 2014, IEEE Transactions on Intelligent Transportation Systems.

[10]  Marj Tonini,et al.  Rockfall detection from terrestrial LiDAR point clouds: A clustering approach using R , 2014, J. Spatial Inf. Sci..

[11]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[12]  K. Itten,et al.  LIDAR-based geometric reconstruction of boreal type forest stands at single tree level for forest and wildland fire management , 2004 .

[13]  Mohan M. Trivedi,et al.  How Would Surround Vehicles Move? A Unified Framework for Maneuver Classification and Motion Prediction , 2018, IEEE Transactions on Intelligent Vehicles.

[14]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[15]  Juan Liu,et al.  An Efficient Computational Architecture for a Collision Early-Warning System for Vehicles, Pedestrians, and Bicyclists , 2011, IEEE Transactions on Intelligent Transportation Systems.

[16]  Christian Laugier,et al.  Growing Hidden Markov Models: An Incremental Tool for Learning and Predicting Human and Vehicle Motion , 2009, Int. J. Robotics Res..

[17]  Lane Change Intent Analysis Using Robust Operators and Sparse Bayesian Learning , 2007, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[18]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[19]  Hiren M. Mandalia,et al.  Using Support Vector Machines for Lane-Change Detection , 2005 .

[20]  M. Treiber,et al.  Estimating Acceleration and Lane-Changing Dynamics from Next Generation Simulation Trajectory Data , 2008, 0804.0108.

[21]  Stewart Worrall,et al.  Naturalistic Driver Intention and Path Prediction Using Recurrent Neural Networks , 2018, IEEE Transactions on Intelligent Transportation Systems.

[22]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[23]  Amaury Nègre,et al.  Probabilistic Analysis of Dynamic Scenes and Collision Risks Assessment to Improve Driving Safety , 2011, IEEE Intelligent Transportation Systems Magazine.

[24]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[25]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[26]  Hermann Winner,et al.  Three Decades of Driver Assistance Systems: Review and Future Perspectives , 2014, IEEE Intelligent Transportation Systems Magazine.