Personalized Vehicle Trajectory Prediction Based on Joint Time-Series Modeling for Connected Vehicles

Motion prediction for the leading vehicle is a critical task for connected autonomous vehicles. It provides a method to model the leading-following vehicle behavior and analysis their interactions. In this study, a joint time-series modeling approach for leading vehicle trajectory prediction considering different driving styles is proposed. The proposed method enables a precise and personalized trajectory prediction for the leading vehicle based on limited inter-vehicle communication signals, such as the vehicle speed and acceleration of the front vehicles. Three different driving styles are first recognized based on an unsupervised clustering algorithm, namely, Gaussian Mixture Model (GMM). The GMM generates a specific driving style for each vehicle based on the speed, acceleration, jerk, time, and space headway features of the leading vehicle. The feature importance of driving style recognition is also evaluated based on the Maximal Information Coefficient (MIC) algorithm. Then, a personalized joint time series modeling (JTSM) method based on the Long Short-Term Memory (LSTM) Recurrent Neural Network model (RNN) is proposed to predict the front vehicle trajectories. The JTSM contains a common LSTM layer and different fully connected regression layers for different driving styles. The proposed method is tested with the Next Generation Simulation (NGSIM) data on the US101, and I-80 highway dataset. The JTSM is tested for making predictions one to five seconds ahead. Results indicate that the proposed personalized JTSM approach shows a significant advantage over the baseline algorithms.

[1]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Cheng Long,et al.  Interaction-aware Kalman Neural Networks for Trajectory Prediction , 2019, 2020 IEEE Intelligent Vehicles Symposium (IV).

[3]  Stewart Worrall,et al.  Naturalistic Driver Intention and Path Prediction Using Recurrent Neural Networks , 2018, IEEE Transactions on Intelligent Transportation Systems.

[4]  S. Ilgin Guler,et al.  Using connected vehicle technology to improve the efficiency of intersections , 2014 .

[5]  Yunfeng Ai,et al.  Driver Lane Change Intention Inference for Intelligent Vehicles: Framework, Survey, and Challenges , 2019, IEEE Transactions on Vehicular Technology.

[6]  Mohan M. Trivedi,et al.  Convolutional Social Pooling for Vehicle Trajectory Prediction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Bo Gao,et al.  Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance: A Survey , 2018, IEEE Transactions on Intelligent Transportation Systems.

[8]  Hong Chen,et al.  Simultaneous Trajectory Planning and Tracking Using an MPC Method for Cyber-Physical Systems: A Case Study of Obstacle Avoidance for an Intelligent Vehicle , 2018, IEEE Transactions on Industrial Informatics.

[9]  Michael Mitzenmacher,et al.  Detecting Novel Associations in Large Data Sets , 2011, Science.

[10]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Wanzhong Zhao,et al.  Coupling Control Strategy of Force and Displacement for Electric Differential Power Steering System of Electric Vehicle With Motorized Wheels , 2018, IEEE Transactions on Vehicular Technology.

[12]  Andreas Lawitzky,et al.  A Combined Model- and Learning-Based Framework for Interaction-Aware Maneuver Prediction , 2016, IEEE Transactions on Intelligent Transportation Systems.

[13]  Ruifeng Zhang,et al.  A method for connected vehicle trajectory prediction and collision warning algorithm based on V2V communication , 2017 .

[14]  Vincenzo Punzo,et al.  On the assessment of vehicle trajectory data accuracy and application to the Next Generation SIMulation (NGSIM) program data , 2011 .

[15]  Bo Cheng,et al.  Estimation of driving style in naturalistic highway traffic using maneuver transition probabilities , 2017 .

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Mykel J. Kochenderfer,et al.  Analysis of Recurrent Neural Networks for Probabilistic Modeling of Driver Behavior , 2017, IEEE Transactions on Intelligent Transportation Systems.

[18]  Mike Lukuc,et al.  Vehicle-to-Vehicle Communications: Readiness of V2V Technology for Application , 2014 .

[19]  Ying Nian Wu,et al.  Multi-Agent Tensor Fusion for Contextual Trajectory Prediction , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Mohan M. Trivedi,et al.  Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMs , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[21]  Volker Willert,et al.  An Integrated Approach to Maneuver-Based Trajectory Prediction and Criticality Assessment in Arbitrary Road Environments , 2016, IEEE Transactions on Intelligent Transportation Systems.

[22]  Wanzhong Zhao,et al.  Energy transfer and utilization efficiency of regenerative braking with hybrid energy storage system , 2019, Journal of Power Sources.

[23]  Mykel J. Kochenderfer,et al.  Imitating driver behavior with generative adversarial networks , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[24]  Siva R K Narla,et al.  The Evolution of Connected Vehicle Technology: From Smart Drivers to Smart Cars to....Self-Driving Cars. , 2013 .

[25]  Chen Lv,et al.  Dynamic State Estimation for the Advanced Brake System of Electric Vehicles by Using Deep Recurrent Neural Networks , 2020, IEEE Transactions on Industrial Electronics.

[26]  Sanjay E. Sarma,et al.  A Survey of the Connected Vehicle Landscape—Architectures, Enabling Technologies, Applications, and Development Areas , 2017, IEEE Transactions on Intelligent Transportation Systems.

[27]  Eduardo Mario Nebot,et al.  Estimation of Multivehicle Dynamics by Considering Contextual Information , 2012, IEEE Transactions on Robotics.

[28]  Dongpu Cao,et al.  Hybrid-Learning-Based Classification and Quantitative Inference of Driver Braking Intensity of an Electrified Vehicle , 2018, IEEE Transactions on Vehicular Technology.

[29]  Xuemin Shen,et al.  Connected Vehicles: Solutions and Challenges , 2014, IEEE Internet of Things Journal.

[30]  Yuanfu Luo,et al.  GAMMA: A General Agent Motion Prediction Model for Autonomous Driving , 2019, ArXiv.

[31]  Dongpu Cao,et al.  Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach , 2019, IEEE Transactions on Vehicular Technology.

[32]  Andreas Lawitzky,et al.  A Game-Theoretic Approach to Replanning-Aware Interactive Scene Prediction and Planning , 2016, IEEE Transactions on Vehicular Technology.

[33]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[34]  Mohan M. Trivedi,et al.  Driver classification and driving style recognition using inertial sensors , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[35]  Junxiang Li,et al.  A Dynamic Bayesian Network for Vehicle Maneuver Prediction in Highway Driving Scenarios: Framework and Verification , 2019, Electronics.

[36]  Benjamin Coifman,et al.  A critical evaluation of the Next Generation Simulation (NGSIM) vehicle trajectory dataset , 2017 .

[37]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[38]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[39]  Carl E. Rasmussen,et al.  The Infinite Gaussian Mixture Model , 1999, NIPS.

[40]  Theo Hofman,et al.  Driving-Cycle-Aware Energy Management of Hybrid Electric Vehicles Using a Three-Dimensional Markov Chain Model , 2019, Automotive Innovation.