HeGA: Heterogeneous Graph Aggregation Network for Trajectory Prediction in High-Density Traffic

Trajectory prediction enables the fast and accurate response of autonomous driving navigation in complex and dense traffics. In this paper, we present a novel trajectory prediction network called Heterogeneous Graph Aggregation (HeGA) for high-density heterogeneous traffic, where the traffic agents of various categories interact densely with each other. To predict the trajectory of a target agent, HeGA first automatically selects neighbors that interact with it by our proposed adaptive neighbor selector, and then aggregates their interactions based on a novel two-phase aggregation transformer block. At last, the historical residual connection LSTM enhances the historical information awareness and decodes the spatial coordinates as the prediction results. Extensive experiments on real data demonstrate that the proposed network significantly outperforms the existing state-of-the-art competitors by over 27% on average displacement error (ADE) and over 31% on final displacement error (FDE). We also deploy HeGA in a state-of-the-art framework for autonomous driving, demonstrating its superior applicability based on three simulated environments with different densities and complexities.

[1]  Yu Zheng,et al.  Detecting Loaded Trajectories for Hazardous Chemicals Transportation , 2022, 2022 IEEE 38th International Conference on Data Engineering (ICDE).

[2]  Yan Zhao,et al.  Efficient and Effective Similar Subtrajectory Search: A Spatial-aware Comprehension Approach , 2022, ACM Trans. Intell. Syst. Technol..

[3]  Han Su,et al.  Lane Change Scheduling for Autonomous Vehicle: A Prediction-and-Search Framework , 2021, KDD.

[4]  Fabien Moutarde,et al.  HOME: Heatmap Output for future Motion Estimation , 2021, 2021 IEEE International Intelligent Transportation Systems Conference (ITSC).

[5]  Sanjay Garg,et al.  A deep learning based approach for trajectory estimation using geographically clustered data , 2021, SN Applied Sciences.

[6]  Buyu Liu,et al.  Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  R. Urtasun,et al.  Learning Lane Graph Representations for Motion Forecasting , 2020, ECCV.

[8]  Anne Verroust-Blondet,et al.  Attention Based Vehicle Trajectory Prediction , 2020, IEEE Transactions on Intelligent Vehicles.

[9]  Yi Xu,et al.  CF-LSTM: Cascaded Feature-Based Long Short-Term Networks for Predicting Pedestrian Trajectory , 2020, AAAI.

[10]  Kai Zheng,et al.  A survey of trajectory distance measures and performance evaluation , 2019, The VLDB Journal.

[11]  Dinesh Manocha,et al.  RobustTP: End-to-End Trajectory Prediction for Heterogeneous Road-Agents in Dense Traffic with Noisy Sensor Inputs , 2019, CSCS.

[12]  Fawzi Nashashibi,et al.  Non-local Social Pooling for Vehicle Trajectory Prediction , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[13]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[14]  Dinesh Manocha,et al.  TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactions , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Dinesh Manocha,et al.  TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agents , 2018, AAAI.

[16]  Brendan Tran Morris,et al.  Convolutional Neural Networkfor Trajectory Prediction , 2018, ECCV Workshops.

[17]  Mohan M. Trivedi,et al.  Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMs , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[18]  Mohan M. Trivedi,et al.  Convolutional Social Pooling for Vehicle Trajectory Prediction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[19]  Silvio Savarese,et al.  Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Chung Choo Chung,et al.  Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecture , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[21]  Florent Altché,et al.  An LSTM network for highway trajectory prediction , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[22]  Jean Oh,et al.  Social Attention: Modeling Attention in Human Crowds , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Tareq Abed Mohammed,et al.  Understanding of a convolutional neural network , 2017, 2017 International Conference on Engineering and Technology (ICET).

[24]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[25]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Quoc V. Le,et al.  Listen, attend and spell: A neural network for large vocabulary conversational speech recognition , 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Daniel Krajzewicz,et al.  Recent Development and Applications of SUMO - Simulation of Urban MObility , 2012 .

[31]  Sorin A. Huss,et al.  Predictive maneuver evaluation for enhancement of Car-to-X mobility data , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[32]  Jonathan P. How,et al.  Driver Behavior Classification at Intersections and Validation on Large Naturalistic Data Set , 2012, IEEE Transactions on Intelligent Transportation Systems.

[33]  Christian Laugier,et al.  Exploiting map information for driver intention estimation at road intersections , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[34]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[35]  Alexander Skabardonis,et al.  Oversaturated Freeway Flow Algorithm for Use in Next Generation Simulation , 2008 .

[36]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[37]  Michael Schreckenberg,et al.  Two lane traffic simulations using cellular automata , 1995, cond-mat/9512119.

[38]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.