SCOUT: Socially-COnsistent and UndersTandable Graph Attention Network for Trajectory Prediction of Vehicles and VRUs

Autonomous vehicles navigate in dynamically changing environments under a wide variety of conditions, being continuously influenced by surrounding objects. Mod - elling interactions among agents is essential for accurately forecasting other agents' behaviour and achieving safe and comfortable motion planning. In this work, we propose SCOUT, a novel Attention-based Graph Neural Network that uses a flexible and generic representation of the scene as a graph for modelling interactions, and predicts socially - consistent trajec - tories of vehicles and Vulnerable Road Users (VRU s) under mixed traffic conditions. We explore three different attention mechanisms and test our scheme with both bird-eye - view and on-vehicle urban data, achieving superior performance than existing state-of - the-art approaches on InD and ApolloScape Trajectory benchmarks. Additionally, we evaluate our model's flexibility and transferability by testing it under completely new scenarios on RounD dataset. The importance and influence of each interaction in the final prediction is explored by means of Integrated Gradients technique and the visualization of the attention learned.

[1]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[2]  Ignacio Parra,et al.  Experimental validation of lane-change intention prediction methodologies based on CNN and LSTM , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[3]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Silvio Savarese,et al.  Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Ankur Taly,et al.  Axiomatic Attribution for Deep Networks , 2017, ICML.

[6]  Ignacio Parra,et al.  Vehicle Trajectory Prediction in Crowded Highway Scenarios Using Bird Eye View Representations and CNNs , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[7]  Razvan Pascanu,et al.  Relational inductive biases, deep learning, and graph networks , 2018, ArXiv.

[8]  Dinesh Manocha,et al.  TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactions , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Wenjun Wang,et al.  Interactive Trajectory Prediction of Surrounding Road Users for Autonomous Driving Using Structural-LSTM Network , 2020, IEEE Transactions on Intelligent Transportation Systems.

[10]  Dinesh Manocha,et al.  TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agents , 2018, AAAI.

[11]  Dongchun Ren,et al.  StarNet: Pedestrian Trajectory Prediction using Deep Neural Network in Star Topology , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[13]  Lutz Eckstein,et al.  The rounD Dataset: A Drone Dataset of Road User Trajectories at Roundabouts in Germany , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[14]  Lutz Eckstein,et al.  The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersections , 2019, 2020 IEEE Intelligent Vehicles Symposium (IV).

[15]  M. Chuah,et al.  GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Driving , 2019 .

[16]  Bodo Rosenhahn,et al.  AMENet: Attentive Maps Encoder Network for Trajectory Prediction , 2020, ArXiv.

[17]  Bodo Rosenhahn,et al.  Exploring Dynamic Context for Multi-path Trajectory Prediction , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Renjie Liao,et al.  SpAGNN: Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Data , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Alois Knoll,et al.  Graph Neural Networks for Modelling Traffic Participant Interaction , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[20]  R. Zemel,et al.  Neural Relational Inference for Interacting Systems , 2018, ICML.

[21]  Mooi Choo Chuah,et al.  GRIP: Graph-based Interaction-aware Trajectory Prediction , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[22]  Mohan M. Trivedi,et al.  Convolutional Social Pooling for Vehicle Trajectory Prediction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).