A Lightweight Goal-Based model for Trajectory Prediction

We present a lightweight goal-based model for multimodal, probabilistic trajectory prediction for urban driving. Previous conditioned-on-goal methods have used map information in order to establish a set of potential goals and then complete the corresponding full trajectory for each goal. We instead propose two original representations, based on the agent's states and its kinematics, to extract the potential goals. In this paper, we conduct a comparative study between the two representations. We also evaluate our approach on the nuScenes dataset, and show that it outperforms a wide array of state-of-the-art methods.

[1]  Max Q.-H. Meng,et al.  A Survey on Deep-Learning Approaches for Vehicle Trajectory Prediction in Autonomous Driving , 2021, 2021 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[2]  Fabien Moutarde,et al.  THOMAS: Trajectory Heatmap Output with learned Multi-Agent Sampling , 2021, ICLR.

[3]  Fabien Moutarde,et al.  GOHOME: Graph-Oriented Heatmap Output for future Motion Estimation , 2021, 2022 International Conference on Robotics and Automation (ICRA).

[4]  Eric M. Wolff,et al.  Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversals , 2021, CoRL.

[5]  Alexandre Alahi,et al.  Interpretable Social Anchors for Human Trajectory Forecasting in Crowds , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  David J. Crandall,et al.  Stepwise Goal-Driven Networks for Trajectory Prediction , 2021, IEEE Robotics and Automation Letters.

[7]  Kris Kitani,et al.  AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecasting , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[8]  Renjie Liao,et al.  LaneRCNN: Distributed Representations for Graph-Centric Motion Forecasting , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Yi Shen,et al.  TNT: Target-driveN Trajectory Prediction , 2020, CoRL.

[10]  Dragomir Anguelov,et al.  VectorNet: Encoding HD Maps and Agent Dynamics From Vectorized Representation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  M. Trivedi,et al.  Trajectory Prediction for Autonomous Driving based on Multi-Head Attention with Joint Agent-Map Representation , 2020, 2021 IEEE Intelligent Vehicles Symposium (IV).

[12]  Anne Verroust-Blondet,et al.  Attention Based Vehicle Trajectory Prediction , 2020, IEEE Transactions on Intelligent Vehicles.

[13]  J. Malik,et al.  It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Prediction , 2020, ECCV.

[14]  Marco Pavone,et al.  Trajectron++: Dynamically-Feasible Trajectory Forecasting with Heterogeneous Data , 2020, ECCV.

[15]  M. Trivedi,et al.  Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Plans , 2020, ArXiv.

[16]  Omar Y. Al-Jarrah,et al.  Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Review , 2019, ArXiv.

[17]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[18]  Freddy A. Boulton,et al.  CoverNet: Multimodal Behavior Prediction Using Trajectory Sets , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Benjamin Sapp,et al.  MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction , 2019, CoRL.

[20]  M. Gavrilescu,et al.  A Review of Tracking, Prediction and Decision Making Methods for Autonomous Driving , 2019, Mathematics.

[21]  Sergey Levine,et al.  PRECOG: PREdiction Conditioned on Goals in Visual Multi-Agent Settings , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[22]  Qiang Xu,et al.  nuScenes: A Multimodal Dataset for Autonomous Driving , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[24]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Michel Bierlaire,et al.  Specification, estimation and validation of a pedestrian walking behaviour model , 2007 .