Improving Motion Forecasting for Autonomous Driving with the Cycle Consistency Loss

Robust motion forecasting of the dynamic scene is a critical component of an autonomous vehicle. It is a challenging problem due to the heterogeneity in the scene and the inherent uncertainties in the problem. To improve the accuracy of motion forecasting, in this work, we identify a new consistency constraint in this task, that is an agent's future trajectory should be coherent with its history observations and visa versa. To leverage this property, we propose a novel cycle consistency training scheme and define a novel cycle loss to encourage this consistency. In particular, we reverse the predicted future trajectory backward in time and feed it back into the prediction model to predict the history and compute the loss as an additional cycle loss term. Through our experiments on the Argoverse dataset, we demonstrate that cycle loss can improve the performance of competitive motion forecasting models.

[1]  Khaled S. Refaat,et al.  Wayformer: Motion Forecasting via Simple & Efficient Attention Networks , 2022, 2023 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Ziyao Xu,et al.  TENET: Transformer Encoding Network for Effective Temporal Flow on Motion Prediction , 2022, ArXiv.

[3]  K. Lu,et al.  HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Qifeng Chen,et al.  Bootstrap Motion Forecasting With Self-Consistent Constraints , 2022, IEEE International Conference on Computer Vision.

[5]  S. Shen,et al.  Trajectory Prediction with Graph-based Dual-scale Context Fusion , 2021, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Fabien Moutarde,et al.  THOMAS: Trajectory Heatmap Output with learned Multi-Agent Sampling , 2021, ICLR.

[7]  Fabien Moutarde,et al.  GOHOME: Graph-Oriented Heatmap Output for future Motion Estimation , 2021, 2022 International Conference on Robotics and Automation (ICRA).

[8]  Samira Ebrahimi Kahou,et al.  Latent Variable Sequential Set Transformers for Joint Multi-Agent Motion Prediction , 2021, ICLR.

[9]  Jonathon Shlens,et al.  Scene Transformer: A unified architecture for predicting future trajectories of multiple agents , 2022, ICLR.

[10]  Hang Zhao,et al.  DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  Fabien Moutarde,et al.  HOME: Heatmap Output for future Motion Estimation , 2021, 2021 IEEE International Intelligent Transportation Systems Conference (ITSC).

[12]  Yi Shen,et al.  TNT: Target-driveN Trajectory Prediction , 2020, CoRL.

[13]  R. Urtasun,et al.  Learning Lane Graph Representations for Motion Forecasting , 2020, ECCV.

[14]  Zhihai He,et al.  Reciprocal Learning Networks for Human Trajectory Prediction , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Benjamin Sapp,et al.  MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction , 2019, CoRL.

[16]  Simon Lucey,et al.  Argoverse: 3D Tracking and Forecasting With Rich Maps , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Henggang Cui,et al.  Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networks , 2018, 2019 International Conference on Robotics and Automation (ICRA).