Evaluation of Differentially Constrained Motion Models for Graph-Based Trajectory Prediction

Given their flexibility and encouraging performance, deep-learning models are becoming standard for motion prediction in autonomous driving. However, with great flexibility comes a lack of interpretability and possible violations of physical constraints. Accompanying these data-driven methods with differentially-constrained motion models to provide physically feasible trajectories is a promising future direction. The foundation for this work is a previously introduced graph-neural-network-based model, MTP-GO. The neural network learns to compute the inputs to an underlying motion model to provide physically feasible trajectories. This research investigates the performance of various motion models in combination with numerical solvers for the prediction task. The study shows that simpler models, such as low-order integrator models, are preferred over more complex, e.g., kinematic models, to achieve accurate predictions. Further, the numerical solver can have a substantial impact on performance, advising against commonly used first-order methods like Euler forward. Instead, a second-order method like Heun's can greatly improve predictions.

[1]  F. Lindsten,et al.  Temporal Graph Neural Networks for Irregular Data , 2023, AISTATS.

[2]  E. Frisk,et al.  MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction With Neural ODEs , 2023, IEEE Transactions on Intelligent Vehicles.

[3]  Lin Zhang,et al.  A Survey on Trajectory-Prediction Methods for Autonomous Driving , 2022, IEEE Transactions on Intelligent Vehicles.

[4]  Chen Lv,et al.  Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Driving , 2021, 2022 International Conference on Robotics and Automation (ICRA).

[5]  Eran Yahav,et al.  How Attentive are Graph Attention Networks? , 2021, ICLR.

[6]  Masayoshi Tomizuka,et al.  Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking , 2021, IEEE Transactions on Intelligent Transportation Systems.

[7]  M. Tomizuka,et al.  Scenario-Transferable Semantic Graph Reasoning for Interaction-Aware Probabilistic Prediction , 2020, IEEE Transactions on Intelligent Transportation Systems.

[8]  Omar Y. Al-Jarrah,et al.  Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Review , 2019, ArXiv.

[9]  Erik Frisk,et al.  Vehicle Behavior Prediction and Generalization Using Imbalanced Learning Techniques , 2021, 2021 IEEE International Intelligent Transportation Systems Conference (ITSC).

[10]  Bolei Zhou,et al.  Multimodal Motion Prediction with Stacked Transformers , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Isaac Skog,et al.  Online Joint State Inference and Learning of Partially Unknown State-Space Models , 2021, IEEE Transactions on Signal Processing.

[12]  Anne Verroust-Blondet,et al.  Attention Based Vehicle Trajectory Prediction , 2020, IEEE Transactions on Intelligent Vehicles.

[13]  Lutz Eckstein,et al.  The rounD Dataset: A Drone Dataset of Road User Trajectories at Roundabouts in Germany , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[14]  Dongsuk Kum,et al.  SCALE-Net: Scalable Vehicle Trajectory Prediction Network under Random Number of Interacting Vehicles via Edge-enhanced Graph Convolutional Neural Network , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Marco Pavone,et al.  Trajectron++: Dynamically-Feasible Trajectory Forecasting with Heterogeneous Data , 2020, ECCV.

[16]  Henggang Cui,et al.  Deep Kinematic Models for Kinematically Feasible Vehicle Trajectory Predictions , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[18]  M. Chuah,et al.  GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Driving , 2019 .

[19]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[20]  Lutz Eckstein,et al.  The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systems , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[21]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[22]  Mohan M. Trivedi,et al.  Convolutional Social Pooling for Vehicle Trajectory Prediction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[23]  Wei Zhan,et al.  Probabilistic Prediction of Vehicle Semantic Intention and Motion , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[24]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[25]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[26]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[30]  Julius Ziegler,et al.  Optimal trajectories for time-critical street scenarios using discretized terminal manifolds , 2012, Int. J. Robotics Res..

[31]  Gerd Wanielik,et al.  Comparison and evaluation of advanced motion models for vehicle tracking , 2008, 2008 11th International Conference on Information Fusion.

[32]  Angelos Amditis,et al.  Sensor Fusion for Predicting Vehicles' Path for Collision Avoidance Systems , 2007, IEEE Transactions on Intelligent Transportation Systems.

[33]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[34]  LI X.RONG,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[35]  A. Galip Ulsoy,et al.  Vehicle dynamics and external disturbance estimation for vehicle path prediction , 2000, IEEE Trans. Control. Syst. Technol..

[36]  Uri M. Ascher,et al.  Computer methods for ordinary differential equations and differential-algebraic equations , 1998 .

[37]  J. Dormand,et al.  A family of embedded Runge-Kutta formulae , 1980 .