Multimodal Trajectory Prediction via Topological Invariance for Navigation at Uncontrolled Intersections

We focus on decentralized navigation among multiple non-communicating rational agents at \emph{uncontrolled} intersections, i.e., street intersections without traffic signs or signals. Avoiding collisions in such domains relies on the ability of agents to predict each others' intentions reliably, and react quickly. Multiagent trajectory prediction is NP-hard whereas the sample complexity of existing data-driven approaches limits their applicability. Our key insight is that the geometric structure of the intersection and the incentive of agents to move efficiently and avoid collisions (rationality) reduces the space of likely behaviors, effectively relaxing the problem of trajectory prediction. In this paper, we collapse the space of multiagent trajectories at an intersection into a set of modes representing different classes of multiagent behavior, formalized using a notion of topological invariance. Based on this formalism, we design Multiple Topologies Prediction (MTP), a data-driven trajectory-prediction mechanism that reconstructs trajectory representations of high-likelihood modes in multiagent intersection scenes. We show that MTP outperforms a state-of-the-art multimodal trajectory prediction baseline (MFP) in terms of prediction accuracy by 78.24% on a challenging simulated dataset. Finally, we show that MTP enables our optimization-based planner, MTPnav, to achieve collision-free and time-efficient navigation across a variety of challenging intersection scenarios on the CARLA simulator.

[1]  Simon Lucey,et al.  Argoverse: 3D Tracking and Forecasting With Rich Maps , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[3]  Ross A. Knepper,et al.  Socially competent navigation planning by deep learning of multi-agent path topologies , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Ross A. Knepper,et al.  Multi-agent Trajectory Prediction and Generation with Topological Invariants Enforced by Hamiltonian Dynamics , 2018, WAFR.

[5]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[6]  Mooi Choo Chuah,et al.  GRIP: Graph-based Interaction-aware Trajectory Prediction , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[7]  Razvan Pascanu,et al.  Relational inductive biases, deep learning, and graph networks , 2018, ArXiv.

[8]  Silvio Savarese,et al.  Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Mac Schwager,et al.  ALGAMES: A Fast Solver for Constrained Dynamic Games , 2019, RSS 2020.

[10]  Christopher Burgess,et al.  beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework , 2016, ICLR 2016.

[11]  Fawzi Nashashibi,et al.  Real time trajectory prediction for collision risk estimation between vehicles , 2009, 2009 IEEE 5th International Conference on Intelligent Computer Communication and Processing.

[12]  E. Artin The theory of braids. , 1950, American scientist.

[13]  Ross A. Knepper,et al.  Multi-agent path topology in support of socially competent navigation planning , 2018, Int. J. Robotics Res..

[14]  David Isele,et al.  Navigating Occluded Intersections with Autonomous Vehicles Using Deep Reinforcement Learning , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Sergey Levine,et al.  Deep Imitative Models for Flexible Inference, Planning, and Control , 2018, ICLR.

[16]  The trends transforming mobility’s future , 2019 .

[17]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[18]  Mitchell A. Berger,et al.  Topological Invariants in Braid Theory , 2001 .

[19]  Masayoshi Tomizuka,et al.  EvolveGraph: Multi-Agent Trajectory Prediction with Dynamic Relational Reasoning , 2020, NeurIPS.

[20]  Anca D. Dragan,et al.  Efficient Iterative Linear-Quadratic Approximations for Nonlinear Multi-Player General-Sum Differential Games , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Sorin A. Huss,et al.  Predictive maneuver evaluation for enhancement of Car-to-X mobility data , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[22]  Dinesh Manocha,et al.  Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMs , 2019, IEEE Robotics and Automation Letters.

[23]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[24]  Alexander Hauptmann,et al.  The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Rüdiger Dillmann,et al.  Learning Driver Behavior Models from Traffic Observations for Decision Making and Planning , 2015, IEEE Intelligent Transportation Systems Magazine.

[26]  Simone Calderara,et al.  DAG-Net: Double Attentive Graph Neural Network for Trajectory Forecasting , 2020, ArXiv.

[27]  Mohan M. Trivedi,et al.  Convolutional Social Pooling for Vehicle Trajectory Prediction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[28]  Sammy Omari,et al.  One Thousand and One Hours: Self-driving Motion Prediction Dataset , 2020, CoRL.

[29]  Siddhartha S. Srinivasa,et al.  MuSHR: A Low-Cost, Open-Source Robotic Racecar for Education and Research , 2019, ArXiv.

[30]  Siddhartha S. Srinivasa,et al.  Implicit Multiagent Coordination at Unsignalized Intersections via Multimodal Inference Enabled by Topological Braids , 2020 .

[31]  Daniela Rus,et al.  Navigating Congested Environments with Risk Level Sets , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Ruslan Salakhutdinov,et al.  Multiple Futures Prediction , 2019, NeurIPS.