Analyzing Multiagent Interactions in Traffic Scenes via Topological Braids

We focus on the problem of analyzing multiagent interactions in traffic domains. Understanding the space of behavior of real-world traffic may offer significant advantages for algorithmic design, data-driven methodologies, and benchmarking. However, the high dimensionality of the space and the stochasticity of human behavior may hinder the identification of important interaction patterns. Our key insight is that traffic environments feature significant geometric and temporal structure, leading to highly organized collective behaviors, often drawn from a small set of dominant modes. In this work, we propose a representation based on the formalism of topological braids that can summarize arbitrarily complex multiagent behavior into a compact object of dual geometric and symbolic nature, capturing critical events of interaction. This representation allows us to formally enumerate the space of outcomes in a traffic scene and characterize their complexity. We illustrate the value of the proposed representation in summarizing critical aspects of real-world traffic behavior through a case study on recent driving datasets. We show that despite the density of real-world traffic, observed behavior tends to follow highly organized patterns of low interaction. Our framework may be a valuable tool for evaluating the richness of driving datasets, but also for synthetically designing balanced training datasets or benchmarks.

[1]  E. Artin The theory of braids. , 1950, American scientist.

[2]  J. Birman Braids, Links, and Mapping Class Groups. , 1975 .

[3]  K. Murasugi,et al.  A study of braids , 1999 .

[4]  S. Sastry,et al.  Optimal maneuver for multiple aircraft conflict resolution: a braid point of view , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[5]  Mitchell A. Berger,et al.  Hamiltonian dynamics generated by Vassiliev invariants , 2001 .

[6]  I. Dynnikov,et al.  On the complexity of braids , 2004, math/0403177.

[7]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  J. Thiffeault,et al.  Braids of entangled particle trajectories. , 2009, Chaos.

[9]  Marko Budisic,et al.  Braidlab: A Software Package for Braids and Loops , 2014, 1410.0849.

[10]  Amnon Shashua,et al.  Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving , 2016, ArXiv.

[11]  Florian T. Pokorny,et al.  Topological trajectory classification with filtrations of simplicial complexes and persistent homology , 2016, Int. J. Robotics Res..

[12]  Vijay Gadepally,et al.  A Framework for Estimating Long Term Driver Behavior , 2016, ArXiv.

[13]  Anca D. Dragan,et al.  Planning for Autonomous Cars that Leverage Effects on Human Actions , 2016, Robotics: Science and Systems.

[14]  Magnus Egerstedt,et al.  Multirobot Mixing via Braid Groups , 2017, IEEE Transactions on Robotics.

[15]  Ross A. Knepper,et al.  Socially competent navigation planning by deep learning of multi-agent path topologies , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Mykel J. Kochenderfer,et al.  Belief state planning for autonomously navigating urban intersections , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[17]  Jonathan A. DeCastro,et al.  Compositional and Contract-Based Verification for Autonomous Driving on Road Networks , 2017, ISRR.

[18]  Darius Burschka,et al.  Estimation of collective maneuvers through cooperative multi-agent planning , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[19]  Subhrajit Bhattacharya,et al.  Path homotopy invariants and their application to optimal trajectory planning , 2017, Annals of Mathematics and Artificial Intelligence.

[20]  Ross A. Knepper,et al.  Social Momentum: A Framework for Legible Navigation in Dynamic Multi-Agent Environments , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  Dylan A. Shell,et al.  An MDP Model of Vehicle-Pedestrian Interaction at an Unsignalized Intersection , 2018, 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall).

[22]  Song-Chun Zhu,et al.  Perception of Human Interaction Based on Motion Trajectories: From Aerial Videos to Decontextualized Animations , 2018, Top. Cogn. Sci..

[23]  Leslie Pack Kaelbling,et al.  From Skills to Symbols: Learning Symbolic Representations for Abstract High-Level Planning , 2018, J. Artif. Intell. Res..

[24]  The trends transforming mobility’s future , 2019 .

[25]  Soshi Iba,et al.  Dynamic Channel: A Planning Framework for Crowd Navigation , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[26]  Ross A. Knepper,et al.  Multi-agent path topology in support of socially competent navigation planning , 2018, Int. J. Robotics Res..

[27]  Simon Lucey,et al.  Argoverse: 3D Tracking and Forecasting With Rich Maps , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Siddhartha S. Srinivasa,et al.  Implicit Multiagent Coordination at Unsignalized Intersections via Multimodal Inference Enabled by Topological Braids , 2020 .

[29]  Marco Pavone,et al.  Trajectron++: Dynamically-Feasible Trajectory Forecasting with Heterogeneous Data , 2020, ECCV.

[30]  Lutz Eckstein,et al.  The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersections , 2019, 2020 IEEE Intelligent Vehicles Symposium (IV).

[31]  Lutz Eckstein,et al.  The rounD Dataset: A Drone Dataset of Road User Trajectories at Roundabouts in Germany , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[32]  Marco Pavone,et al.  Interpretable Policies from Formally-Specified Temporal Properties , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[33]  Gen Li,et al.  Learning Topological Motion Primitives for Knot Planning , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  Qiang Xu,et al.  nuScenes: A Multimodal Dataset for Autonomous Driving , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Priya Sundaresan,et al.  Untangling Dense Knots by Learning Task-Relevant Keypoints , 2020, CoRL.

[36]  Andreas Orthey,et al.  Multilevel Motion Planning: A Fiber Bundle Formulation , 2020, ArXiv.

[37]  Jyotirmoy V. Deshmukh,et al.  Learning from Demonstrations using Signal Temporal Logic , 2021, CoRL.

[38]  Siddhartha S. Srinivasa,et al.  Multimodal Trajectory Prediction via Topological Invariance for Navigation at Uncontrolled Intersections , 2020, CoRL.

[39]  Igor Gilitschenski,et al.  Vehicle Trajectory Prediction Using Generative Adversarial Network With Temporal Logic Syntax Tree Features , 2021, IEEE Robotics and Automation Letters.

[40]  Ross A. Knepper,et al.  Hamiltonian coordination primitives for decentralized multiagent navigation , 2021, Int. J. Robotics Res..

[41]  Benjamin Sapp,et al.  Identifying Driver Interactions via Conditional Behavior Prediction , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[42]  Stefanos Nikolaidis,et al.  Learning From Demonstrations Using Signal Temporal Logic in Stochastic and Continuous Domains , 2021, IEEE Robotics and Automation Letters.

[43]  Jiquan Ngiam,et al.  Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Dataset , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[44]  James McCann,et al.  An Artin Braid Group Representation of Knitting Machine State with Applications to Validation and Optimization of Fabrication Plans , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[45]  Nan Li,et al.  Game-Theoretic Modeling of Traffic in Unsignalized Intersection Network for Autonomous Vehicle Control Verification and Validation , 2019, IEEE Transactions on Intelligent Transportation Systems.

[46]  Ross A. Knepper,et al.  Social Momentum: Design and Evaluation of a Framework for Socially Competent Robot Navigation , 2022, ACM Transactions on Human-Robot Interaction.

[47]  Wenshuo Wang,et al.  Understanding V2V Driving Scenarios through Traffic Primitives , 2018, ArXiv.

[48]  Rohan Chandra,et al.  B-GAP: Behavior-Rich Simulation and Navigation for Autonomous Driving , 2020, IEEE Robotics and Automation Letters.