Hamiltonian coordination primitives for decentralized multiagent navigation

We focus on decentralized navigation among multiple non-communicating agents in continuous domains without explicit traffic rules, such as sidewalks, hallways, or squares. Following collision-free motion in such domains requires effective mechanisms of multiagent behavior prediction. Although this prediction problem can be shown to be NP-hard, humans are often capable of solving it efficiently by leveraging sophisticated mechanisms of implicit coordination. Inspired by the human paradigm, we propose a novel topological formalism that explicitly models multiagent coordination. Our formalism features both geometric and algebraic descriptions enabling the use of standard gradient-based optimization techniques for trajectory generation but also symbolic inference over coordination strategies. In this article, we contribute (a) HCP (Hamiltonian Coordination Primitives), a novel multiagent trajectory-generation pipeline that accommodates spatiotemporal constraints formulated as symbolic topological specifications corresponding to a desired coordination strategy; (b) HCPnav, an online planning framework for decentralized collision avoidance that generates motion by following multiagent trajectory primitives corresponding to high-likelihood, low-cost coordination strategies. Through a series of challenging trajectory-generation experiments, we show that HCP outperforms a trajectory-optimization baseline in generating trajectories of desired topological specifications in terms of success rate and computational efficiency. Finally, through a variety of navigation experiments, we illustrate the efficacy of HCPnav in handling challenging multiagent navigation scenarios under homogeneous or heterogeneous agents across a series of environments of different geometry.

[1]  Mitchell A. Berger,et al.  Hamiltonian dynamics generated by Vassiliev invariants , 2001 .

[2]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[3]  Ross A. Knepper,et al.  Multi-agent Trajectory Prediction and Generation with Topological Invariants Enforced by Hamiltonian Dynamics , 2018, WAFR.

[4]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[5]  Jory Denny,et al.  A Topology-Based Path Similarity Metric and its Application to Sampling-Based Motion Planning , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  G. Pedrizzetti,et al.  Vortex Dynamics , 2011 .

[7]  Trung Dung Ngo,et al.  Toward Socially Aware Robot Navigation in Dynamic and Crowded Environments: A Proactive Social Motion Model , 2017, IEEE Transactions on Automation Science and Engineering.

[8]  Daniele Fontanelli,et al.  Walking Ahead: The Headed Social Force Model , 2017, PloS one.

[9]  Siddhartha S. Srinivasa,et al.  CHOMP: Covariant Hamiltonian optimization for motion planning , 2013, Int. J. Robotics Res..

[10]  E. Goffman Behavior in public places : notes on the social organization of gatherings , 1964 .

[11]  J. Birman Braids, Links, and Mapping Class Groups. , 1975 .

[12]  Hassan Aref,et al.  Vortices, kinematics and chaos , 1989 .

[13]  Ross A. Knepper,et al.  Socially competent navigation planning by deep learning of multi-agent path topologies , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Vijay Kumar,et al.  Topological constraints in search-based robot path planning , 2012, Auton. Robots.

[15]  Dapeng Zhao,et al.  Core Challenges of Social Robot Navigation: A Survey , 2021, ACM Trans. Hum. Robot Interact..

[16]  Jory Denny,et al.  Topology-based group routing in partially known environments , 2020, SAC.

[17]  Hassan Aref,et al.  Point vortex dynamics: A classical mathematics playground , 2007 .

[18]  Serge P. Hoogendoorn,et al.  Simulation of pedestrian flows by optimal control and differential games , 2003 .

[19]  Takayuki Kanda,et al.  Towards a Socially Acceptable Collision Avoidance for a Mobile Robot Navigating Among Pedestrians Using a Pedestrian Model , 2014, International Journal of Social Robotics.

[20]  Siddhartha S. Srinivasa,et al.  MuSHR: A Low-Cost, Open-Source Robotic Racecar for Education and Research , 2019, ArXiv.

[21]  Paolo Fiorini,et al.  Motion Planning in Dynamic Environments Using Velocity Obstacles , 1998, Int. J. Robotics Res..

[22]  Siddhartha S. Srinivasa,et al.  Toward a deeper understanding of motion alternatives via an equivalence relation on local paths , 2012, Int. J. Robotics Res..

[23]  Nancy M. Amato,et al.  Dynamic Region-biased Rapidly-exploring Random Trees , 2016, WAFR.

[24]  Aaron Steinfeld,et al.  Group Split and Merge Prediction With 3D Convolutional Networks , 2020, IEEE Robotics and Automation Letters.

[25]  Dmitry Berenson,et al.  Human-robot collaborative manipulation planning using early prediction of human motion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Mark H. Overmars,et al.  A Predictive Collision Avoidance Model for Pedestrian Simulation , 2009, MIG.

[27]  Dirk Wollherr,et al.  Human-Like Motion Planning Based on Game Theoretic Decision Making , 2018, Int. J. Soc. Robotics.

[28]  Ross A. Knepper,et al.  Effects of Distinct Robot Navigation Strategies on Human Behavior in a Crowded Environment , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[29]  Danica Kragic,et al.  Data-Driven Topological Motion Planning with Persistent Cohomology , 2015, Robotics: Science and Systems.

[30]  Ross A. Knepper,et al.  Decentralized Multi-Agent Navigation Planning with Braids , 2016, WAFR.

[31]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[32]  W. H. Warren The dynamics of perception and action. , 2006, Psychological review.

[33]  Dirk Wollherr,et al.  Measuring the Effectiveness of Readability for Mobile Robot Locomotion , 2016, Int. J. Soc. Robotics.

[34]  Ludger Kaup,et al.  Holomorphic Functions of Several Variables: An Introduction to the Fundamental Theory , 1983 .

[35]  Torsten Bertram,et al.  Integrated online trajectory planning and optimization in distinctive topologies , 2017, Robotics Auton. Syst..

[36]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[37]  Adrien Treuille,et al.  Continuum crowds , 2006, SIGGRAPH 2006.

[38]  Dinesh Manocha,et al.  The Hybrid Reciprocal Velocity Obstacle , 2011, IEEE Transactions on Robotics.

[39]  Ross A. Knepper,et al.  Social Momentum: A Framework for Legible Navigation in Dynamic Multi-Agent Environments , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[40]  Christian Vollmer,et al.  Learning to navigate through crowded environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[41]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[42]  Ruslan Salakhutdinov,et al.  Multiple Futures Prediction , 2019, NeurIPS.

[43]  Ross A. Knepper,et al.  Real-time informed path sampling for motion planning search , 2012, Int. J. Robotics Res..

[44]  G. Csibra,et al.  'Obsessed with goals': functions and mechanisms of teleological interpretation of actions in humans. , 2007, Acta psychologica.

[45]  Kai Oliver Arras,et al.  Socially-aware robot navigation: A learning approach , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Magnus Egerstedt,et al.  Multirobot Mixing via Braid Groups , 2017, IEEE Transactions on Robotics.

[47]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Silvio Savarese,et al.  Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[49]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[50]  Ioannis Karamouzas,et al.  Universal power law governing pedestrian interactions. , 2014, Physical review letters.

[51]  S. Shankar Sastry,et al.  Optimal Coordinated Motions of Multiple Agents Moving on a Plane , 2003, SIAM J. Control. Optim..

[52]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..

[53]  Paul G. Spirakis,et al.  Strong NP-Hardness of Moving Many Discs , 1984, Inf. Process. Lett..

[54]  Paul A. Beardsley,et al.  Reciprocal collision avoidance for multiple car-like robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[55]  Andreas Orthey,et al.  Multilevel Motion Planning: A Fiber Bundle Formulation , 2020, ArXiv.

[56]  Joan S. Birman,et al.  Braids, Links, and Mapping Class Groups. (AM-82) , 1975 .

[57]  E. J.,et al.  ON THE COMPLEXITY OF MOTION PLANNING FOR MULTIPLE INDEPENDENT OBJECTS ; PSPACE HARDNESS OF THE " WAREHOUSEMAN ' S PROBLEM " . * * ) , 2022 .

[58]  Wolfram Burgard,et al.  Socially compliant mobile robot navigation via inverse reinforcement learning , 2016, Int. J. Robotics Res..

[59]  Jonathan P. How,et al.  Socially aware motion planning with deep reinforcement learning , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[60]  Marco Pavone,et al.  Multimodal Probabilistic Model-Based Planning for Human-Robot Interaction , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[61]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[62]  Mitchell A. Berger,et al.  Topological Invariants in Braid Theory , 2001 .

[63]  Dinesh Manocha,et al.  Reciprocal n-Body Collision Avoidance , 2011, ISRR.

[64]  Jan Zwickel,et al.  I See What You Mean: How Attentional Selection Is Shaped by Ascribing Intentions to Others , 2012, PloS one.

[65]  Eberhard Freitag,et al.  Analytic Functions of Several Complex Variables , 2011 .

[66]  Soshi Iba,et al.  Dynamic Channel: A Planning Framework for Crowd Navigation , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[67]  Benjamin Kuipers,et al.  Robot navigation with model predictive equilibrium point control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[68]  Andreas Orthey,et al.  Visualizing Local Minima in Multi-Robot Motion Planning using Multilevel Morse Theory. , 2020 .

[69]  Alexandra Kirsch,et al.  Legible robot navigation in the proximity of moving humans , 2012, 2012 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO).

[70]  Ross A. Knepper,et al.  Multi-agent path topology in support of socially competent navigation planning , 2018, Int. J. Robotics Res..

[71]  Jean Oh,et al.  Social Attention: Modeling Attention in Human Crowds , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[72]  J. Schwartz,et al.  On the Complexity of Motion Planning for Multiple Independent Objects; PSPACE- Hardness of the "Warehouseman's Problem" , 1984 .

[73]  Peter Stone,et al.  Robust Motion Planning and Safety Benchmarking in Human Workspaces , 2019, SafeAI@AAAI.

[74]  Danica Kragic,et al.  High-dimensional Winding-Augmented Motion Planning with 2D topological task projections and persistent homology , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[75]  Dirk Helbing,et al.  How simple rules determine pedestrian behavior and crowd disasters , 2011, Proceedings of the National Academy of Sciences.

[76]  Joelle Pineau,et al.  Socially Adaptive Path Planning in Human Environments Using Inverse Reinforcement Learning , 2016, Int. J. Soc. Robotics.

[77]  Nicholas H. Wolfinger PASSING MOMENTS , 1995 .

[78]  Stephen J. Guy,et al.  NH-TTC: A gradient-based framework for generalized anticipatory collision avoidance , 2019, Robotics: Science and Systems.

[79]  Ross A. Knepper,et al.  Pedestrian-inspired sampling-based multi-robot collision avoidance , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[80]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.