Learning Interaction-Aware Trajectory Predictions for Decentralized Multi-Robot Motion Planning in Dynamic Environments

This letter presents a data-driven decentralized trajectory optimization approach for multi-robot motion planning in dynamic environments. When navigating in a shared space, each robot needs accurate motion predictions of neighboring robots to achieve predictive collision avoidance. These motion predictions can be obtained among robots by sharing their future planned trajectories with each other via communication. However, such communication may not be available nor reliable in practice. In this letter, we introduce a novel trajectory prediction model based on recurrent neural networks (RNN) that can learn multi-robot motion behaviors from demonstrated trajectories generated using a centralized sequential planner. The learned model can run efficiently online for each robot and provide interaction-aware trajectory predictions of its neighbors based on observations of their history states. We then incorporate the trajectory prediction model into a decentralized model predictive control (MPC) framework for multi-robot collision avoidance. Simulation results show that our decentralized approach can achieve a comparable level of performance to a centralized planner while being communication-free and scalable to a large number of robots. We also validate our approach with a team of quadrotors in real-world experiments.

[1]  Alexander Domahidi,et al.  Real-time planning for automated multi-view drone cinematography , 2017, ACM Trans. Graph..

[2]  Soon-Jo Chung,et al.  Neural-Swarm: Decentralized Close-Proximity Multirotor Control Using Learned Interactions , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Anca D. Dragan,et al.  Confidence-aware motion prediction for real-time collision avoidance1 , 2020, Int. J. Robotics Res..

[4]  Javier Alonso-Mora,et al.  B-UAVC: Buffered Uncertainty-Aware Voronoi Cells for Probabilistic Multi-Robot Collision Avoidance , 2019, 2019 International Symposium on Multi-Robot and Multi-Agent Systems (MRS).

[5]  Andreas Breitenmoser,et al.  On Combining Multi-robot Coverage and Reciprocal Collision Avoidance , 2014, DARS.

[6]  Alexander Domahidi,et al.  FORCES NLP: an efficient implementation of interior-point methods for multistage nonlinear nonconvex programs , 2020, Int. J. Control.

[7]  Roland Siegwart,et al.  Robust collision avoidance for multiple micro aerial vehicles using nonlinear model predictive control , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Philip H. S. Torr,et al.  DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Martin Buss,et al.  Understanding Human Avoidance Behavior: Interaction-Aware Decision Making Based on Game Theory , 2016, Int. J. Soc. Robotics.

[10]  Dmitry Berenson,et al.  Human-robot collaborative manipulation planning using early prediction of human motion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Dinesh Manocha,et al.  Reciprocal n-Body Collision Avoidance , 2011, ISRR.

[12]  Gaurav S. Sukhatme,et al.  Trajectory Planning for Quadrotor Swarms , 2018, IEEE Transactions on Robotics.

[13]  Marco Pavone,et al.  Multimodal Probabilistic Model-Based Planning for Human-Robot Interaction , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Dinesh Manocha,et al.  Reciprocal Velocity Obstacles for real-time multi-agent navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[15]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[16]  Saptarshi Bandyopadhyay,et al.  Fast, On-line Collision Avoidance for Dynamic Vehicles Using Buffered Voronoi Cells , 2017, IEEE Robotics and Automation Letters.

[17]  Jonathan P. How,et al.  Multi-Agent Motion Planning for Dense and Dynamic Environments via Deep Reinforcement Learning , 2020, IEEE Robotics and Automation Letters.

[18]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[19]  Yan Zhang,et al.  Collision avoidance planning in multi-robot based on improved artificial potential field and rules , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[20]  Ilya V. Kolmanovsky,et al.  A game theoretical model of traffic with multiple interacting drivers for use in autonomous vehicle development , 2016, 2016 American Control Conference (ACC).

[21]  Javier Alonso-Mora,et al.  With Whom to Communicate: Learning Efficient Communication for Multi-Robot Collision Avoidance , 2020, ArXiv.

[22]  Javier Alonso-Mora,et al.  Distributed Multi-Robot Formation Splitting and Merging in Dynamic Environments , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[23]  Dariu M. Gavrila,et al.  Human motion trajectory prediction: a survey , 2019, Int. J. Robotics Res..

[24]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Silvio Savarese,et al.  Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Aaron D. Ames,et al.  Safety Barrier Certificates for Collisions-Free Multirobot Systems , 2017, IEEE Transactions on Robotics.

[27]  Jonathan M. Garibaldi,et al.  Multi-Robot Search and Rescue: A Potential Field Based Approach , 2007 .

[28]  Soon-Jo Chung,et al.  GLAS: Global-to-Local Safe Autonomy Synthesis for Multi-Robot Motion Planning With End-to-End Learning , 2020, IEEE Robotics and Automation Letters.

[29]  Hannes Sommer,et al.  A Data-driven Model for Interaction-Aware Pedestrian Motion Prediction in Object Cluttered Environments , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Wolfram Burgard,et al.  Learning driving styles for autonomous vehicles from demonstration , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[31]  Chonhyon Park,et al.  I-Planner: Intention-aware motion planning using learning-based human motion prediction , 2016, Int. J. Robotics Res..

[32]  Angela P. Schoellig,et al.  Online Trajectory Generation With Distributed Model Predictive Control for Multi-Robot Motion Planning , 2020, IEEE Robotics and Automation Letters.

[33]  Dirk Helbing,et al.  GENERALIZED FORCE MODEL OF TRAFFIC DYNAMICS , 1998 .

[34]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[35]  Javier Alonso-Mora,et al.  Chance-Constrained Collision Avoidance for MAVs in Dynamic Environments , 2019, IEEE Robotics and Automation Letters.