Multi-Objective Policy Generation for Multi-Robot Systems Using Riemannian Motion Policies

In many applications, multi-robot systems are required to achieve multiple objectives. For these multi-objective tasks, it is oftentimes hard to design a single control policy that fulfills all the objectives simultaneously. In this paper, we focus on multi-objective tasks that can be decomposed into a set of simple subtasks. Controllers for these subtasks are individually designed and then combined into a control policy for the entire team. One significant feature of our work is that the subtask controllers are designed along with their underlying manifolds. When a controller is combined with other controllers, their associated manifolds are also taken into account. This formulation yields a policy generation framework for multi-robot systems that can combine controllers for a variety of objectives while implicitly handling the interaction among robots and subtasks. To describe controllers on manifolds, we adopt Riemannian Motion Policies (RMPs), and propose a collection of RMPs for common multi-robot subtasks. Centralized and decentralized algorithms are designed to combine these RMPs into a final control policy. Theoretical analysis shows that the system under the control policy is stable. Moreover, we prove that many existing multi-robot controllers can be closely approximated by the framework. The proposed algorithms are validated through both simulated tasks and robotic implementations.

[1]  Jonathan P. How,et al.  Decentralized path planning for multi-agent teams with complex constraints , 2012, Autonomous Robots.

[2]  Li Wang,et al.  The Robotarium: A remotely accessible swarm robotics research testbed , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[3]  B. E. Bishop On the use of redundant manipulator techniques for control of platoons of cooperating robotic vehicles , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[4]  Li Wang,et al.  Multi-objective compositions for collision-free connectivity maintenance in teams of mobile robots , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[5]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[6]  Jorge Cortes,et al.  Coordinated Control of Multi-Robot Systems: A Survey , 2017 .

[7]  Byron Boots,et al.  RMPflow: A Computational Graph for Automatic Motion Policy Generation , 2018, WAFR.

[8]  Aaron D. Ames,et al.  Safety Barrier Certificates for Collisions-Free Multirobot Systems , 2017, IEEE Transactions on Robotics.

[9]  Jorge Cortes,et al.  Distributed Control of Robotic Networks: A Mathematical Approach to Motion Coordination Algorithms , 2009 .

[10]  Li Wang,et al.  Control Barrier Certificates for Safe Swarm Behavior , 2015, ADHS.

[11]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[12]  Daniel Kappler,et al.  Riemannian Motion Policies , 2018, ArXiv.

[13]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[14]  Gianluca Antonelli,et al.  Flocking for multi-robot systems via the Null-Space-based Behavioral control , 2010, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Mireille E. Broucke,et al.  Formations of vehicles in cyclic pursuit , 2004, IEEE Transactions on Automatic Control.

[16]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[17]  J. Hendrickx,et al.  Rigid graph control architectures for autonomous formations , 2008, IEEE Control Systems.

[18]  Katia P. Sycara,et al.  Distributed dynamic priority assignment and motion planning for multiple mobile robots with kinodynamic constraints , 2016, 2016 American Control Conference (ACC).

[19]  Howie Choset,et al.  Subdimensional expansion for multirobot path planning , 2015, Artif. Intell..

[20]  Paulo Tabuada,et al.  Control barrier function based quadratic programs with application to adaptive cruise control , 2014, 53rd IEEE Conference on Decision and Control.

[21]  A. D. Lewis,et al.  Geometric control of mechanical systems : modeling, analysis, and design for simple mechanical control systems , 2005 .

[22]  Maxim Likhachev,et al.  Planning for multi-agent teams with leader switching , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.