Multi-robot formation control and object transport in dynamic environments via constrained optimization

We present a constrained optimization method for multi-robot formation control in dynamic environments, where the robots adjust the parameters of the formation, such as size and three-dimensional orientation, to avoid collisions with static and moving obstacles, and to make progress towards their goal. We describe two variants of the algorithm, one for local motion planning and one for global path planning. The local planner first computes a large obstacle-free convex region in a neighborhood of the robots, embedded in position-time space. Then, the parameters of the formation are optimized therein by solving a constrained optimization, via sequential convex programming. The robots navigate towards the optimized formation with individual controllers that account for their dynamics. The idea is extended to global path planning by sampling convex regions in free position space and connecting them if a transition in formation is possible - computed via the constrained optimization. The path of lowest cost to the goal is then found via graph search. The method applies to ground and aerial vehicles navigating in two- and three-dimensional environments among static and dynamic obstacles, allows for reconfiguration, and is efficient and scalable with the number of robots. In particular, we consider two applications, a team of aerial vehicles navigating in formation, and a small team of mobile manipulators that collaboratively carry an object. The approach is verified in experiments with a team of three mobile manipulators and in simulations with a team of up to sixteen Micro Air Vehicles (quadrotors).

[1]  Calin Belta,et al.  Abstraction and control for Groups of robots , 2004, IEEE Transactions on Robotics.

[2]  YangQuan Chen,et al.  Formation control: a review and a new consideration , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Lluís Ros Giralt,et al.  Randomized kinodynamic planning for constrained systems , 2018, ICRA 2018.

[4]  Wei Ren,et al.  Distributed coordination architecture for multi-robot formation control , 2008, Robotics Auton. Syst..

[5]  Ross A. Knepper,et al.  Local motion planning for collaborative multi-robot manipulation of deformable objects , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Richard M. Murray,et al.  DISTRIBUTED COOPERATIVE CONTROL OF MULTIPLE VEHICLE FORMATIONS USING STRUCTURAL POTENTIAL FUNCTIONS , 2002 .

[7]  J. Trinkle,et al.  Controlling Shapes of Ensembles of Robots of Finite Size with Nonholonomic Constraints , 2009 .

[8]  M. Ani Hsieh,et al.  Decentralized controllers for shape generation with robotic swarms , 2008, Robotica.

[9]  John R. Spletzer,et al.  Convex Optimization Strategies for Coordinating Large-Scale Robot Formations , 2007, IEEE Transactions on Robotics.

[10]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[11]  Robin Deits,et al.  Computing Large Convex Regions of Obstacle-Free Space Through Semidefinite Programming , 2014, WAFR.

[12]  Vijay Kumar,et al.  Synthesis of feedback controllers for multiple aerial robots with geometric constraints , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  William B. Dunbar,et al.  Model predictive control of coordinated multi-vehicle formations , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[14]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[15]  Tomás Lozano-Pérez,et al.  On multiple moving objects , 2005, Algorithmica.

[16]  Seth Hutchinson,et al.  Path planning for permutation-invariant multirobot formations , 2005, IEEE Transactions on Robotics.

[17]  Vijay Kumar,et al.  Automated composition of motion primitives for multi-robot systems from safe LTL specifications , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Karl Henrik Johansson,et al.  On the stability of distance-based formation control , 2008, 2008 47th IEEE Conference on Decision and Control.

[19]  Vijay Kumar,et al.  Distributed multi-robot task assignment and formation control , 2008, 2008 IEEE International Conference on Robotics and Automation.

[20]  Maja J. Mataric,et al.  A general algorithm for robot formations using local sensing and minimal communication , 2002, IEEE Trans. Robotics Autom..

[21]  Kostas E. Bekris,et al.  Multi-level formation roadmaps for collision-free dynamic shape changes with non-holonomic teams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  Vijay Kumar,et al.  A semidefinite programming framework for controlling multi-robot systems in dynamic environments , 2010, 49th IEEE Conference on Decision and Control (CDC).

[23]  D. Bertsekas The auction algorithm: A distributed relaxation method for the assignment problem , 1988 .

[24]  Richard M. Murray,et al.  INFORMATION FLOW AND COOPERATIVE CONTROL OF VEHICLE FORMATIONS , 2002 .

[25]  Mac Schwager,et al.  Virtual Rigid Bodies for coordinated agile maneuvering of teams of micro aerial vehicles , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Jorge Cortés,et al.  Global and robust formation-shape stabilization of relative sensing networks , 2009, Autom..

[27]  Tucker R. Balch,et al.  Social potentials for scalable multi-robot formations , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[28]  Vijay Kumar,et al.  Modeling and control of formations of nonholonomic mobile robots , 2001, IEEE Trans. Robotics Autom..

[29]  Javier Alonso-Mora,et al.  Multi-robot navigation in formation via sequential convex programming , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Lorenzo Sabattini,et al.  Arbitrarily shaped formations of mobile robots: artificial potential fields and coordinate transformation , 2011, Auton. Robots.

[31]  Xiaoming Hu,et al.  Formation constrained multi-agent control , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[32]  George J. Pappas,et al.  Flocking in Fixed and Switching Networks , 2007, IEEE Transactions on Automatic Control.

[33]  Howie Choset,et al.  Composition of local potential functions for global robot control and navigation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[34]  Jonathan P. How,et al.  Decoupled multiagent path planning via incremental sequential convex programming , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Caio Igor Gonçalves Chinelato,et al.  CONTROL OF COOPERATIVE MOBILE MANIPULATORS TRANSPORTING A PAYLOAD , 2014 .

[36]  Soon-Jo Chung,et al.  Swarm assignment and trajectory optimization using variable-swarm, distributed auction assignment and sequential convex programming , 2016, Int. J. Robotics Res..

[37]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[38]  Javier Alonso-Mora,et al.  Distributed multi-robot formation control among obstacles: A geometric and optimization approach with consensus , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Paul A. Beardsley,et al.  Collision avoidance for aerial vehicles in multi-agent scenarios , 2015, Auton. Robots.

[40]  Vijay Kumar,et al.  Synthesis of Controllers to Create, Maintain, and Reconfigure Robot Formations with Communication Constraints , 2009, ISRR.

[41]  K.J. Kyriakopoulos,et al.  Formation Control and Collision Avoidance for Multi-Agent Systems and a Connection between Formation Infeasibility and Flocking Behavior , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[42]  Oussama Khatib,et al.  Vehicle/arm coordination and multiple mobile manipulator decentralized cooperation , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[43]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[44]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[45]  Petter Ögren,et al.  A control Lyapunov function approach to multi-agent coordination , 2001 .

[46]  Mac Schwager,et al.  Virtual Rigid Bodies for Agile Coordination of Quadrotor Swarms and Human-Swarm Teleoperation , 2015 .

[47]  Chien Chern Cheah,et al.  Region-based shape control for a swarm of robots , 2009, Autom..

[48]  Angela P. Schoellig,et al.  Generation of collision-free trajectories for a quadrocopter fleet: A sequential convex programming approach , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[49]  Rajankumar Bhatt,et al.  Decentralized kinematic control of payload by a system of mobile manipulators , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[50]  Vijay Kumar,et al.  Sequential Composition for Navigating a Nonholonomic Cart in the Presence of Obstacles , 2011, IEEE Transactions on Robotics.

[51]  Robin Deits,et al.  Efficient mixed-integer planning for UAVs in cluttered environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[52]  B. Mittelman,et al.  On control. , 1979, Dental management.

[53]  Roland Siegwart,et al.  Object and animation display with multiple aerial vehicles , 2012, IROS 2012.

[54]  Kostas J. Kyriakopoulos,et al.  Nonholonomic navigation and control of cooperating mobile manipulators , 2003, IEEE Trans. Robotics Autom..

[55]  Nicholas Roy,et al.  Towards A Swarm of Agile Micro Quadrotors , 2013 .

[56]  Venkat Krovi,et al.  Decentralized Kinematic Control of Payload Transport by a System of Mobile Manipulators , 2004 .

[57]  Christopher M. Clark,et al.  Motion planning for formations of mobile robots , 2004, Robotics Auton. Syst..