Formation Control of Mobile Robots Using Multiple Aerial Cameras

This paper describes a new vision-based control method to drive a set of robots moving on the ground plane to a desired formation. As the main contribution, we propose to use multiple camera-equipped unmanned aerial vehicles (UAVs) as control units. Each camera views, and is used to control, a subset of the ground team. Thus, the method is partially distributed, combining the simplicity of centralized schemes with the scalability and robustness of distributed strategies. Relying on a homography computed for each UAV-mounted camera, our approach is purely image-based and has low computational cost. In the control strategy we propose, if a robot is seen by multiple cameras, it computes its motion by combining the commands it receives. Then, if the intersections between the sets of robots viewed by the different cameras satisfy certain conditions, we formally guarantee the stabilization of the formation, considering unicycle robots. We also propose a distributed algorithm to control the camera motions that preserves these required overlaps, using communications. The effectiveness of the presented control scheme is illustrated via simulations and experiments with real robots.

[1]  Daniel Liberzon,et al.  Rendezvous without coordinates , 2008, 2008 47th IEEE Conference on Decision and Control.

[2]  Gonzalo López-Nicolás,et al.  Visual control of mobile robots , 2014, Robotics Auton. Syst..

[3]  Nathan Michael,et al.  Vision-Based, Distributed Control Laws for Motion Coordination of Nonholonomic Robots , 2009, IEEE Transactions on Robotics.

[4]  Magnus Egerstedt,et al.  Multi-UAV Convoy Protection: An Optimal Approach to Path Planning and Coordination , 2010, IEEE Transactions on Robotics.

[5]  Lorenzo Sabattini,et al.  Arbitrarily shaped formations of mobile robots: artificial potential fields and coordinate transformation , 2011, Auton. Robots.

[6]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[7]  Magnus Egerstedt,et al.  Distributed Coordination Control of Multiagent Systems While Preserving Connectedness , 2007, IEEE Transactions on Robotics.

[8]  Karl H. Johansson,et al.  Further results on the stability of distance-based multi-robot formations , 2009, 2009 American Control Conference.

[9]  Vijay Kumar,et al.  Cooperative Visibility Maintenance for Leader–Follower Formations in Obstacle Environments , 2014, IEEE Transactions on Robotics.

[10]  George J. Pappas,et al.  Distributed formation control with permutation symmetries , 2007, 2007 46th IEEE Conference on Decision and Control.

[11]  Gonzalo López-Nicolás,et al.  Visual Control for Multirobot Organized Rendezvous , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Camillo J. Taylor,et al.  A vision-based formation control framework , 2002, IEEE Trans. Robotics Autom..

[13]  Gonzalo López-Nicolás,et al.  Partially distributed multirobot control with multiple cameras , 2013, 2013 American Control Conference.

[14]  Mac Schwager,et al.  Eyes in the Sky: Decentralized Control for the Deployment of Robotic Camera Networks , 2011, Proceedings of the IEEE.

[15]  Dimos V. Dimarogonas,et al.  A connection between formation infeasibility and velocity alignment in kinematic multi-agent systems , 2008, Autom..

[16]  Jin Bae Park,et al.  Adaptive Formation Control of Electrically Driven Nonholonomic Mobile Robots With Limited Information , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  René Vidal,et al.  Distributed Formation Control with Omnidirectional Vision-Based Motion Segmentation and Visual Servoing , 2004 .

[18]  S. Shankar Sastry,et al.  Following the flock [formation control] , 2004, IEEE Robotics & Automation Magazine.

[19]  M. Cao,et al.  Adaptive control schemes for mobile robot formations with triangularised structures , 2010 .

[20]  Vijay Kumar,et al.  Controlling Ensembles of Robots via a Supervisory Aerial Robot , 2008, Adv. Robotics.