Coordination and navigation of heterogeneous MAV–UGV formations localized by a ‘hawk-eye’-like approach under a model predictive control scheme

An approach for coordination and control of 3D heterogeneous formations of unmanned aerial and ground vehicles under hawk-eye-like relative localization is presented in this paper. The core of the method lies in the use of visual top-view feedback from flying robots for the stabilization of the entire group in a leader–follower formation. We formulate a novel model predictive control-based methodology for guiding the formation. The method is employed to solve the trajectory planning and control of a virtual leader into a desired target region. In addition, the method is used for keeping the following vehicles in the desired shape of the group. The approach is designed to ensure direct visibility between aerial and ground vehicles, which is crucial for the formation stabilization using the hawk-eye-like approach. The presented system is verified in numerous experiments inspired by search-and-rescue applications, where the formation acts as a searching phalanx. In addition, stability and convergence analyses are provided to explicitly determine the limitations of the method in real-world applications.

[1]  Klaus Schilling,et al.  Application of coordinated multi-vehicle formations for snow shoveling on airports , 2009, Intell. Serv. Robotics.

[2]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[3]  William B. Dunbar,et al.  Distributed receding horizon control for multi-vehicle formation stabilization , 2006, Autom..

[4]  Libor Preucil,et al.  Low cost MAV platform AR-drone in experimental verifications of methods for vision based autonomous navigation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Drago Matko,et al.  A control strategy for platoons of differential drive wheeled mobile robot , 2011, Robotics Auton. Syst..

[6]  Libor Preucil,et al.  Coordination and navigation of heterogeneous UAVs-UGVs teams localized by a hawk-eye approach , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Randal W. Beard,et al.  A decentralized approach to formation maneuvers , 2003, IEEE Trans. Robotics Autom..

[8]  Rafael Castro-Linares,et al.  Trajectory tracking for non-holonomic cars: A linear approach to controlled leader-follower formation , 2010, 49th IEEE Conference on Decision and Control (CDC).

[9]  Christopher M. Clark,et al.  Motion planning for formations of mobile robots , 2004, Robotics Auton. Syst..

[10]  Zhou Chao,et al.  UAV Formation Flight Based on Nonlinear Model Predictive Control , 2012 .

[11]  Dusan M. Stipanovic,et al.  Formation Control and Collision Avoidance for Multi-agent Non-holonomic Systems: Theory and Experiments , 2008, Int. J. Robotics Res..

[12]  Vijay Kumar,et al.  Modeling and control of formations of nonholonomic mobile robots , 2001, IEEE Trans. Robotics Autom..

[13]  Vijay Kumar,et al.  Trajectory design and control for aggressive formation flight with quadrotors , 2012, Auton. Robots.

[14]  Maja J. Mataric,et al.  A general algorithm for robot formations using local sensing and minimal communication , 2002, IEEE Trans. Robotics Autom..

[15]  Patrick Doherty,et al.  Relay Positioning for Unmanned Aerial Vehicle Surveillance* , 2010, Int. J. Robotics Res..

[16]  Pedro U. Lima,et al.  Robot formation motion planning using Fast Marching , 2011, Robotics Auton. Syst..

[17]  Mazen Alamir,et al.  Stabilization of nonlinear systems using receding-horizon control schemes , 2013 .

[18]  Long Wang,et al.  Finite-time formation control for multi-agent systems , 2009, Autom..

[19]  Yang Liu,et al.  An iterative learning approach to formation control of multi-agent systems , 2012, Syst. Control. Lett..

[20]  Mark W. Spong,et al.  Cooperative Avoidance Control for Multiagent Systems , 2007 .

[21]  Libor Preucil,et al.  Roads sweeping by unmanned multi-vehicle formations , 2011, 2011 IEEE International Conference on Robotics and Automation.

[22]  Jan Faigl,et al.  AR-Drone as a Platform for Robotic Research and Education , 2011, Eurobot Conference.

[23]  Xun-Lin Zhu,et al.  Consensus of Second-Order Delayed Multi-Agent Systems with Leader-Following , 2010, Eur. J. Control.

[24]  Maarouf Saad,et al.  Formation path following control of unicycle-type mobile robots , 2008, 2008 IEEE International Conference on Robotics and Automation.

[25]  Oscar Barambones,et al.  ROBUST ADAPTIVE CONTROL FOR ROBOT MANIPULATORS WITH UNMODELLED DYNAMICS , 2000, Cybern. Syst..

[26]  T. Krajnik,et al.  Cooperative μUAV-UGV autonomous indoor surveillance , 2012, International Multi-Conference on Systems, Sygnals & Devices.

[27]  Haibin Duan,et al.  Receding horizon control for multi-UAVs close formation control based on differential evolution , 2010, Science China Information Sciences.

[28]  Vijay Kumar,et al.  Trajectory Generation and Control for Precise Aggressive Maneuvers with Quadrotors , 2010, ISER.

[29]  Jian Chen,et al.  Leader-Follower Formation Control of Multiple Non-holonomic Mobile Robots Incorporating a Receding-horizon Scheme , 2010, Int. J. Robotics Res..

[30]  Khac Duc Do,et al.  Practical Formation Control of Multiple Unicycle-Type Mobile Robots with Limited Sensing Ranges , 2011, J. Intell. Robotic Syst..

[31]  Vijay Kumar,et al.  Towards a swarm of agile micro quadrotors , 2012, Robotics: Science and Systems.

[32]  Randal W. Beard,et al.  A coordination architecture for spacecraft formation control , 2001, IEEE Trans. Control. Syst. Technol..

[33]  Camillo J. Taylor,et al.  A vision-based formation control framework , 2002, IEEE Trans. Robotics Autom..

[34]  Vijay Kumar,et al.  Planning and Control of Ensembles of Robots with Non-holonomic Constraints , 2009, Int. J. Robotics Res..

[35]  Farbod Fahimi,et al.  Non-Iterative nonlinear model predictive approach applied to the control of helicopters' group formation , 2009, Robotics Auton. Syst..

[36]  Jorge Cortes,et al.  Distributed Control of Robotic Networks: A Mathematical Approach to Motion Coordination Algorithms , 2009 .

[37]  Nikolaos Papanikolopoulos,et al.  Robot Formations Using a Single Camera and Entropy-based Segmentation , 2012, J. Intell. Robotic Syst..

[38]  Marios M. Polycarpou,et al.  Cooperative Constrained Control of Distributed Agents With Nonlinear Dynamics and Delayed Information Exchange: A Stabilizing Receding-Horizon Approach , 2008, IEEE Transactions on Automatic Control.

[39]  Libor Preucil,et al.  A Control System for Multi-Robotic Communities , 2006, 2006 IEEE Conference on Emerging Technologies and Factory Automation.

[40]  Libor Preucil,et al.  Low-cost embedded system for relative localization in robotic swarms , 2013, 2013 IEEE International Conference on Robotics and Automation.

[41]  Michael Defoort Distributed receding horizon planning for multi-robot systems , 2010, 2010 IEEE International Conference on Control Applications.

[42]  Min-Jea Tahk,et al.  Cascade-type guidance law design for multiple-UAV formation keeping , 2011 .

[43]  Wenjie Dong,et al.  Robust Formation Control of Multiple Wheeled Mobile Robots , 2011, J. Intell. Robotic Syst..

[44]  Wen-Hua Chen,et al.  Piecewise constant model predictive control for autonomous helicopters , 2011, Robotics Auton. Syst..

[45]  Vijay Kumar,et al.  Trajectory generation and control for precise aggressive maneuvers with quadrotors , 2012, Int. J. Robotics Res..

[46]  Eliseo Ferrante,et al.  Swarmanoid: A Novel Concept for the Study of Heterogeneous Robotic Swarms , 2013, IEEE Robotics & Automation Magazine.

[47]  Libor Preucil,et al.  Simple yet stable bearing-only navigation , 2010, J. Field Robotics.

[48]  Wei Ren Decentralization of Virtual Structures in Formation Control of Multiple Vehicle Systems via Consensus Strategies , 2008, Eur. J. Control.

[49]  Martial Hebert,et al.  A behavior-based system for off-road navigation , 1994, IEEE Trans. Robotics Autom..

[50]  H. Jin Kim,et al.  Nonlinear Model Predictive Formation Flight , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[51]  Herbert G. Tanner,et al.  Decentralized cooperative control of heterogeneous vehicle groups , 2007, Robotics Auton. Syst..

[52]  Abdelkader Abdessameud,et al.  Formation control of VTOL Unmanned Aerial Vehicles with communication delays , 2011, Autom..

[53]  David Obdrzalek,et al.  Research and Education in Robotics - EUROBOT 2011 - International Conference, Prague, Czech Republic, June 15-17, 2011. Proceedings , 2011, Eurobot Conference.

[54]  Francesco Bullo,et al.  Distributed Control of Robotic Networks , 2009 .

[55]  Stjepan Bogdan,et al.  Multi-Agent Formation Control Based on Bell-Shaped Potential Functions , 2010, J. Intell. Robotic Syst..

[56]  David Q. Mayne,et al.  Correction to "Constrained model predictive control: stability and optimality" , 2001, Autom..

[57]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[58]  Vijay Kumar,et al.  Opportunities and challenges with autonomous micro aerial vehicles , 2012, Int. J. Robotics Res..