Modeling and Control of UAV Bearing Formations with Bilateral High-level Steering

In this paper we address the problem of controlling the motion of a group of unmanned aerial vehicles (UAVs) bound to keep a formation defined in terms of only relative angles (i.e. a bearing formation). This problem can naturally arise within the context of several multi-robot applications such as, e.g. exploration, coverage, and surveillance. First, we introduce and thoroughly analyze the concept and properties of bearing formations, and provide a class of minimally linear sets of bearings sufficient to uniquely define such formations. We then propose a bearing-only formation controller requiring only bearing measurements, converging almost globally, and maintaining bounded inter-agent distances despite the lack of direct metric information. The controller still leaves the possibility of imposing group motions tangent to the current bearing formation. These can be either autonomously chosen by the robots because of any additional task (e.g. exploration), or exploited by an assisting human co-operator. For this latter ‘human-in-the-loop’ case, we propose a multi-master/multi-slave bilateral shared control system providing the co-operator with some suitable force cues informative of the UAV performance. The proposed theoretical framework is extensively validated by means of simulations and experiments with quadrotor UAVs equipped with onboard cameras. Practical limitations, e.g. limited field-of-view, are also considered.

[1]  Dongjun Lee,et al.  Bilateral Teleoperation of Multiple Cooperative Robots over Delayed Communication Networks: Theory , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[2]  Alberto Isidori,et al.  Nonlinear control systems: an introduction (2nd ed.) , 1989 .

[3]  Roland Siegwart,et al.  Closed-form solution for absolute scale velocity determination combining inertial measurements and a single feature correspondence , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  S. Shankar Sastry,et al.  Formation control of nonholonomic mobile robots with omnidirectional visual servoing and motion segmentation , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[5]  H. David Kirk Search and Rescue , 1997 .

[6]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[7]  Antonio Franchi,et al.  Bilateral Teleoperation of Groups of Mobile Robots With Time-Varying Topology , 2012, IEEE Transactions on Robotics.

[8]  M. Fliess,et al.  Flatness and defect of non-linear systems: introductory theory and examples , 1995 .

[9]  Giuseppe Oriolo,et al.  Probabilistic mutual localization in multi-agent systems from anonymous position measures , 2010, 49th IEEE Conference on Decision and Control (CDC).

[10]  Dongjun Lee,et al.  Passive-Set-Position-Modulation Framework for Interactive Robotic Systems , 2010, IEEE Transactions on Robotics.

[11]  Gianluca Antonelli,et al.  Experiments of Formation Control With Multirobot Systems Using the Null-Space-Based Behavioral Control , 2009, IEEE Transactions on Control Systems Technology.

[12]  Calin Belta,et al.  Abstraction and control for Groups of robots , 2004, IEEE Transactions on Robotics.

[13]  I. Mas,et al.  Cluster Space Specification and Control of Mobile Multirobot Systems , 2009, IEEE/ASME Transactions on Mechatronics.

[14]  Heinrich H. Bülthoff,et al.  On-board velocity estimation and closed-loop control of a quadrotor UAV based on optical flow , 2012, 2012 IEEE International Conference on Robotics and Automation.

[15]  A.J. Calise,et al.  Approaches to vision-based formation control , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[16]  Mac Schwager,et al.  Eyes in the Sky: Decentralized Control for the Deployment of Robotic Camera Networks , 2011, Proceedings of the IEEE.

[17]  Camillo J. Taylor,et al.  A vision-based formation control framework , 2002, IEEE Trans. Robotics Autom..

[18]  Antonio Franchi,et al.  Shared Control : Balancing Autonomy and Human Assistance with a Group of Quadrotor UAVs , 2012, IEEE Robotics & Automation Magazine.

[19]  P Robuffo Giordano Bilateral Teleoperation of Groups of Mobile Robots , 2011 .

[20]  S SukhatmeGaurav,et al.  Visual-Inertial Sensor Fusion , 2011 .

[21]  Antonio Franchi,et al.  SwarmSimX: Real-Time Simulation Environment for Multi-robot Systems , 2012, SIMPAR.

[22]  Nancy A. Lynch,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[23]  Antonio Franchi,et al.  Bilateral Teleoperation of Groups of UAVs with Decentralized Connectivity Maintenance , 2011, Robotics: Science and Systems.

[24]  Antonio Franchi,et al.  Distributed Pursuit-Evasion without Global Localization via Local Frontiers , 2010 .

[25]  Frans C. T. van der Helm,et al.  Measuring Neuromuscular Control Dynamics During Car Following With Continuous Haptic Feedback , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  René van Paassen,et al.  Artificial Force Field for Haptic Feedback in UAV Teleoperation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Antonio Franchi,et al.  A passivity-based decentralized approach for the bilateral teleoperation of a group of UAVs with switching topology , 2011, 2011 IEEE International Conference on Robotics and Automation.

[28]  Robert E. Mahony,et al.  Nonlinear Complementary Filters on the Special Orthogonal Group , 2008, IEEE Transactions on Automatic Control.

[29]  G. Oriolo,et al.  The Sensor-based Random Graph Method for Cooperative Robot Exploration , 2009, IEEE/ASME Transactions on Mechatronics.

[30]  Giuseppe Oriolo,et al.  3-D mutual localization with anonymous bearing measurements , 2012, 2012 IEEE International Conference on Robotics and Automation.

[31]  Antonio Franchi,et al.  Haptic teleoperation of multiple unmanned aerial vehicles over the internet , 2011, 2011 IEEE International Conference on Robotics and Automation.

[32]  Nathan Michael,et al.  Vision-Based, Distributed Control Laws for Motion Coordination of Nonholonomic Robots , 2009, IEEE Transactions on Robotics.

[33]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[34]  Gaurav S. Sukhatme,et al.  Experiments with a Large Heterogeneous Mobile Robot Team: Exploration, Mapping, Deployment and Detection , 2006, Int. J. Robotics Res..

[35]  R. Murray,et al.  Real‐time trajectory generation for differentially flat systems , 1998 .

[36]  Elias B. Kosmatopoulos,et al.  Multi-robot three-dimensional coverage of unknown areas , 2012, Int. J. Robotics Res..

[37]  B. Anderson,et al.  Sensor and network topologies of formations with direction, bearing, and angle information between agents , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[38]  T. Eren,et al.  Using Angle of Arrival (Bearing) Information in Network Localization , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[39]  Vijay Kumar,et al.  The GRASP Multiple Micro-UAV Testbed , 2010, IEEE Robotics & Automation Magazine.

[40]  A. Benallegue,et al.  Exact linearization and noninteracting control of a 4 rotors helicopter via dynamic feedback , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[41]  Dusan M. Stipanovic,et al.  Bilateral Teleoperation of Multiple Mobile Agents: Coordinated Motion and Collision Avoidance , 2010, IEEE Transactions on Control Systems Technology.

[42]  Nathan Michael,et al.  Vision-Based Localization for Leader–Follower Formation Control , 2009, IEEE Transactions on Robotics.

[43]  Paolo Fiorini,et al.  Search and Rescue Robotics , 2008, Springer Handbook of Robotics.

[44]  Neville Hogan,et al.  Controlling impedance at the man/machine interface , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[45]  Antonio Franchi,et al.  Experiments of passivity-based bilateral aerial teleoperation of a group of UAVs with decentralized velocity synchronization , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Antonio Franchi,et al.  Bilateral teleoperation of a group of UAVs with communication delays and switching topology , 2012, 2012 IEEE International Conference on Robotics and Automation.

[47]  R. Fierro,et al.  Robust vision-based nonlinear formation control , 2006, 2006 American Control Conference.

[48]  Antonio Franchi,et al.  Distributed pursuit-evasion without mapping or global localization via local frontiers , 2012, Auton. Robots.