Control of Multiple UAVs for Persistent Surveillance: Algorithm and Flight Test Results

Interest in control of multiple autonomous vehicles continues to grow for applications such as weather monitoring, geographical mapping fauna surveys, and extra-terrestrial exploration. The task of persistent surveillance is of particular significance in that the target area needs to be continuously surveyed, minimizing the time between visitations to the same region. This distinction from one-time coverage does not allow a straightforward application of most exploration techniques to the problem, though ideas from these methods can still be used. The aerial vehicle dynamic and endurance constraints add additional complexity to the autonomous control problem, whereas stochastic environments and vehicle failures introduce uncertainty. In this work, we investigate techniques for high-level control, that are scalable, reliable, efficient, and robust to problem dynamics. Next, we suggest a modification to the control policy to account for aircraft dynamic constraints. We also devise a health monitoring policy and a control policy modification to improve performance under endurance constraints. The Vehicle Swarm Technology Laboratory-a hardware testbed developed at Boeing Research and Technology, Seattle, WA, for evaluating a swarm of unmanned air vehicles-is then described, and these control policies are tested in a realistic scenario.

[1]  Y. Charlie Hu,et al.  Deployment of mobile robots with energy and timing constraints , 2006, IEEE Transactions on Robotics.

[2]  Jeff S. Shamma,et al.  Cooperative Control of Distributed Multi-Agent Systems , 2008 .

[3]  Wolfram Burgard,et al.  Collaborative multi-robot exploration , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[4]  Marios M. Polycarpou,et al.  Cooperative Control of Distributed Multi-Agent Systems , 2001 .

[5]  Wolfram Burgard,et al.  Collaborative Exploration of Unknown Environments with Teams of Mobile Robots , 2001, Advances in Plan-Based Control of Robotic Agents.

[6]  Ilan Kroo,et al.  Probability Collectives for Optimization of Computer Simulations , 2007 .

[7]  Sebastian Thrun,et al.  Exploration and model building in mobile robot domains , 1993, IEEE International Conference on Neural Networks.

[8]  M. Pachter,et al.  Research issues in autonomous control of tactical UAVs , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[9]  G. Sachs Minimum shear wind strength required for dynamic soaring of albatrosses , 2004 .

[10]  Jose B. Cruz,et al.  Coordinating networked uninhabited air vehicles for persistent area denial , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[11]  Eric W. Frew,et al.  Flight Demonstrations of Self-directed Collaborative Navigation of Small Unmanned Aircraft , 2004 .

[12]  Gaurav S. Sukhatme,et al.  The Analysis of an Efficient Algorithm for Robot Coverage and Exploration based on Sensor Network Deployment , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[13]  Ilan Kroo,et al.  Control of Multiple UAVs for Persistent Surveillance: Algorithm Description and Hardware Demonstration , 2009 .

[14]  Jonathan P. How,et al.  Receding horizon control of autonomous aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[15]  Boleslaw K. Szymanski,et al.  Efficient and inefficient ant coverage methods , 2001, Annals of Mathematics and Artificial Intelligence.

[16]  Sven Koenig,et al.  Robot exploration with combinatorial auctions , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[17]  Howie Choset,et al.  Coverage for robotics – A survey of recent results , 2001, Annals of Mathematics and Artificial Intelligence.

[18]  Dusan M. Stipanovic,et al.  On persistent coverage control , 2007, 2007 46th IEEE Conference on Decision and Control.

[19]  Stefan R. Bieniawski,et al.  Control and Management of an Indoor, Health Enabled, Heterogenous Fleet , 2009 .

[20]  Wei Min Tao,et al.  A decentralized approach for cooperative sweeping by multiple mobile robots , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[21]  Susanne Albers,et al.  Exploring Unknown Environments with Obstacles , 1999, SODA '99.

[22]  Mark Campbell,et al.  Optimal Cooperative Reconnaissance Using Multiple Vehicles , 2007 .

[23]  David Gross,et al.  An Overview of the Cooperative Operations in UrbaN TERrain (COUNTER) Program , 2008 .

[24]  Alex Fukunaga,et al.  Cooperative mobile robotics: antecedents and directions , 1995 .

[25]  Kagan Tumer,et al.  Efficient Evaluation Functions for Multi-rover Systems , 2004, GECCO.

[26]  Marios Polycarpou,et al.  AFRL-VA-WP-TP-2003-304 COOPERATIVE CONTROL FOR UAVs SEARCHING RISKY ENVIRONMENTS FOR TARGETS , 2004 .

[27]  Howie Choset,et al.  Coverage Path Planning: The Boustrophedon Cellular Decomposition , 1998 .

[28]  Victor Adolfsson The State of the Art in Distributed Mobile Robotics , 2001 .

[29]  Elon Rimon,et al.  Spanning-tree based coverage of continuous areas by a mobile robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[30]  Jonathan P. How,et al.  COORDINATION AND CONTROL OF MULTIPLE UAVs , 2002 .

[31]  Stefan Bieniawski,et al.  Vehicle Swarm Rapid Prototyping Testbed , 2009 .

[32]  Jonathan P. How,et al.  Mission Health Management for 24/7 Persistent Surveillance Operations , 2007 .

[33]  D. Ghose,et al.  Search using multiple UAVs with flight time constraints , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[34]  Kamran Mohseni,et al.  Information Energy for Sensor-Reactive UAV Flock Control , 2004 .

[35]  C. E. Francis Nomenclature , 1883, The Dental register.

[36]  Marios M. Polycarpou,et al.  Stochastic Models of a Cooperative Autonomous UAV Search Problem , 2003 .

[37]  Kagan Tumer,et al.  Coordinating multi-rover systems: evaluation functions for dynamic and noisy environments , 2005, GECCO '05.

[38]  Lynne E. Parker,et al.  Current State of the Art in Distributed Autonomous Mobile Robotics , 2000 .

[39]  Noam Hazon,et al.  Towards robust on-line multi-robot coverage , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[40]  Brett Bethke,et al.  Exploring Health-Enabled Mission Concepts in the Vehicle Swarm Technology Laboratory , 2009 .

[41]  Sung June Chang,et al.  Free movimg pattern's Online Spanning Tree Coverage Algorithm , 2006, 2006 SICE-ICASE International Joint Conference.

[42]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[43]  Howie Choset,et al.  Sensor-based Coverage of Unknown Environments: Incremental Construction of Morse Decompositions , 2002, Int. J. Robotics Res..

[44]  S. Bhat,et al.  Time-Optimal Feedback Guidance in Two Dimensions under Turn-Rate and Terminal Heading Constraints , .

[45]  Eiichi Yoshida,et al.  An algorithm of dividing a work area to multiple mobile robots , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[46]  Eric Bonabeau,et al.  Control of UAV Swarms: What the Bugs Can Teach Us , 2003 .

[47]  Howie Choset,et al.  Critical point sensing in unknown environments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[48]  S. Pratt,et al.  Guidance and control for cooperative search , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[49]  L. Dubins On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[50]  Charles A. Erignac An Exhaustive Swarming Search Strategy based on Distributed Pheromone Maps , 2007 .

[51]  Jonathan P. How,et al.  Experimental Demonstration of Adaptive MDP-Based Planning with Model Uncertainty , 2008 .

[52]  Christos G. Cassandras,et al.  Sensor Networks and Cooperative Control , 2005, CDC 2005.

[53]  Nikhil Nigam,et al.  Control and design of multiple unmanned air vehicles for persistent surveillance , 2009 .

[54]  Maria L. Gini,et al.  Autonomous Mobile Robots and Distributed Exploratory Missions , 2000, DARS.

[55]  Wolfram Burgard,et al.  Coordination for Multi-Robot Exploration and Mapping , 2000, AAAI/IAAI.

[56]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[57]  Marios M. Polycarpou,et al.  COOPERATIVE PATH-PLANNING FOR AUTONOMOUS VEHICLES USING DYNAMIC PROGRAMMING , 2002 .

[58]  Guang Yang,et al.  Multi-agent control algorithms for chemical cloud detection and mapping using unmanned air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Jun Ota,et al.  Cooperative sweeping by multiple mobile robots with relocating portable obstacles , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[60]  Jonathan P. How,et al.  Cooperative path planning for multiple UAVs in dynamic and uncertain environments , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[61]  I. Kroo,et al.  Persistent Surveillance Using Multiple Unmanned Air Vehicles , 2008, 2008 IEEE Aerospace Conference.