Control and design of multiple unmanned air vehicles for persistent surveillance

Control of multiple autonomous aircraft for search and exploration, is a topic of current research interest for applications such as weather monitoring, geographical surveys, search and rescue, tactical reconnaissance, and extra-terrestrial exploration, and the need to distribute sensing is driven by considerations of efficiency, reliability, cost and scalability. Hence, this problem has been extensively studied in the fields of controls and artificial intelligence. The task of persistent surveillance is different from a coverage/exploration problem, in that all areas need to be continuously searched, minimizing the time between visitations to each region in the target space. This distinction does not allow a straightforward application of most exploration techniques to the problem, although ideas from these methods can still be used. The use of aerial vehicles is motivated by their ability to cover larger spaces and their relative insensitivity to terrain. However, the dynamics of Unmanned Air Vehicles (UAVs) adds complexity to the control problem. Most of the work in the literature decouples the vehicle dynamics and control policies, but their interaction is particularly interesting for a surveillance mission. Stochastic environments and UAV failures further enrich the problem by requiring the control policies to be robust, and this aspect is particularly important for hardware implementations. For a persistent mission, it becomes imperative to consider the range/endurance constraints of the vehicles. The coupling of the control policy with the endurance constraints of the vehicles is an aspect that has not been sufficiently explored. Design of UAVs for desirable mission performance is also an issue of considerable significance. The use of a single monolithic optimization for such a problem has practical limitations, and decomposition-based design is a potential alternative. In this research high-level control policies are devised, that are scalable, reliable, efficient, and robust to changes in the environment. Most of the existing techniques that carry performance guarantees are not scalable or robust to changes. The scalable techniques are often heuristic in nature, resulting in lack of reliability and performance. Our policies are tested in a multi-UAV simulation environment developed for this problem, and shown to be near-optimal in spite of being completely reactive in nature. We explicitly account for the coupling between aircraft dynamics and control policies as well, and suggest modifications to improve performance under dynamic constraints. A smart refueling policy is also developed to account for limited endurance, and large performance benefits are observed. The method is based on the solution of a linear program that can be efficiently solved online in a distributed setting, unlike previous work. The Vehicle Swarm Technology Laboratory (VSTL), a hardware testbed developed at Boeing Research and Technology for evaluating swarm of UAVs, is described next and used to test the control strategy in a real-world scenario. The simplicity and robustness of the strategy allows easy implementation and near replication of the performance observed in simulation. Finally, an architecture for system-of-systems design based on Collaborative Optimization (CO) is presented. Earlier work coupling operations and design has used frameworks that make certain assumptions not valid for this problem. The efficacy of our approach is illustrated through preliminary design results, and extension to more realistic settings is also demonstrated.

[1]  S. Sitharama Iyengar,et al.  Autonomous Mobile Robots , 1991 .

[2]  Victor Adolfsson The State of the Art in Distributed Mobile Robotics , 2001 .

[3]  Jonathan P. How,et al.  Cooperative path planning for multiple UAVs in dynamic and uncertain environments , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[4]  Guang Yang,et al.  Multi-agent control algorithms for chemical cloud detection and mapping using unmanned air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  William A. Crossley,et al.  Evaluating Morphing Aircraft in a Fleet Context Using Non- Deterministic Metrics , 2005 .

[6]  Panos Y. Papalambros,et al.  Analytical Target Cascading in Product Family Design , 2006 .

[7]  Wolfram Burgard,et al.  Collaborative multi-robot exploration , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[8]  William A. Crossley,et al.  Building Surrogate Models for Capability-Based Evaluation: Comparing Morphing and Fixed Geometry Aircraft in a Fleet Context , 2006 .

[9]  Ilan Kroo,et al.  Probability Collectives for Optimization of Computer Simulations , 2007 .

[10]  Marios M. Polycarpou,et al.  Stochastic Models of a Cooperative Autonomous UAV Search Problem , 2003 .

[11]  Kagan Tumer,et al.  Coordinating multi-rover systems: evaluation functions for dynamic and noisy environments , 2005, GECCO '05.

[12]  H. Erzberger,et al.  OPTIMUM HORIZONTAL GUIDANCE TECHNIQUES FOR AIRCRAFT , 1971 .

[13]  Gaurav S. Sukhatme,et al.  The Analysis of an Efficient Algorithm for Robot Coverage and Exploration based on Sensor Network Deployment , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[14]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[15]  Mark Campbell,et al.  Optimal Cooperative Reconnaissance Using Multiple Vehicles , 2007 .

[16]  Frank L. Lewis,et al.  Aircraft Control and Simulation , 1992 .

[17]  Wolfram Burgard,et al.  Collaborative Exploration of Unknown Environments with Teams of Mobile Robots , 2001, Advances in Plan-Based Control of Robotic Agents.

[18]  John T. Wen,et al.  Trajectory tracking control of a car-trailer system , 1997, IEEE Trans. Control. Syst. Technol..

[19]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1997, Auton. Robots.

[20]  Eiichi Yoshida,et al.  An algorithm of dividing a work area to multiple mobile robots , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[21]  Eric Bonabeau,et al.  Control of UAV Swarms: What the Bugs Can Teach Us , 2003 .

[22]  Jose B. Cruz,et al.  Coordinating networked uninhabited air vehicles for persistent area denial , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[23]  Howie Choset,et al.  Critical point sensing in unknown environments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[24]  Marjorie Darrah,et al.  Increasing UAV Task Assignment Performance through Parallelized Genetic Algorithms , 2007 .

[25]  Boleslaw K. Szymanski,et al.  Efficient and inefficient ant coverage methods , 2001, Annals of Mathematics and Artificial Intelligence.

[26]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[27]  Robert D. Braun,et al.  Collaborative optimization: an architecture for large-scale distributed design , 1996 .

[28]  Noam Hazon,et al.  Towards robust on-line multi-robot coverage , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[29]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[30]  Howie Choset,et al.  Coverage Path Planning: The Boustrophedon Cellular Decomposition , 1998 .

[31]  Mark Baldesarra,et al.  Operations Simulation Framework to Evaluate Vehicle Designs for Planetary Surface Exploration , 2007 .

[32]  D. Ghose,et al.  Search using multiple UAVs with flight time constraints , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[33]  Kamran Mohseni,et al.  Information Energy for Sensor-Reactive UAV Flock Control , 2004 .

[34]  Andres Sousa-Poza,et al.  System of systems engineering , 2003, IEEE Engineering Management Review.

[35]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[36]  Howie Choset,et al.  Sensor-based Coverage of Unknown Environments: Incremental Construction of Morse Decompositions , 2002, Int. J. Robotics Res..

[37]  Wei Min Tao,et al.  A decentralized approach for cooperative sweeping by multiple mobile robots , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[38]  Jonathan P. How,et al.  COORDINATION AND CONTROL OF MULTIPLE UAVs , 2002 .

[39]  Sven Koenig,et al.  Robot exploration with combinatorial auctions , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[40]  Howie Choset,et al.  Coverage for robotics – A survey of recent results , 2001, Annals of Mathematics and Artificial Intelligence.

[41]  Ilan Kroo,et al.  Use of the Collaborative Optimization Architecture for Launch Vehicle Design , 1996 .

[42]  Jonathan P. How,et al.  Receding horizon control of autonomous aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[43]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[44]  Marios M. Polycarpou,et al.  COOPERATIVE PATH-PLANNING FOR AUTONOMOUS VEHICLES USING DYNAMIC PROGRAMMING , 2002 .

[45]  I. Kroo,et al.  Persistent Surveillance Using Multiple Unmanned Air Vehicles , 2008, 2008 IEEE Aerospace Conference.

[46]  Walter Murray,et al.  Two decomposition algorithms for nonconvex optimization problems with global variables , 2001 .

[47]  Wright-Patterson Afb,et al.  TASK ALLOCATION FOR WIDE AREA SEARCH MUNITIONS VIA NETWORK FLOW OPTIMIZATION , 2001 .

[48]  Dusan M. Stipanovic,et al.  On persistent coverage control , 2007, 2007 46th IEEE Conference on Decision and Control.

[49]  Sung June Chang,et al.  Free movimg pattern's Online Spanning Tree Coverage Algorithm , 2006, 2006 SICE-ICASE International Joint Conference.

[50]  Maria L. Gini,et al.  Autonomous Mobile Robots and Distributed Exploratory Missions , 2000, DARS.

[51]  L. Dubins On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[52]  Charles A. Erignac An Exhaustive Swarming Search Strategy based on Distributed Pheromone Maps , 2007 .

[53]  Dimitri N. Mavris,et al.  System of Systems Modeling for Personal Air Vehicles , 2002 .

[54]  Dimitri N. Mavris,et al.  The Need for a Military System Effectiveness Framework: The System of Systems Approach , 2001 .

[55]  E. Fernandez-Gaucherand,et al.  Cooperative control for UAV's searching risky environments for targets , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[56]  Sebastian Thrun,et al.  Exploration and model building in mobile robot domains , 1993, IEEE International Conference on Neural Networks.

[57]  G. Sachs Minimum shear wind strength required for dynamic soaring of albatrosses , 2004 .