Persistent Surveillance Using Multiple Unmanned Air Vehicles

Search and exploration using multiple autonomous sensing platforms has been extensively studied in the fields of controls and artificial intelligence. The task of persistent surveillance is different from a coverage or exploration problem, in that the target area needs to be continuously searched, minimizing the time between visitations to the same region. This difference does not allow a straightforward application of most exploration techniques to the problem, although ideas from these methods can still be used. In this research we investigate techniques that are scalable, reliable, efficient, and robust to problem dynamics. These are tested in a multiple unmanned air vehicle (UAV) simulation environment, developed for this program. A semi-heuristic control policy for a single UAV is extended to the case of multiple UAVs using two methods. One is an extension of a reactive policy for a single UAV and the other involves allocation of sub-regions to individual UAVs for parallel exploration. An optimal assignment procedure (based on auction algorithms) has also been developed for this purpose. A comparison is made between the two approaches and a simplified optimal result. The reactive policy is found to exhibit an interesting emergent behavior as the number of UAVs becomes large. The control policy derived for a single UAV is modified to account for actual aircraft dynamics (a 3 degree-of-freedom nonlinear dynamics simulation is used for this purpose) and improvements in performance are observed. Finally, we draw conclusions about the utility and efficiency of these techniques.

[1]  L. Dubins On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[2]  H. Erzberger,et al.  OPTIMUM HORIZONTAL GUIDANCE TECHNIQUES FOR AIRCRAFT , 1971 .

[3]  Robert S. Garfinkel,et al.  Technical Note - An Improved Algorithm for the Bottleneck Assignment Problem , 1971, Oper. Res..

[4]  Jianxiu Hao,et al.  On algorithms for network flow problems , 1989 .

[5]  Frank L. Lewis,et al.  Aircraft Control and Simulation , 1992 .

[6]  Dimitri P. Bertsekas,et al.  Auction algorithms for network flow problems: A tutorial introduction , 1992, Comput. Optim. Appl..

[7]  Eiichi Yoshida,et al.  An algorithm of dividing a work area to multiple mobile robots , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[8]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1997, Auton. Robots.

[9]  John T. Wen,et al.  Trajectory tracking control of a car-trailer system , 1997, IEEE Trans. Control. Syst. Technol..

[10]  Lynne E. Parker,et al.  Current State of the Art in Distributed Autonomous Mobile Robotics , 2000 .

[11]  Wolfram Burgard,et al.  Collaborative multi-robot exploration , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[12]  Towards sensor based coverage with robot teams , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[13]  Guang Yang,et al.  Multi-agent control algorithms for chemical cloud detection and mapping using unmanned air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[15]  Marios M. Polycarpou,et al.  COOPERATIVE PATH-PLANNING FOR AUTONOMOUS VEHICLES USING DYNAMIC PROGRAMMING , 2002 .

[16]  Jonathan P. How,et al.  COORDINATION AND CONTROL OF MULTIPLE UAVs , 2002 .

[17]  Stefano Caselli,et al.  Parallel path planning with multiple evasion strategies , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[18]  Marios M. Polycarpou,et al.  Opportunistically cooperative neural learning in mobile agents , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[19]  Kagan Tumer,et al.  Learning sequences of actions in collectives of autonomous agents , 2002, AAMAS '02.

[20]  E. Fernandez-Gaucherand,et al.  Cooperative control for UAV's searching risky environments for targets , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[21]  Marios M. Polycarpou,et al.  Stochastic Models of a Cooperative Autonomous UAV Search Problem , 2003 .

[22]  Christopher M. Clark,et al.  Motion Planning for Multiple Mobile Robot Systems using Dynamic Networks , 2003 .

[23]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[24]  A. Ollero,et al.  Multiple UAV cooperative searching operation using polygon area decomposition and efficient coverage algorithms , 2004, DARS.

[25]  Howie Choset,et al.  Coverage for robotics – A survey of recent results , 2001, Annals of Mathematics and Artificial Intelligence.

[26]  D. Ghose,et al.  Search using multiple UAVs with flight time constraints , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[27]  G. Sachs Minimum shear wind strength required for dynamic soaring of albatrosses , 2004 .

[28]  Kamran Mohseni,et al.  Information Energy for Sensor-Reactive UAV Flock Control , 2004 .

[29]  Jose B. Cruz,et al.  Coordinating networked uninhabited air vehicles for persistent area denial , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[30]  Kagan Tumer,et al.  Coordinating multi-rover systems: evaluation functions for dynamic and noisy environments , 2005, GECCO '05.

[31]  J. Llinas,et al.  Parametric control of multiple unmanned air vehicles over an unknown hostile territory , 2005, International Conference on Integration of Knowledge Intensive Multi-Agent Systems, 2005..

[32]  Ilan Kroo,et al.  Probability Collectives for Optimization of Computer Simulations , 2007 .

[33]  Dusan M. Stipanovic,et al.  Effective Coverage Control for Mobile Sensor Networks With Guaranteed Collision Avoidance , 2007, IEEE Transactions on Control Systems Technology.

[34]  Mark Campbell,et al.  Optimal Cooperative Reconnaissance Using Multiple Vehicles , 2007 .

[35]  Charles A. Erignac An Exhaustive Swarming Search Strategy based on Distributed Pheromone Maps , 2007 .

[36]  Dimitri P. Bertsekas,et al.  Auction Algorithms , 2009, Encyclopedia of Optimization.

[37]  S. Bhat,et al.  Time-Optimal Feedback Guidance in Two Dimensions under Turn-Rate and Terminal Heading Constraints , .