Search by UAVs with Flight Time Constraints using Game Theoretical Models

This paper addresses the problem of obtaining search routes for UAVs with ∞ight time constraints performing search operations in an unknown region. The UAVs start the search mission from a base station and have to return to a base station for refuelling. This requirement acts as a constraint on the available paths. Optimal search route decisions for a flnite horizon are obtained using a game theoretical framework depending on the level of cooperation between UAVs. The performance of these game theoretical strategies { noncooperative Nash and cooperative { are evaluated for difierent length look ahead policies. Simulation results show that the non-cooperative strategies perform as well as the cooperative strategy even though they require no communication between UAVs. Unmanned aerials vehicles (UAVs) are widely being considered for search and surveillance operations in remote, inaccessible, and hostile regions. The UAVs are equipped with sensors that collect necessary information as they ∞y over a region. The UAVs need to ∞y many sorties to collect complete and accurate information about the unknown region. In this sense, these UAVs are difierent from search munitions which usually are of single use type and are destroyed at the end of a single mission. The UAVs have limited fuel capacity and have to return to the base for refuelling before they ∞y another sortie. A desirable feature for these UAVs is to have the ability of on-board autonomous decision-making for real-time search route planning. An efiective search route plan is one that takes into account the presence of other UAVs and the amount of uncertainty that various areas in the search region have. This problem becomes complex when more than one UAV is deployed to perform the search operation. The search of an unknown region can be more efiective if the UAVs cooperate with each other. The search decisions have to be optimal over a flnite horizon search space, although this does not ensure optimality of the full sortie. Moreover, the route decisions have to be made at every step over a flnite horizon, taking into account the requirement that the UAV has to return to a base station. The problem of search route planning becomes still more di‐cult when there are multiple base stations and a UAV has the option of selecting one of them for refuelling. The other aspect of decision-making involves the optimality of a search step (movement of a UAV from one cell to another at a given time) based on the uncertainty associated with the surrounding area. If we assume a scenario where the UAVs are tracked by some other airborne system that updates them on the location of the other UAVs, then the decision-making is reduced to taking a most favourable joint decision by all the UAVs provided they communicate among themselves to arrive at this joint decision. However, quite often the UAVs may have very limited communication capability. Under these circumstances, a UAV has to depend on decision-making algorithms that consider only the location of the other UAVs and the uncertainty associated with the search region to arrive at an "optimal" decision. In this paper, we propose a game theoretical approach to route decision-making that takes into account various levels of communication capabilities possessed by the UAVs while taking the ∞ight time (or refuelling) constraint into account.

[1]  Izhak Rubin,et al.  A framework and analysis for cooperative search using UAV swarms , 2004, SAC '04.

[2]  James N. Eagle,et al.  Using multiple searchers in constrained‐path, moving‐target search problems , 1996 .

[3]  Marios M. Polycarpou,et al.  Decentralized Cooperative Search in UAV's Using Opportunistic Learning , 2002 .

[4]  Yasuhiko Kitamura,et al.  A cooperative search scheme for dynamic problems , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[5]  D. Ghose,et al.  Search using multiple UAVs with flight time constraints , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[6]  S. Pratt,et al.  Guidance and control for cooperative search , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[7]  Marios M. Polycarpou,et al.  A cooperative search framework for distributed agents , 2001, Proceeding of the 2001 IEEE International Symposium on Intelligent Control (ISIC '01) (Cat. No.01CH37206).

[8]  Ravindra K. Ahuja,et al.  Network Flows: Theory, Algorithms, and Applications , 1993 .

[9]  Marios M. Polycarpou,et al.  Analysis of opportunistic method for cooperative search by mobile agents , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[10]  D. Ghose,et al.  Multiple agent team theoretic decision-making for searching unknown environments , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[11]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[12]  D. Ghose,et al.  Multiple agent search of an unknown environment using game theoretical models , 2004, Proceedings of the 2004 American Control Conference.

[13]  James R. Cloutier,et al.  Search and Attack Strategies , 2004 .