Case-Based Behavior Recognition in Beyond Visual Range Air Combat

Abstract : An unmanned air vehicle (UAV) can operate as a capable team member in mixed human-robot teams if it is controlled by an agent that can intelligently plan. However, planning effectively in a beyond-visual-range air combat scenario requires understanding the behaviors of hostile agents, which is challenging in partially observable environments such as the one we study. In particular, unobserved hostile behaviors in our domain may alter the world state. To effectively counter hostile behaviors, they need to be recognized and predicted. We present a Case-Based Behavior Recognition (CBBR) algorithm that annotates an agent s behaviors using a discrete feature set derived from a continuous spatio-temporal world state. These behaviors are then given as input to an air combat simulation, along with the UAV s plan, to predict hostile actions and estimate the effectiveness of the given plan. We describe an implementation and evaluation of our CBBR algorithm in the context of a goal reasoning agent designed to control a UAV and report an empirical study that shows CBBR outperforms a baseline algorithm. Our study also indicates that using features which model an agent s prior behaviors can increase behavior recognition accuracy.

[1]  Gita Reese Sukthankar,et al.  Simultaneous Team Assignment and Behavior Recognition from Spatio-Temporal Agent Traces , 2006, AAAI.

[2]  David W. Aha,et al.  Case-Based Behavior Recognition to Facilitate Planning in Unmanned Air Vehicles , 2014 .

[3]  Héctor Muñoz-Avila,et al.  Goal Reasoning: Papers from the ACS workshop , 2013 .

[4]  Barry Smyth,et al.  Remembering To Forget: A Competence-Preserving Case Deletion Policy for Case-Based Reasoning Systems , 1995, IJCAI.

[5]  Arnav Jhala,et al.  Case-Based Goal Formulation , 2010 .

[6]  Froduald Kabanza,et al.  Opponent Behaviour Recognition for Real-Time Strategy Games , 2010, Plan, Activity, and Intent Recognition.

[7]  David W. Aha,et al.  Opponent Modeling and Spatial Similarity to Retrieve and Reuse Superior Plays , 2009 .

[8]  Paul Nielsen,et al.  Participation of TacAir-Soar in RoadRunner and Coyote Exercises at Air Force Research Lab, Mesa AZ , 2006 .

[9]  David W. Aha,et al.  Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game , 2005, Künstliche Intell..

[10]  Anand S. Rao,et al.  Multi-Agent Mental-State Recognition and its Application to Air-Combat Modelling , 1994 .

[11]  David W. Aha,et al.  Case-Based Parameter Selection for Plans: Coordinating Autonomous Vehicle Teams , 2014, ICCBR.

[12]  Gita Reese Sukthankar,et al.  Activity Recognition for Dynamic Multi-Agent Teams , 2011, TIST.

[13]  Hector Muñoz-Avila,et al.  Recognizing the Enemy: Combining Reinforcement Learning with Strategy Selection Using Case-Based Reasoning , 2008, ECCBR.

[14]  Robert E. Smith,et al.  Classifier systems in combat: two-sided learning of maneuvers for advanced fighter aircraft , 2000 .

[15]  Lili Sahakyan,et al.  Remembering to Forget , 2010, Psychological science.

[16]  David W. Aha,et al.  Case-Based Goal-Driven Coordination of Multiple Learning Agents , 2013, ICCBR.