Case-Based Team Recognition Using Learned Opponent Models

For an agent to act intelligently in a multi-agent environment it must model the capabilities of other agents. In adversarial environments, like the beyond-visual-range air combat domain we study in this paper, it may be possible to get information about teammates but difficult to obtain accurate models of opponents. We address this issue by designing an agent to learn models of aircraft and missile behavior, and use those models to classify the opponents’ aircraft types and weapons capabilities. These classifications are used as input to a case-based reasoning (CBR) system that retrieves possible opponent team configurations (i.e., the aircraft type and weapons payload per opponent). We describe evidence from our empirical study that the CBR system recognizes opponent team behavior more accurately than using the learned models in isolation. Additionally, our CBR system demonstrated resilience to limited classification opportunities, noisy air combat scenarios, and high model error.

[1]  Manuela M. Veloso,et al.  Team Playing Behavior in Robot Soccer: A Case-Based Reasoning Approach , 2007, ICCBR.

[2]  David W. Aha,et al.  Case-Based Policy and Goal Recognition , 2015, ICCBR.

[3]  David W. Aha,et al.  Distributed discrepancy detection for a goal reasoning agent in beyond-visual-range air combat , 2018, AI Communications.

[4]  Biao Wang,et al.  Air Combat Decision-Making for Cooperative Multiple Target Attack Using Heuristic Adaptive Genetic Algorithm , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[5]  Greg L. Zacharias,et al.  Air combat tactics optimization using stochastic genetic algorithms , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[6]  Hector Muñoz-Avila,et al.  Recognizing the Enemy: Combining Reinforcement Learning with Strategy Selection Using Case-Based Reasoning , 2008, ECCBR.

[7]  David W. Aha,et al.  Beating the Defense: Using Plan Recognition to Inform Learning Agents , 2009, FLAIRS.

[8]  Joscha Bach,et al.  Recognizing and Predicting Agent Behavior with Case Based Reasoning , 2003, RoboCup.

[9]  Robert L. Shaw,et al.  Fighter Combat: Tactics and Maneuvering , 1985 .

[10]  David W. Aha,et al.  Distributed Discrepancy Detection for BVR Air Combat , 2022 .

[11]  D. Hodson,et al.  Advanced Framework for Simulation, Integration and Modeling (AFSIM) (Case Number: 88ABW-2015-2258) , 2015 .

[12]  Babak Esfandiari,et al.  A Case-Based Reasoning Approach to Imitating RoboCup Players , 2008, FLAIRS.

[13]  Gita Reese Sukthankar,et al.  Simultaneous Team Assignment and Behavior Recognition from Spatio-Temporal Agent Traces , 2006, AAAI.

[14]  Aaron F. Bobick,et al.  A Framework for Recognizing Multi-Agent Action from Visual Evidence , 1999, AAAI/IAAI.