Layered Behavior Modeling via Combining Descriptive and Prescriptive Approaches: A Case Study of Infantry Company Engagement

Defense modeling and simulation (DM&S) has brought insights into how to efficiently operate combat entities, such as soldiers and weapon systems. Most DM&S works have been developed to reflect accurate descriptions of military doctrines, yet these doctrines provide only guidelines of military operations, not details about how the combat entities should behave. Because such vague parts are often fulfilled with the appropriate behavior of combat entities in a battlefield, one part argues that DM&S should consider individual combat behaviors as well. However, it is known as an infeasible problem discovering best individual actions from infinite searching space, such as the battlefield. This paper proposes a layered behavior modeling to practically resolve this issue. The proposed method applies descriptive modeling to reduce the searching space by employing domain-specific knowledge; and prescriptive modeling to discover best individual actions in the reduced space. For the generalization, the proposed method adapts both modeling methods being modularized, and then the proposed method suggested an interface between them that is based on their semantic analogies. Both modeling methods are modularized, so they are interacted through an interface defined in the proposed method. This paper presents a realization of the proposed method through a case study of infantry company-level operations. In the case study, the proposed method is implemented with discrete event system specification formalism as the descriptive part and Markov decision process as the prescriptive part. The experimental results illustrated that the combat effectiveness resulted from the proposed method is statistically better than that from the descriptive-only modeling, and the difference would be guided by the objective of the combat behavior. Through the presented experimental results and the discussion, this paper argues that future DM&S should consider a broad spectrum from the battlefield incorporating the rational behavior of military individuals.

[1]  Jean-Christophe Castella,et al.  Combining top-down and bottom-up modelling approaches of land use/cover change to support public policies: Application to sustainable management of natural resources in northern Vietnam , 2007 .

[2]  Ibrahim Cil,et al.  A multi-agent architecture for modelling and simulation of small military unit combat in asymmetric warfare , 2010, Expert Syst. Appl..

[3]  Manisha Mishra,et al.  Context-Aware Decision Support for Anti-Submarine Warfare Mission Planning Within a Dynamic Environment , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Tag Gon Kim,et al.  System of Systems Approach to Formal Modeling of CPS for Simulation‐Based Analysis , 2015 .

[5]  John E. Laird,et al.  Variability in Human Behavior Modeling for Military Simulations , 2003 .

[6]  Kai Virtanen,et al.  Game-Theoretic Validation and Analysis of Air Combat Simulation Models , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Bara Kim,et al.  Optimal Admission Control and State Space Reduction in Two-Class Preemptive Loss Systems , 2015 .

[8]  Richard W. Pew,et al.  Modeling human and organizational behavior : application to military simulations , 1998 .

[9]  Simon Goss,et al.  Interchanging Agents and Humans in Military Simulation , 2002, AI Mag..

[10]  Kathleen M. Carley,et al.  Modeling and Simulating Command and Control for Naval Air Defense Operation , 2013 .

[11]  E. Salas,et al.  Military Team Research: 10 Years of Progress , 1995 .

[12]  Punam Bedi,et al.  Command Agent Belief Architecture to Support Commander Decision Making in Military Simulation , 2017 .

[13]  Sanjay Bisht,et al.  Modelling and Simulation of Tactical Team Behaviour , 2007 .

[14]  Xu Chen Police Patrol Optimization With Security Level Functions , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Bernard P. Zeigler,et al.  Theory of Modeling and Simulation: Integrating Discrete Event and Continuous Complex Dynamic Systems , 2000 .

[16]  Ing-Ray Chen,et al.  Adaptive Intrusion Detection of Malicious Unmanned Air Vehicles Using Behavior Rule Specifications , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Peter Gorniak,et al.  SquadSmart: Hierarchical Planning and Coordinated Plan Execution for Squads of Characters , 2007, AIIDE.

[18]  Uwe Dompke Computer Generated Forces - Background, Definition and Basic Technologies , 2003 .

[19]  Sarvapali D. Ramchurn,et al.  Decentralized Patrolling Under Constraints in Dynamic Environments , 2016, IEEE Transactions on Cybernetics.

[20]  Reza Berangi,et al.  Optimal SMDP-Based Connection Admission Control Mechanism in Cognitive Radio Sensor Networks , 2017 .

[21]  F. Moradi,et al.  Simulation-based Defense Planning , 2014 .

[22]  Kevin O'Brien,et al.  Human Behavior Models for Agents in Simulators and Games: Part I: Enabling Science with PMFserv , 2006, Presence: Teleoperators & Virtual Environments.

[23]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[24]  Lincheng Shen,et al.  A Continuous-Time Markov Decision Process-Based Method With Application in a Pursuit-Evasion Example , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Don Morrison,et al.  Dynamics of Decision Making in Cyber Defense: Using Multi-agent Cognitive Modeling to Understand CyberWar , 2017, Theory and Models for Cyber Situation Awareness.

[26]  Ming Ni,et al.  An UHV Grid Security and Stability Defense System: Considering the Risk of Power System Communication , 2016, IEEE Transactions on Smart Grid.

[27]  Gil Tidhar,et al.  Using Intelligent Agents in Military Simulation or "Using Agents Intelligently" , 1999, AAAI/IAAI.

[28]  John A. Sokolowski,et al.  Applying reinforcement learning to an insurgency Agent-based Simulation , 2014 .

[29]  Simon R Goerger Validating Human Behavioral Models for Combat Simulations Using Techniques for the Evaluation of Human Performance , 2004 .

[30]  Frank L. Lewis,et al.  Discrete Event Command and Control of Multiple Military Missions in Network Centric Warfare , 2012 .

[31]  John N. Tsitsiklis,et al.  The Complexity of Markov Decision Processes , 1987, Math. Oper. Res..

[32]  Il-Chul Moon,et al.  Agent-Based Simulation of Time to Decide: Military Commands and Time Delays , 2015, J. Artif. Soc. Soc. Simul..

[33]  Tan Wenqian,et al.  Aircraft-Pilot System Modeling and Pilot Control Behavior Research for Airdrop Task , 2016 .

[34]  Clinton Heinze,et al.  Thinking Quickly: Agents for Modeling Air Warfare , 1998, Australian Joint Conference on Artificial Intelligence.

[35]  Tag Gon Kim,et al.  Accelerated simulation of hierarchical military operations with tabulation technique , 2016, J. Simulation.

[36]  Sabeur Elkosantini,et al.  Toward a new generic behavior model for human centered system simulation , 2015, Simul. Model. Pract. Theory.

[37]  R. K. Jain,et al.  Simulation of Naval Wargames , 2004 .

[38]  Robert H. Kewley,et al.  Computational military tactical planning system , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[39]  Craig A. Knoblock,et al.  PDDL-the planning domain definition language , 1998 .

[40]  Janet Wedgwood,et al.  Agent Based Models for Logistics in Wargaming , 2003 .

[41]  Don Brutzman,et al.  Ethical mission definition and execution for maritime robotic vehicles: A practical approach , 2016, OCEANS 2016 MTS/IEEE Monterey.

[42]  Thomas W. Lucas,et al.  Military applications of agent-based simulations , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[43]  Teresa Wu,et al.  Toward Agent-based Modeling of the U.S. Department of Defense Acquisition System , 2015 .

[44]  Il-Chul Moon,et al.  LDEF Formalism for Agent-Based Model Development , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[45]  Lin Zhang,et al.  Decision-Theoretic Military Operations Planning , 2004, ICAPS.

[46]  Su-Youn Hong,et al.  DEVSim++ Toolset for Defense Modeling and Simulation and Interoperation , 2011 .

[47]  R. Bellman A Markovian Decision Process , 1957 .

[48]  Andreas Tolk,et al.  Tutorial on the Engineering Principles of Combat Modeling and Distributed Simulation , 2012, 2019 Winter Simulation Conference (WSC).

[49]  Xiang Yu,et al.  Sense and collision avoidance of Unmanned Aerial Vehicles using Markov Decision Process and flatness approach , 2015, 2015 IEEE International Conference on Information and Automation.

[50]  Tag Gon Kim,et al.  DEVS-based doctrine validation of fleet anti-air defense , 2010, SpringSim.

[51]  Michael L. Littman,et al.  Bandit-Based Planning and Learning in Continuous-Action Markov Decision Processes , 2012, ICAPS.

[52]  Dewen Hu,et al.  Multiobjective Reinforcement Learning: A Comprehensive Overview , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[53]  Bernard P. Zeigler,et al.  Multifacetted Modelling and Discrete Event Simulation , 1984 .