HTN guided game tree search for adaptive CGF commander behavior modeling

Employing Hierarchical Task Network (HTN) for commander behavior modeling usually requires a rich set of knowledge in order to be responsive to various situations during the combat. This paper presents an HTN planning based game tree search to enhance the commander agent's deliberation capability. Given a general HTN structure, our approach evaluates different decomposition branches through look-ahead reasoning, and produces appropriate decisions. Compared with using HTN alone, the HTN guided tree search can online explore tasks' adaptabilities to different situations, thus reducing the impact of HTN knowledge insufficiency. We apply this approach to an infantry combat simulation, where the commander needs to guide three platoons to clear enemies in specific areas. Results show that it can effectively find the best strategy from HTN encoded alternatives.

[1]  Michael Buro,et al.  Heuristic Search Applied to Abstract Combat Games , 2005, Canadian Conference on AI.

[2]  Xiao Xu,et al.  Extending HTN to planning and execution control for small combat unit simulation , 2017, Int. J. Model. Simul. Sci. Comput..

[3]  David W. Aha,et al.  Learning approximate preconditions for methods in hierarchical plans , 2005, ICML.

[4]  Bertram C. Bruce,et al.  Problems and techniques of text-analysis , 1980 .

[5]  Michael Buro,et al.  Fast Heuristic Search for RTS Game Combat Scenarios , 2012, AIIDE.

[6]  Ke Xu,et al.  A Domain-Independent System for Case-Based Task Decomposition without Domain Theories , 2005, AAAI.

[7]  Santiago Ontañón,et al.  RTS AI Problems and Techniques , 2019, Encyclopedia of Computer Graphics and Games.

[8]  Hector Muñoz-Avila,et al.  SHOP: Simple Hierarchical Ordered Planner , 1999, IJCAI.

[9]  Michael J. North,et al.  Complex adaptive systems modeling with Repast Simphony , 2013, Complex Adapt. Syst. Model..

[10]  Hector Muñoz-Avila,et al.  Learning hierarchical task network domains from partially observed plan traces , 2014, Artif. Intell..

[11]  Santiago Ontañón,et al.  Adversarial Hierarchical-Task Network Planning for Complex Real-Time Games , 2015, IJCAI.

[12]  Peter Gorniak,et al.  SquadSmart: Hierarchical Planning and Coordinated Plan Execution for Squads of Characters , 2007, AIIDE.

[13]  Remco Straatman,et al.  Hierarchical AI for Multiplayer Bots in Killzone 3 , 2019, Game AI Pro 360.

[14]  Michael Buro,et al.  Portfolio greedy search and simulation for large-scale combat in starcraft , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[15]  Alan Fern,et al.  UCT for Tactical Assault Planning in Real-Time Strategy Games , 2009, IJCAI.

[16]  Francesco Mondada,et al.  Integration of Online Learning into HTN Planning for Robotic Tasks , 2012, AAAI Spring Symposium: Designing Intelligent Robots.