Learning to play like a human: case injected genetic algorithms for strategic computer gaming

We use case injected genetic algorithms to learn how to competently play computer strategy games. Strategic computer games involve long range planning across complex dynamics and imperfect knowledge presented to players requires them to anticipate opponent moves and adapt their strategies accordingly. This work addresses the problem of acquiring and using knowledge from human players for such games. Specifically, we learn general routing information from a human player and use case-injected genetic algorithms to incorporate this acquired knowledge in subsequent planning. Results from a strike planning game show that with an appropriate representation, case injection effectively biases the genetic algorithm toward producing plans that contain important strategic elements used by human players.

[1]  Gil Tidhar,et al.  The Challenge of Whole Air Mission Modelling , 1995 .

[2]  E LairdJohn Research in human-level AI using computer games , 2002 .

[3]  Richard K. Belew,et al.  Methods for Competitive Co-Evolution: Finding Opponents Worth Beating , 1995, ICGA.

[4]  Sushil J. Louis,et al.  Learning with case-injected genetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[5]  C SchankRoger,et al.  Dynamic Memory: A Theory of Reminding and Learning in Computers and People , 1983 .

[6]  Arthur L. Samuel,et al.  Some studies in machine learning using the game of checkers , 2000, IBM J. Res. Dev..

[7]  John E. Laird,et al.  Research in human-level AI using computer games , 2002, CACM.

[8]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[9]  Gregory S. Parnell,et al.  An Air Mission Planning Algorithm Using Decision Analysis and Mixed Integer Programming , 1997, Oper. Res..

[10]  Gil Tidhar,et al.  Flying Together: Modelling Air Mission Teams , 1998, Applied Intelligence.

[11]  John E. Laird,et al.  Human-Level AI's Killer Application: Interactive Computer Games , 2000, AI Mag..

[12]  David Leake,et al.  Case-Based Reasoning: Experiences, Lessons and Future Directions , 1996 .

[13]  Roger C. Schank,et al.  Dynamic memory - a theory of reminding and learning in computers and people , 1983 .

[14]  Larry J. Eshelman,et al.  The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination , 1990, FOGA.

[15]  Christopher K. Riesbeck,et al.  Inside Case-Based Reasoning , 1989 .

[16]  Jordan B. Pollack,et al.  Coevolution of a Backgammon Player , 1996 .

[17]  Graham Kendall,et al.  An Investigation of an Adaptive Poker Player , 2001, Australian Joint Conference on Artificial Intelligence.