A Bayesian model for opening prediction in RTS games with application to StarCraft

This paper presents a Bayesian model to predict the opening (first strategy) of opponents in real-time strategy (RTS) games. Our model is general enough to be applied to any RTS game with the canonical gameplay of gathering resources to extend a technology tree and produce military units and we applied it to StarCraft1. This model can also predict the possible technology trees of the opponent, but we will focus on openings here. The parameters of this model are learned from replays (game logs), labeled with openings. We present a semi-supervised method of labeling replays with the expectation-maximization algorithm and key features, then we use these labels to learn our parameters and benchmark our method with cross-validation. Uses of such a model range from a commentary assistant (for competitive games) to a core component of a dynamic RTS bot/AI, as it will be part of our StarCraft AI competition entry bot.

[1]  Robert P. Goldman,et al.  A probabilistic plan recognition algorithm based on plan tree grammars , 2009, Artif. Intell..

[2]  Santiago Ontañón,et al.  Situation Assessment for Plan Retrieval in Real-Time Strategy Games , 2008, ECCBR.

[3]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[4]  David W. Aha,et al.  Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game , 2005, Künstliche Intell..

[5]  Santiago Ontañón,et al.  Case-Based Planning and Execution for Real-Time Strategy Games , 2007, ICCBR.

[6]  Hector Muñoz-Avila,et al.  Hierarchical Plan Representations for Encoding Strategic Game AI , 2005, AIIDE.

[7]  Pierre Bessière,et al.  Auto-supervised learning in the Bayesian Programming Framework , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Hector Geffner,et al.  Plan Recognition as Planning , 2009, IJCAI.

[9]  Michael Mateas,et al.  A data mining approach to strategy prediction , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[10]  Christian Laugier,et al.  Probabilistic Reasoning and Decision Making in Sensory-Motor Systems , 2008, Springer Tracts in Advanced Robotics.

[11]  Pierre Bessière,et al.  Teaching Bayesian behaviours to video game characters , 2003, Robotics Auton. Syst..

[12]  Adrian E. Raftery,et al.  MCLUST Version 3 for R: Normal Mixture Modeling and Model-Based Clustering † , 2007 .

[13]  P. Bessière,et al.  Common Bayesian Models for Common Cognitive Issues , 2010, Acta biotheoretica.

[14]  Adrian E. Raftery,et al.  Model-Based Clustering, Discriminant Analysis, and Density Estimation , 2002 .

[15]  Santiago Ontañón,et al.  Learning from Demonstration and Case-Based Planning for Real-Time Strategy Games , 2008, Soft Computing Applications in Industry.

[16]  Ingrid Zukerman,et al.  Bayesian Models for Keyhole Plan Recognition in an Adventure Game , 2004, User Modeling and User-Adapted Interaction.

[17]  Pierre Bessière,et al.  A Survey of Probabilistic Models Using the Bayesian Programming Methodology as a Unifying Framework , 2003 .

[18]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[19]  Chuen-Tsai Sun,et al.  Building a player strategy model by analyzing replays of real-time strategy games , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[20]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .

[21]  Froduald Kabanza,et al.  Opponent Behaviour Recognition for Real-Time Strategy Games , 2010, Plan, Activity, and Intent Recognition.

[22]  Matthew J. Beal.  Variational algorithms for approximate Bayesian inference , 2003 .