Explaining how to play real-time strategy games

Real-time strategy games share many aspects with real situations in domains such as battle planning, air traffic control, and emergency response team management which makes them appealing test-beds for Artificial Intelligence (AI) and machine learning. End-user annotations could help to provide supplemental information for learning algorithms, especially when training data is sparse. This paper presents a formative study to uncover how experienced users explain game play in real-time strategy games. We report the results of our analysis of explanations and discuss their characteristics that could support the design of systems for use by experienced real-time strategy game users in specifying or annotating strategy-oriented behavior.

[1]  Michael Buro,et al.  Real-Time Strategy Games: A New AI Research Challenge , 2003, IJCAI.

[2]  Judith Good,et al.  Script Cards: A Visual Programming Language for Games Authoring by Young People , 2006, Visual Languages and Human-Centric Computing (VL/HCC'06).

[3]  James C. Spohrer,et al.  KidSim: programming agents without a programming language , 1994, CACM.

[4]  Brad A. Myers,et al.  Natural programming languages and environments , 2004, Commun. ACM.

[5]  David W. Aha,et al.  Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game , 2005, Künstliche Intell..

[6]  Karen Holtzblatt,et al.  Making customer-centered design work for teams , 1993, CACM.

[7]  Brad A. Myers,et al.  Graphical representation of programs in a demonstrational visual shell—an empirical evaluation , 1997, TCHI.

[8]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[9]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[10]  Alexander Repenning.  Agentsheets: a tool for building domain-oriented visual programming environments , 1993, CHI '93.

[11]  Mary Beth Rosson,et al.  Supporting end-user debugging: what do users want to know? , 2006, AVI '06.

[12]  Barry A. T. Brown,et al.  Experts at Play , 2009 .

[13]  Randy Pausch,et al.  Alice: a 3-D tool for introductory programming concepts , 2000 .

[14]  Raghoebar‐Krieger,et al.  The reliability of logbook data of medical students: an estimation of interobserver agreement, sensitivity and specificity , 2001, Medical education.

[15]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[16]  Alexander Repenning,et al.  Bending the rules: steps toward semantically enriched graphical rewrite rules , 1995, Proceedings of Symposium on Visual Languages.

[17]  Kenneth M. Kahn,et al.  ToonTalk - An Animated Programming Environment for Children , 1996, J. Vis. Lang. Comput..

[18]  Alexander Repenning,et al.  Agentsheets: a tool for building domain-oriented dynamic, visual environments , 1993 .

[19]  Weng-Keen Wong,et al.  Integrating rich user feedback into intelligent user interfaces , 2008, IUI '08.