Toward a Domain-independent Case-based Reasoning Approach for Imitation : Three Case Studies in Gaming

We describe a domain-independent approach to learning by observation that uses case-based reasoning to allow a software agent to behave similarly to an expert when presented with a similar set of input stimuli. Case studies have been performed in two simulated domains, soccer and space combat, and a physical robotics domain and our experimental results show that successful imitation is possible in each of those domains.

[1]  Mark T. Keane,et al.  On the Automatic Generation of Cases Libraries by Chunking Chess Games , 1995, ICCBR.

[2]  Stefan Schaal,et al.  Robot Learning From Demonstration , 1997, ICML.

[3]  Mario Lenz,et al.  CBR for Dynamic Situation Assessment in an Agent-Oriented Setting , 1998 .

[4]  Christian Bauckhage,et al.  Combining Self Organizing Maps and Multilayer Perceptrons to Learn Bot-Behaviour for a Commercial Game , 2003, GAME-ON.

[5]  Padraig Cunningham,et al.  Case-Based Plan Recognition in Computer Games , 2003, ICCBR.

[6]  Timo Steffens,et al.  Adapting Similarity Measures to Agent Types in Opponent Modelling , 2004 .

[7]  Manuela M. Veloso,et al.  Retrieving and Reusing Game Plays for Robot Soccer , 2006, ECCBR.

[8]  D.H. Grollman,et al.  Learning robot soccer skills from demonstration , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[9]  Santiago Ontañón,et al.  Case-Based Planning and Execution for Real-Time Strategy Games , 2007, ICCBR.

[10]  Hector Muñoz-Avila,et al.  Recognizing the Enemy: Combining Reinforcement Learning with Strategy Selection Using Case-Based Reasoning , 2008, ECCBR.

[11]  David W. Aha,et al.  Learning Continuous Action Models in a Real-Time Strategy Environment , 2008, FLAIRS.

[12]  Babak Esfandiari,et al.  A Case-Based Reasoning Approach to Imitating RoboCup Players , 2008, FLAIRS.

[13]  Luc Lamontagne,et al.  Reinforcement of Local Pattern Cases for Playing Tetris , 2008, FLAIRS.

[14]  Babak Esfandiari,et al.  Considerations for Real-Time Spatially-Aware Case-Based Reasoning: A Case Study in Robotic Soccer Imitation , 2008, ECCBR.

[15]  Jonathan Dinerstein,et al.  DEMONSTRATION‐BASED BEHAVIOR PROGRAMMING FOR EMBODIED VIRTUAL AGENTS , 2008, Comput. Intell..

[16]  Pieter Abbeel,et al.  Learning for control from multiple demonstrations , 2008, ICML '08.

[17]  A. Ram,et al.  Authoring Behaviors for Games using Learning from Demonstration , 2009 .

[18]  David W. Aha,et al.  Case-Based Reasoning in Transfer Learning , 2009, ICCBR.

[19]  Babak Esfandiari,et al.  An Active Approach to Automatic Case Generation , 2009, ICCBR.

[20]  Jonathan Rubin,et al.  SARTRE : System Overview A Case-Based Agent for Two-Player Texas Hold ’ em , 2009 .