A Case-Based Approach for Action Selection and Coordination in Robot Soccer Gameplays

Designing a robot’s behavior in imprecise, uncertain, dynamic, unpredictable and real-time response domains is very challenging, and even more if an adversarial component is also present. An example of such domains is the robot soccer. In this work we propose the use of Case-Based Reasoning techniques to handle all these features in the action selection problem of a team of robots. Moreover, we are also interested in obtaining a cooperative behavior among robots to successfully perform joint tasks. Thus, we include explicit passes between robots, not only to enhance collaboration, but also to face the adversarial component of the domain, i.e. the opponents. We evaluate our approach with respect to a reactive approach in 2 vs. 2 scenarios, where two attackers play against two moving opponents, i.e. a defender and a goalie. We successfully show that our approach not only achieves the expected team behavior, but also outperforms in general the compared approach.

[1]  Babak Esfandiari,et al.  A scene-based imitation framework for RoboCup clients , 2006 .

[2]  Barry Smyth,et al.  Retrieval, reuse, revision and retention in case-based reasoning , 2005, The Knowledge Engineering Review.

[3]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[4]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[5]  James A. Hendler,et al.  Co-evolving Soccer Softbot Team Coordination with Genetic Programming , 1997, RoboCup.

[6]  Gregor Lämmel,et al.  Exploiting Past Experience - Case-Based Decision Support for Soccer Agents , 2007, KI.

[7]  Manuela M. Veloso,et al.  Executing multi-robot cases through a single coordinator , 2007, AAMAS '07.

[8]  Alan Liu,et al.  A design method for incorporating multidisciplinary requirements for developing a robot soccer player , 2002, Fourth International Symposium on Multimedia Software Engineering, 2002. Proceedings..

[9]  Gourab Sen Gupta,et al.  Strategy for collaboration in robot soccer , 2002, Proceedings First IEEE International Workshop on Electronic Design, Test and Applications '2002.

[10]  Michael M. Richter,et al.  Team Playing Behavior in Robot Soccer: A Case-Based Approach , 2007 .

[11]  Jafar Habibi,et al.  Using a Two-Layered Case-Based Reasoning for Prediction in Soccer Coach , 2003, MLMTA.

[12]  Jong-Hwan Kim,et al.  Modular Q-learning based multi-agent cooperation for robot soccer , 2001, Robotics Auton. Syst..

[13]  Raquel Ros,et al.  Acquiring a Robust Case Base for the Robot Soccer Domain , 2007, IJCAI.

[14]  Peter Stone,et al.  Instance-Based Action Models for Fast Action Planning , 2007, RoboCup.

[15]  Chia-Ju Wu,et al.  A Fuzzy Mechanism for Action Selection of Soccer Robots , 2004, J. Intell. Robotic Syst..

[16]  Patrick Doherty,et al.  Issues in Designing Physical Agents for Dynamic Real-Time Environments: World Modeling, Planning, Learning, and Communicating , 2004, AI Mag..

[17]  Timo Steffens,et al.  Adapting Similarity Measures to Agent Types in Opponent Modelling , 2004 .

[18]  Mario Lenz,et al.  CBR for Dynamic Situation Assessment in an Agent-Oriented Setting , 1998 .

[19]  Gordon Fraser,et al.  Cooperative Planning and Plan Execution in Partially Observable Dynamic Domains , 2004, RoboCup.

[20]  Alessandro Saffiotti,et al.  The uses of fuzzy logic in autonomous robot navigation , 1997, Soft Comput..

[21]  Joscha Bach,et al.  Recognizing and Predicting Agent Behavior with Case Based Reasoning , 2003, RoboCup.

[22]  Andreas D. Lattner,et al.  Sequential Pattern Mining for Situation and Behavior Prediction in Simulated Robotic Soccer , 2005, RoboCup.

[23]  Bernhard Nebel,et al.  Towards a Life-Long Learning Soccer Agent , 2002, RoboCup.

[24]  Manuela M. Veloso,et al.  Retrieving and Reusing Game Plays for Robot Soccer , 2006, ECCBR.

[25]  Yang Yang,et al.  An Approach to Plan Recognition and Retrieval for Multi-agent Systems , 2002 .

[26]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[27]  Gerhard Lakemeyer,et al.  Learning Decision Trees for Action Selection in Soccer Agents , 2008 .

[28]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[29]  Bernhard Nebel,et al.  Case Based Game Play in the RoboCup Four-Legged League Part I The Theoretical Model , 2003, RoboCup.

[30]  Ubbo Visser,et al.  Recognition and Prediction of Motion Situations Based on a Qualitative Motion Description , 2003, RoboCup.

[31]  Jong-Hwan Kim,et al.  Recombinant Rule Selection in Evolutionary Algorithm for Fuzzy Path Planner of Robot Soccer , 2006, KI.

[32]  Geuntaek Kang,et al.  A Tactics for Robot Soccer with Fuzzy Logic Mediator , 2005, CIS.

[33]  Hisao Ishibuchi,et al.  Performance Evaluation of an Evolutionary Method for RoboCup Soccer Strategies , 2005, RoboCup.

[34]  Matthew Gillen,et al.  Case-Based Reasoning for Planning and World Modeling in the RoboCup Small Size League , 2003 .

[35]  Jong-Hwan Kim,et al.  Action selection mechanism for soccer robot , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[36]  Carlos Bustamante,et al.  Fuzzy Naive Bayesian Classification in RoboSoccer 3D: A Hybrid Approach to Decision Making , 2006, RoboCup.

[37]  Steffen Brüggert,et al.  Fault-Tolerant Self Localization by Case-Based Reasoning , 2000, RoboCup.

[38]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[39]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[40]  Martin A. Riedmiller,et al.  Karlsruhe Brainstormers - A Reinforcement Learning Approach to Robotic Soccer , 2000, RoboCup.

[41]  R. Sreerama Kumar,et al.  Intelligent decision making in multi-agent robot soccer system through compounded artificial neural networks , 2007, Robotics Auton. Syst..