A Multi-agent Algorithm for Robot Soccer Games

In this paper, we demonstrate the design and implementation of a multi-agent algorithm including a set of strategies for robot soccer games in Fira [1] simulation league. Soccer games are pseudo matches performed on a simulator for testing real-timedecisionmaking schemes for cooperative multi-agent systems. One of most important issues in the soccer game is how to pass a ball among teammates. Many proposed strategies [2][3], based on reinforcement learning methods [21] [22][23][24] or heuristic schemes to infer the possible risks and costs, do not consider ball passing as a multi-criteria optimum problem. To determine whether passing the ball to a teammate in the goal area, a multi-criteria decision-making strategy is proposed by considering the multiple criteria, the angle of the ball to the two goalposts, the distance between the ball and the goal, and the position of the enemies. As to the formation of a team, we introduce an idea, called virtual forces [18], to suggest the optimum positions of team players. The optimum positions will depend on the real-time conditions such as the ball position and the positions of all enemy players. To evaluate the proposed strategies, we take the team UvA-Trilearn[4], the world champion in 2002, as an opponent. The results show that the proposed strategies attain better performance than UvA-Trilearn.

[1]  Georges Voronoi Nouvelles applications des paramètres continus à la théorie des formes quadratiques. Premier mémoire. Sur quelques propriétés des formes quadratiques positives parfaites. , 1908 .

[2]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[3]  Richard S. Sutton,et al.  Dimensions of Reinforcement Learning , 1998 .

[4]  Atsuyuki Okabe,et al.  Spatial Tessellations: Concepts and Applications of Voronoi Diagrams, Second Edition , 2000, Wiley Series in Probability and Mathematical Statistics.

[5]  Kumiko Tanaka-Ishii,et al.  Multi-Agent Explanation Strategies in Real-Time Domains , 2000, ACL.

[6]  Jacky Baltes Strategy selection, goal generation, and role assignment in a robotic soccer team , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[7]  Ivan Stojmenovic,et al.  A triple layer location management strategy for wireless cellular networks , 2002, Proceedings. Eleventh International Conference on Computer Communications and Networks.

[8]  Stefan Schaal,et al.  Reinforcement Learning for Humanoid Robotics , 2003 .

[9]  Krishnendu Chakrabarty,et al.  Sensor deployment and target localization based on virtual forces , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[10]  Wang Hong-bao Fuzzy logic based strategy for robot soccer , 2004 .

[11]  Xianyi Chen,et al.  Design and Implementation of a General Decision-Making Model in RoboCup Simulation , 2004, ArXiv.

[12]  Sergio A. Rojas,et al.  Evolving object oriented agent programs in Robocup domain , 2005, GECCO '05.

[13]  Tingting Wang,et al.  The minority game strategy in team competition: how and when? , 2005, IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[14]  Thomas Röfer,et al.  SimRobot - A General Physical Robot Simulator and Its Application in RoboCup , 2005, RoboCup.