Disruptive Innovations in RoboCup 2D Soccer Simulation League: From Cyberoos'98 to Gliders2016

We review disruptive innovations introduced in the RoboCup 2D Soccer Simulation League over the twenty years since its inception, and trace the progress of our champion team (Gliders). We conjecture that the League has been developing as an ecosystem shaped by diverse approaches taken by participating teams, increasing in its overall complexity. A common feature is that different champion teams succeeded in finding a way to decompose the enormous search-space of possible single and multi-agent behaviours, by automating the exploration of the problem space with various techniques which accelerated the software development efforts. These methods included interactive debugging, machine learning, automated planning, and opponent modelling. The winning approach developed by Gliders is centred on human-based evolutionary computation which optimised several components such as an action-dependent evaluation function, dynamic tactics with Voronoi diagrams, information dynamics, and bio-inspired collective behaviour.

[1]  Hidehisa Akiyama,et al.  Multi-agent Positioning Mechanism in the Dynamic Environment , 2008, RoboCup.

[2]  Hiroaki Kitano,et al.  RoboCup: Today and Tomorrow - What we have learned , 1999, Artif. Intell..

[3]  X. R. Wang,et al.  Quantifying and Tracing Information Cascades in Swarms , 2012, PloS one.

[4]  I. Tanev,et al.  Epigenetic programming: Genetic programming incorporating epigenetic learning through modification of histones , 2008, Inf. Sci..

[5]  Xiaoping Chen,et al.  The Decision-Making Framework of WrightEagle, the RoboCup 2013 Soccer Simulation 2D League Champion Team , 2013, RoboCup.

[6]  Jelle R. Kok,et al.  UvA Trilearn 2003 Team Description , 2003 .

[7]  Manuela M. Veloso,et al.  Task Decomposition, Dynamic Role Assignment, and Low-Bandwidth Communication for Real-Time Strategic Teamwork , 1999, Artif. Intell..

[8]  Luís Paulo Reis,et al.  COACH UNILANG - A Standard Language for Coaching a (Robo)Soccer Team , 2001, RoboCup.

[9]  Oliver Obst,et al.  Gliders2012: Tactics with Action-dependent Evaluation Functions , 2012 .

[10]  Peter Stone,et al.  The RoboCup Soccer Server and CMUnited Clients: Implemented Infrastructure for MAS Research , 2003, Autonomous Agents and Multi-Agent Systems.

[11]  Ralf Der,et al.  Information-driven self-organization: the dynamical system approach to autonomous robot behavior , 2011, Theory in Biosciences.

[12]  Alexander Kosorukoff,et al.  Eye-tracking evolutionary algorithm to minimize user fatigue in IEC applied to interactive one-max problem , 2007, GECCO '07.

[13]  Ni Lao,et al.  Technical Solutions of TsinghuAeolus for Robotic Soccer , 2003, RoboCup.

[14]  M. Prokopenko,et al.  Evolving Spatiotemporal Coordination in a Modular Robotic System , 2006, SAB.

[15]  Amir Tavafi,et al.  MarliK 2012 Soccer 2D Simulation Team Description Paper , 2012 .

[16]  Mikhail Prokopenko,et al.  Cyberoos'2001: "Deep Behaviour Projection" Agent Architecture , 2001, RoboCup.

[17]  Oliver Obst,et al.  Gliders2014: Dynamic Tactics with Voronoi Diagrams , 2014 .

[18]  Hiroaki Kitano,et al.  RoboCup-97: The First Robot World Cup Soccer Games and Conferences , 1998, AI Mag..

[19]  Minoru Asada,et al.  Overview of RoboCup-2000 , 2001, RoboCup.

[20]  Manuela M. Veloso,et al.  Layered Disclosure: Revealing Agents' Internals , 2000, ATAL.

[21]  Sean Luke,et al.  Genetic Programming Produced Competitive Soccer Softbot Teams for RoboCup97 , 1998 .

[22]  Martin A. Riedmiller,et al.  Brainstormers 2D — Team Description 2009 , 2005 .

[23]  Mikhail Prokopenko,et al.  Flexible Synchronisation within RoboCup Environment: A Comparative Analysis , 2000, RoboCup.

[24]  Oliver Obst,et al.  Gliders 2016 : Integrating multi-agent approaches to tactical diversity , 2016 .

[25]  Hidehisa Akiyama,et al.  HELIOS 2010 Team Description , 2010 .

[26]  Takuya Morishita,et al.  Zeng01 Team Description: Formation Decision Method Using Game Theory , 2001, RoboCup.

[27]  Luís Paulo Reis,et al.  Situation Based Strategic Positioning for Coordinating a Team of Homogeneous Agents , 2000, Balancing Reactivity and Social Deliberation in Multi-Agent Systems.

[28]  Mikhail Prokopenko,et al.  Relating the Entropy of Joint Beliefs to Multi-agent Coordination , 2002, RoboCup.

[29]  Oliver Obst,et al.  Gliders2013: Tactical Analysis with Information Dynamics , 2013 .

[30]  Mikhail Prokopenko,et al.  Evolving Spatiotemporal Coordination in a Modular Robotic System , 2006, SAB.

[31]  Thomas Martinetz,et al.  A Method for Incorporation of New Evidence to Improve World State Estimation , 2001, RoboCup.

[32]  Oliver Obst,et al.  RoboCup Simulation Leagues: Enabling Replicable and Robust Investigation of Complex Robotic Systems , 2015, IEEE Robotics & Automation Magazine.

[33]  Oliver Obst,et al.  Gliders2015: Opponent avoidance with bio-inspired ocking behaviour , 2015 .

[34]  Mikhail Prokopenko,et al.  On Emergence of Scalable Tactical and Strategic Behavior , 2000, RoboCup.

[35]  Mikhail Prokopenko,et al.  Improved Particle Filtering for Pseudo-Uniform Belief Distributions in Robot Localisation , 2013, RoboCup.

[36]  Manuela M. Veloso,et al.  The CMUnited-99 Champion Simulator Team , 1999, RoboCup.

[37]  Peter Stone and Patrick Riley and Manuela Veloso Defining and Using Ideal Teammate and Opponent Models , 2000 .

[38]  Albert Y. Zomaya,et al.  Information modification and particle collisions in distributed computation. , 2010, Chaos.

[39]  Hiroaki Kitano,et al.  The RoboCup Synthetic Agent Challenge 97 , 1997, IJCAI.

[40]  Oliver Obst,et al.  Towards Quantifying Interaction Networks in a Football Match , 2013, RoboCup.

[41]  Mikhail Prokopenko,et al.  Evaluating Team Performance at the Edge of Chaos , 2003, RoboCup.

[42]  Alex Kosorukoff,et al.  Human based genetic algorithm , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[43]  Albert Y. Zomaya,et al.  A framework for the local information dynamics of distributed computation in complex systems , 2008, ArXiv.

[44]  Albert Y. Zomaya,et al.  Coherent information structure in complex computation , 2012, Theory in Biosciences.

[45]  Luís Paulo Reis,et al.  FC Portugal Team Description: RoboCup 2000 Simulation League Champion , 2000, RoboCup.

[46]  Oliver Obst,et al.  Simulation leagues: Analysis of competition formats , 2014, RoboCup.