Collaborating and Learning Predators on a Pursuit Scenario

A generic predator/prey pursuit scenario is used to validate a common learning approach using Wilson’s eXtended Learning Classifier System (XCS). The predators, having only local information, should independently learn and act while at the same time they are urged to collaborate and to capture the prey. Since learning from scratch is often a time consuming process, the common learning approach, as investigated here, is compared to an individual learning approach of selfish learning agents. A special focus is set on the performance of how quickly the team goal is achieved in both learning scenarios. This paper provides new insights of how agents with local information could learn collaboratively in a dynamically changing multi-agent environment. Furthermore, the concept of a common rule base based on Wilson’s XCS is investigated. The results based on the common rule base approach show a significant speed up in the learning performance but may be significantly inferior on the long run, in particular in situations with a moving prey.

[1]  Takao Terano,et al.  Learning Classifier Systems Meet Multiagent Environments , 2000, IWLCS.

[2]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[3]  Sandip Sen,et al.  Learning in multiagent systems , 1999 .

[4]  Stewart W. Wilson Generalization in the XCS Classifier System , 1998 .

[5]  Y. Shoham Introduction to Multi-Agent Systems , 2002 .

[6]  Michael Wooldridge,et al.  An Introduction to MultiAgent Systems John Wiley & Sons , 2002 .

[7]  Domenico Tegolo,et al.  Prey-predator strategies in a multiagent system , 2005, Seventh International Workshop on Computer Architecture for Machine Perception (CAMP'05).

[8]  Terence C. Fogarty,et al.  Social Simulation Using a Multi-agent Model Based on Classifier Systems: The Emergence of Vacillating Behaviour in the "El Farol" Bar Problem , 2001, IWLCS.

[9]  M Dorigo,et al.  Ant colonies for the travelling salesman problem. , 1997, Bio Systems.

[10]  Scott H. Clearwater,et al.  A Multi-Agent System for Controlling Building Environments , 1995, ICMAS.

[11]  Tim Kovacs,et al.  Advances in Learning Classifier Systems , 2001, Lecture Notes in Computer Science.

[12]  Daniel Kudenko,et al.  Learning in multi-agent systems , 2001, The Knowledge Engineering Review.

[13]  Pier Luca Lanzi,et al.  An Analysis of Generalization in the XCS Classifier System , 1999, Evolutionary Computation.

[14]  H. Van Dyke Parunak,et al.  Industrial and practical applications of DAI , 1999 .

[15]  Corso Elvezia,et al.  Ant colonies for the traveling salesman problem , 1997 .

[16]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[17]  Hartmut Schmeck,et al.  Improving XCS Performance by Distribution , 2008, SEAL.

[18]  Dipti Srinivasan,et al.  An Introduction to Multi-Agent Systems , 2010 .