A Quantitative Investigation into Distribution of Memory and Learning in Multi Agent Systems with Implicit Communications

In this paper we have investigated a group of multi agent systems (MAS) in which the agents change their environment and this change has the potential to trigger behaviors in other agents of the group in another time or another position in the environment. The structure makes it possible to conceptualize the group as a super organism incorporating the agents and the environment such that new behaviors are observed from the whole group as a result of the specific distribution of agents in that environment. This distribution exists in many aspects like a super memory (or even a super brain) that exists in the environment and is not limited to memories of the individuals. There is a distributed decision making that is done by the group of agents which, in a higher level consists of both individual and group decision makings, and can be viewed as emergent rather than consciously planned. As the agents change the environment, they decrease the error for the group and hence a distributed learning is also forming between the agents of the group. This implicit learning is related to the implicit memory existing in the environment. These two interpretations of memory and learning are assessed with experimental results where two robots perform a task while they are not aware of their global behavior.

[1]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[2]  Guy Theraulaz,et al.  A Brief History of Stigmergy , 1999, Artificial Life.

[3]  I. Whishaw,et al.  Fundamentals of Human Neuropsychology , 1995 .

[4]  Leslie Pack Kaelbling,et al.  Learning Policies with External Memory , 1999, ICML.

[5]  De Vries Book review: R.C. O'Reilly and Y. Munakata: Computational explorations in cognitive neuroscience: understanding the mind by stimulating the brain. Cambridge, Mass: The MIT Press. , 2002 .

[6]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[7]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[8]  I. Couzin,et al.  Collective memory and spatial sorting in animal groups. , 2002, Journal of theoretical biology.

[9]  I. Whishaw,et al.  An Introduction to Brain and Behavior , 2000 .

[10]  M. Gazzaniga,et al.  Cognitive Neuroscience: The Biology of the Mind , 1998 .

[11]  R. L. Atkinson,et al.  Hilgard's Introduction to Psychology , 1999 .

[12]  P.-P. Grasse La reconstruction du nid et les coordinations interindividuelles chezBellicositermes natalensis etCubitermes sp. la théorie de la stigmergie: Essai d'interprétation du comportement des termites constructeurs , 1959, Insectes Sociaux.

[13]  Jean-Louis Deneubourg,et al.  From local actions to global tasks: stigmergy and collective robotics , 2000 .

[14]  Chris Melhuish,et al.  Stigmergy, Self-Organization, and Sorting in Collective Robotics , 1999, Artificial Life.

[15]  Richard C. Atkinson,et al.  Hilgard's introduction to psychology, 12th ed. , 1996 .

[16]  A. Baddeley Human Memory: Theory and Practice, Revised Edition , 1990 .

[17]  Lawrence Butler,et al.  'History: Theory and Practice' , 1997 .

[18]  S. Rathus Psychology, 3rd ed. , 1987 .