Adaptive behavior for cooperation: a virtual reality application

We present a behavioral system based on artificial life for animating actors in a virtual reality application. Through a virtual soccer game, we show how a set of autonomous players (called agents) can cooperate and communicate to perform common tasks. The user is immersed in the game. He/she interacts with the other agents and is integrated in the cooperation and communication systems. Every entity reads in real-time by using a classifiers system which is composed of a set of binary rules and a reward system. The originality of such method is the ability to build a behavior (by emergence) without initial knowledge. The analysis of the simulation gives interesting results: after convergence, the global behavior of the teams produces coherent movements. Moreover, the introduction of disturbances does not affect the performances of the classifiers system.

[1]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[2]  Patrice Torguet,et al.  Multi-user interactions in the context of concurrent virtual world modelling , 1996 .

[3]  Maja J. Mataric,et al.  Using communication to reduce locality in distributed multiagent learning , 1997, J. Exp. Theor. Artif. Intell..

[4]  Demetri Terzopoulos,et al.  Artificial fishes: physics, locomotion, perception, behavior , 1994, SIGGRAPH.

[5]  Daniel Thalmann,et al.  A versatile navigation interface for virtual humans in collaborative virtual environments , 1997, VRST '97.

[6]  Cyril Panatier,et al.  Collective learning for spatial collaboration , 1998 .

[7]  Stewart W. Wilson,et al.  A Finer-Grained Motivational Model of Behaviour Sequencing , 1996 .

[8]  Emmet Spier,et al.  A Finer-Grained Motivational Model of Behaviour Sequencing , 1996 .

[9]  Andrea Bonarini,et al.  Evolutionary Learning of Fuzzy rules: competition and cooperation , 1996 .

[10]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[11]  P. Maes.  Modeling adaptive autonomous agents , 1993 .

[12]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.

[13]  Maja J. Matarić,et al.  Learning to Use Selective Attention and Short-Term Memory in Sequential Tasks , 1996 .

[14]  Maja J. Mataric,et al.  Reward Functions for Accelerated Learning , 1994, ICML.

[15]  Andrew McCallum,et al.  Learning to Use Selective Attention and Short-Term Memory in Sequential Tasks , 1996 .