Coevolving communicative behavior in a linear pursuer-evadergame

The pursuer-evader (PE) game is recognized as an important domain in which to study the coevolution of robust adaptive behavior and protean behavior (Miller and Cli , 1994). Nevertheless, the potential of the game is largely unrealized due to methodological hurdles in coevolutionary simulation raised by PE; versions of the game that have optimal solutions (Isaacs, 1965) are closed-ended, while other formulations are opaque with respect to their solution space, for the lack of a rigorous metric of agent behavior. This inability to characterize behavior, in turn, obfuscates coevolutionary dynamics. We present a new formulation of PE that a ords a rigorous measure of agent behavior and system dynamics. The game is moved from the two-dimensional plane to the one-dimensional bitstring; at each time step, the evader generates a bit that the pursuer must simultaneously predict. Because behavior is expressed as a time series, we can employ information theory to provide quantitative analysis of agent activity. Further, this version of PE opens vistas onto the communicative component of pursuit and evasion behavior, providing an open-ended serial communications channel and an open world (via coevolution). Results show that subtle changes to our game determine whether it is open-ended, and profoundly a ect the viability of arms-race dynamics.

[1]  David H. Ackley,et al.  Altruism in the evolution of communication , 1994 .

[2]  Dave Cliff,et al.  Tracking the Red Queen: Measurements of Adaptive Progress in Co-Evolutionary Simulations , 1995, ECAL.

[3]  Jordan B. Pollack,et al.  Coevolution of a Backgammon Player , 1996 .

[4]  Pattie Maes,et al.  The Evolution of Communication Schemes Over Continuous Channels , 1996 .

[5]  Dave Cliff,et al.  Co-evolution of pursuit and evasion II: Simulation Methods and results , 1996 .

[6]  Ezequiel A. Di Paolo,et al.  Social coordination and spatial organization: Steps towards the evolution of communication , 1997 .

[7]  T. Ikegami,et al.  Emergence of net-grammar in communicating agents. , 1996, Bio Systems.

[8]  L. Steels Self-organising vocabularies , 1996 .

[9]  Kunihiko Kaneko,et al.  Evolution to the Edge of Chaos in Imitation Game , 1993 .

[10]  Dave Cliff,et al.  Protean behavior in dynamic games: arguments for the co-evolution of pursuit-evasion tactics , 1994 .

[11]  Richard W. Hamming,et al.  Coding and Information Theory , 1980 .

[12]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[13]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[14]  J. Crutchfield The calculi of emergence: computation, dynamics and induction , 1994 .

[15]  Michael Oliphant,et al.  Learning and the Emergence of Coordinated Communication , 1997 .

[16]  Craig W. Reynolds Competition, Coevolution and the Game of Tag , 1994 .

[17]  W. Hamilton,et al.  Sexual reproduction as an adaptation to resist parasites (a review). , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Peter J. Angeline,et al.  Competitive Environments Evolve Better Solutions for Complex Tasks , 1993, ICGA.