Using a Queue Genetic Algorithm to Evolve Xpilot Control Strategies on a Distributed System

In this paper, we describe a distributed learning system used to evolve a control program for an agent operating in the network game Xpilot. This system, which we refer to as a queue genetic algorithm, is a steady state genetic algorithm that uses stochastic selection and first-in-first-out replacement. We employ it to distribute fitness evaluations over a local network of dissimilar computers. The system made full use of our available computers while evolving successful controller solutions that were comparable to those evolved using a regular generational genetic algorithm.

[1]  Kenneth de Jong,et al.  Generation gap methods , 2018, Evolutionary Computation 1.

[2]  K. Dejong,et al.  An Analysis Of The Behavior Of A Class Of Genetic Adaptive Systems , 1975 .

[3]  L. Darrell Whitley,et al.  The GENITOR Algorithm and Selection Pressure: Why Rank-Based Allocation of Reproductive Trials is Best , 1989, ICGA.

[4]  Gary B. Parker,et al.  Evolving autonomous agent control in the Xpilot environment , 2005, 2005 IEEE Congress on Evolutionary Computation.

[5]  Jeffrey Horn,et al.  Handbook of evolutionary computation , 1997 .

[6]  Georges R. Harik,et al.  Foundations of Genetic Algorithms , 1997 .

[7]  G.B. Parker,et al.  Using cyclic genetic algorithms to evolve multi-loop control programs , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[8]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[9]  Thomas Philip Runarsson,et al.  An Asynchronous Parallel Evolution Strategy , 2003, Int. J. Comput. Intell. Appl..

[10]  L. Darrell Whitley,et al.  GENITOR II: a distributed genetic algorithm , 1990, J. Exp. Theor. Artif. Intell..

[11]  Gary B. Parker,et al.  CYCLIC GENETIC ALGORITHMS FOR THE LOCOMOTION OF HEXAPOD ROBOTS , 2008 .

[12]  Naoki Shibata,et al.  TECHNIQUES TO IMPROVE EXPLORATION EFFICIENCY OF PARALLEL SELF ADAPTIVE GENETIC ALGORITHMS BY DISPENSING SYNCHRONIZATION , 2004 .

[13]  Kenneth A. De Jong,et al.  Generation Gaps Revisited , 1992, FOGA.

[14]  Gary B. Parker,et al.  Evolution and prioritization of survival strategies for a simulated robot in Xpilot , 2005, 2005 IEEE Congress on Evolutionary Computation.