Coevolutionary Neural Population Models

We present a method for using neural networks to model evolutionary population dynamics, and draw parallels to recent deep learning advancements in which adversarially-trained neural networks engage in coevolutionary interactions. We conduct experiments which demonstrate that models from evolutionary game theory are capable of describing the behavior of these neural population systems.

[1]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[2]  John F. Kolen,et al.  Backpropagation is Sensitive to Initial Conditions , 1990, Complex Syst..

[3]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[4]  Karl Tuyls,et al.  Evolutionary Dynamics of Multi-Agent Learning: A Survey , 2015, J. Artif. Intell. Res..

[5]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .

[6]  W. Oechel,et al.  Automatic design and manufacture of robotic lifeforms , 2022 .

[7]  Kenneth O. Stanley,et al.  A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks , 2009, Artificial Life.

[8]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[9]  D. E. Matthews.  Evolution and the Theory of Games , 1977 .

[10]  Mario Lucic,et al.  Are GANs Created Equal? A Large-Scale Study , 2017, NeurIPS.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Kenneth O. Stanley,et al.  Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning , 2017, ArXiv.

[13]  J. Doyne Farmer,et al.  A Rosetta stone for connectionism , 1990 .

[14]  Rasmus K. Ursem,et al.  Diversity-Guided Evolutionary Algorithms , 2002, PPSN.

[15]  Elliot Meyerson,et al.  Evolving Deep Neural Networks , 2017, Artificial Intelligence in the Age of Neural Networks and Brain Computing.

[16]  David Warde-Farley,et al.  1 Adversarial Perturbations of Deep Neural Networks , 2016 .

[17]  Jordan B. Pollack,et al.  Effects of Finite Populations on Evolutionary Stable Strategies , 2000, GECCO.

[18]  Kristian Lindgren,et al.  Evolutionary phenomena in simple dynamics , 1992 .

[19]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[20]  David B. Fogel,et al.  On the instability of evolutionary stable strategies in small populations , 1998 .

[21]  Inman Harvey,et al.  Issues in evolutionary robotics , 1993 .

[22]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.