Deep Interactive Evolution

This paper describes an approach that combines generative adversarial networks (GANs) with interactive evolutionary computation (IEC). While GANs can be trained to produce lifelike images, they are normally sampled randomly from the learned distribution, providing limited control over the resulting output. On the other hand, interactive evolution has shown promise in creating various artifacts such as images, music and 3D objects, but traditionally relies on a hand-designed evolvable representation of the target domain. The main insight in this paper is that a GAN trained on a specific target domain can act as a compact and robust genotype-to-phenotype mapping (i.e. most produced phenotypes do resemble valid domain artifacts). Once such a GAN is trained, the latent vector given as input to the GAN's generator network can be put under evolutionary control, allowing controllable and high-quality image generation. In this paper, we demonstrate the advantage of this novel approach through a user study in which participants were able to evolve images that strongly resemble specific target images.

[1]  Karl Sims,et al.  Artificial evolution for computer graphics , 1991, SIGGRAPH.

[2]  Stephen Todd,et al.  Evolutionary Art and Computers , 1992 .

[3]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[4]  Ying Zhang,et al.  Reduced human fatigue interactive evolutionary computation for micromachine design , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[5]  Philippe Collard,et al.  Eye-tracking evolutionary algorithm to minimize user fatigue in IEC applied to interactive one-max problem , 2007, GECCO '07.

[6]  Jimmy Secretan,et al.  Picbreeder: evolving pictures collaboratively online , 2008, CHI.

[7]  Kenneth O. Stanley,et al.  Automatic Content Generation in the Galactic Arms Race Video Game , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[8]  Kenneth O. Stanley,et al.  Interactively evolving harmonies through functional scaffolding , 2011, GECCO '11.

[9]  Kenneth O. Stanley,et al.  On the deleterious effects of a priori objectives on evolution and representation , 2011, GECCO '11.

[10]  Josh C. Bongard,et al.  Combining fitness-based search and user modeling in evolutionary robotics , 2013, GECCO '13.

[11]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[12]  Alexei A. Efros,et al.  Seeing 3D Chairs: Exemplar Part-Based 2D-3D Alignment Using a Large Dataset of CAD Models , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Kristen Grauman,et al.  Fine-Grained Visual Comparisons with Local Learning , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Sebastian Risi,et al.  DrawCompileEvolve: Sparking Interactive Evolutionary Art with Human Creations , 2015, EvoMUSART.

[16]  Joel Lehman,et al.  Petalz: Search-Based Procedural Content Generation for the Casual Gamer , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[17]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[18]  Luca Konig,et al.  The Blind Watchmaker Why The Evidence Of Evolution Reveals A Universe Without Design , 2016 .

[19]  Ian J. Goodfellow,et al.  NIPS 2016 Tutorial: Generative Adversarial Networks , 2016, ArXiv.

[20]  Alexander M. Rush,et al.  Adversarially Regularized Autoencoders for Generating Discrete Structures , 2017, ArXiv.

[21]  David Berthelot,et al.  BEGAN: Boundary Equilibrium Generative Adversarial Networks , 2017, ArXiv.

[22]  Ahmed M. Elgammal,et al.  CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Norms , 2017, ICCC.

[23]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[24]  Alexander M. Rush,et al.  Adversarially Regularized Autoencoders , 2017, ICML.