Modeling user selection in quality diversity

The initial phase in real world engineering optimization and design is a process of discovery in which not all requirements can be made in advance, or are hard to formalize. Quality diversity algorithms, which produce a variety of high performing solutions, provide a unique chance to support engineers and designers in the search for what is possible and high performing. In this work we begin to answer the question how a user can interact with quality diversity and turn it into an interactive innovation aid. By modeling a user's selection it can be determined whether the optimization is drifting away from the user's preferences. The optimization is then constrained by adding a penalty to the objective function. We present an interactive quality diversity algorithm that can take into account the user's selection. The approach is evaluated in a new multimodal optimization benchmark that allows various optimization tasks to be performed. The user selection drift of the approach is compared to a state of the art alternative on both a planning and a neuroevolution control task, thereby showing its limits and possibilities.

[1]  Rostislav Khlebnikov,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2016 .

[2]  Laurens van der Maaten,et al.  Accelerating t-SNE using tree-based algorithms , 2014, J. Mach. Learn. Res..

[3]  Gregory S. Hornby,et al.  Automated Antenna Design with Evolutionary Algorithms , 2006 .

[4]  Kenneth O. Stanley,et al.  A novel human-computer collaboration: combining novelty search with interactive evolution , 2014, GECCO.

[5]  Yiannis Demiris,et al.  Quality and Diversity Optimization: A Unifying Modular Framework , 2017, IEEE Transactions on Evolutionary Computation.

[6]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[7]  Kenneth O. Stanley,et al.  Abandoning Objectives: Evolution Through the Search for Novelty Alone , 2011, Evolutionary Computation.

[8]  Antoine Cully,et al.  Robots that can adapt like animals , 2014, Nature.

[9]  Jean-Baptiste Mouret,et al.  Discovering the elite hypervolume by leveraging interspecies correlation , 2018, GECCO.

[10]  Jonathan Goldstein,et al.  When Is ''Nearest Neighbor'' Meaningful? , 1999, ICDT.

[11]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[12]  Thomas Bäck,et al.  Prototype Discovery using Quality-Diversity , 2018, PPSN.

[13]  Jean-Baptiste Mouret,et al.  Data-Efficient Design Exploration through Surrogate-Assisted Illumination , 2018, Evolutionary Computation.

[14]  Kenneth O. Stanley,et al.  Searching for Quality Diversity When Diversity is Unaligned with Quality , 2016, PPSN.

[15]  Kenneth O. Stanley,et al.  Quality Diversity: A New Frontier for Evolutionary Computation , 2016, Front. Robot. AI.

[16]  Francesco Iorio,et al.  Parameters tell the design story: ideation and abstraction in design optimization , 2014, ANSS 2014.

[17]  H. Niederreiter.  Low-discrepancy and low-dispersion sequences , 1988 .

[18]  Hod Lipson,et al.  Evolving three-dimensional objects with a generative encoding inspired by developmental biology , 2011, ECAL.

[19]  Mike Preuss,et al.  Multimodal Optimization by Means of Evolutionary Algorithms , 2015, Natural Computing Series.

[20]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[21]  Kenneth O. Stanley,et al.  Evolving a diversity of virtual creatures through novelty search and local competition , 2011, GECCO '11.

[22]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Uri Shaham,et al.  Stochastic Neighbor Embedding separates well-separated clusters , 2017, 1702.02670.

[24]  Ian C. Parmee,et al.  Towards the support of innovative conceptual design through interactive designer/evolutionary computing strategies , 2000, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[25]  Stéphane Doncieux,et al.  Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study , 2012, Evolutionary Computation.