Accelerating human-computer collaborative search through learning comparative and predictive user models

Interactive Evolutionary Algorithms (IEAs) have much potential for allowing a human user to guide a search algorithm, but have struggled to overcome the limitations of slow, easily-fatigued human users. Here we describe The Approximate User (TAU) system in which these limitations are overcome by using a model of the user's preferences - which are continuously built and refined during the search process - to drive the search algorithm. Two variations of a user-modeling approach are compared to determine if this approach can accelerate IEA search. The two user-modeling approaches compared are: 1. learning a classifier which correctly determines which of two designs is better; and 2. learning a model which predicts a fitness score. Rather than having people do the user-testing, we propose the use of a simulated user as an easier means to test IEAs. Both variants of the TAU IEA are compared against a basic IEA and it is shown that TAU is up to 2.7 times faster and 15 times more reliable at producing near optimal results. In addition, we see TAU as a step toward building a more general Human-Computer Collaborative system.

[1]  R. Dawkins The Blind Watchmaker , 1986 .

[2]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[3]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[4]  Karl Sims,et al.  Artificial evolution for computer graphics , 1991, SIGGRAPH.

[5]  Craig Caldwell,et al.  Tracking a Criminal Suspect Through "Face-Space" with a Genetic Algorithm , 1991, ICGA.

[6]  Samir W. Mahfoud Crowding and Preselection Revisited , 1992, PPSN.

[7]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[8]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[9]  Hod Lipson,et al.  Nonlinear system identification using coevolution of models and tests , 2005, IEEE Transactions on Evolutionary Computation.

[10]  Hod Lipson,et al.  Actively probing and modeling users in interactive coevolution , 2006, GECCO.

[11]  Somlak Wannarumon,et al.  Aesthetic evolutionary algorithm for fractal-based user-centered jewelry design , 2007, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[12]  Hod Lipson,et al.  Automated reverse engineering of nonlinear dynamical systems , 2007, Proceedings of the National Academy of Sciences.

[13]  Rahul Rai,et al.  A STOCHASTIC GRAPH GRAMMAR ALGORITHM FOR INTERACTIVE SEARCH , 2009 .

[14]  Christopher A. Mattson,et al.  A Computationally-assisted Methodology for Preference-guided Conceptual Design , 2010 .

[15]  Kenneth O. Stanley,et al.  Picbreeder: A Case Study in Collaborative Evolutionary Exploration of Design Space , 2011, Evolutionary Computation.

[16]  Hod Lipson,et al.  Evolving three-dimensional objects with a generative encoding inspired by developmental biology , 2011, ECAL.