Black-box complexity: from complexity theory to playing mastermind

 Together with Frank Neumann and Ingo Wegener, he founded the theory track at GECCO and served as its co-chair 2007-2009.  He is a member of the editorial boards of Evolutionary Computation and Information Processing Letters.  His research area includes theoretical aspects of randomized search heuristics, in particular, run-time analysis and complexity theory.  This is a tutorial on black-box complexity. This is currently one of the hottest topics in the theory of randomized search heuristics.  I shall try my best to..  tell you on an elementary level what black-box complexity is and how it shapes our understanding of randomized search heuristics  give an in-depth coverage of two topics that received much attention in the last few years  stronger upper bounds and the connection to guessing games  alternative black-box models  sketch several open problems  Don't hesitate to ask questions whenever they come up! Agenda  Part 1: Black-box complexity: A complexity theory for randomized search heuristics (RSH)  Introduction/definition  Lower bounds for all RSH (example: needle functions)  Thorn in the flesh: Are there better RSH out there? (example onemax)  Different black-box models – what is the right difficulty measure?  Part 2: Tools and techniques (in the language of guessing games)  From black-box to guessing games  A general lower bound  How to play Mastermind  A new game  Summary, open problems Copyright is held by the author/owner(s).  Why a complexity theory for RSH?  Understand problem difficulty!  How?  Black-box complexity!  What can we do with that?  General lower bounds, thorn in the flesh  Different notions of black-box complexity Why a Complexity Theory for RSH?  Understand problem difficulty!  Randomized search heuristics (RSH) like evolutionary algorithms, genetic algorithms, ant colony optimization, simulated annealing, … are very successful for a variety of problems.  Little general advice which problems are suitable for such general methods  Solution: Complexity theory for RSH  Take a similar successful route as classical algorithmics!  Algorithmics: Design good algorithms and analyze their performance  Complexity theory: Show that certain things are just not possible  The interplay between the two areas proved to be very fruitful for the research on classic algorithms Algorithms vs. Complexity Theory for RSH – An Example  Bottom line: Spanning tree is easy for RSH, the Needle problem …

[1]  Benjamin Doerr,et al.  Ranking-Based Black-Box Complexity , 2011, Algorithmica.

[2]  Benjamin Doerr,et al.  Reducing the arity in unbiased black-box complexity , 2012, GECCO '12.

[3]  Kurt Mehlhorn,et al.  The Query Complexity of Finding a Hidden Permutation , 2013, Space-Efficient Data Structures, Streams, and Algorithms.

[4]  Thomas Jansen,et al.  UNIVERSITY OF DORTMUND REIHE COMPUTATIONAL INTELLIGENCE COLLABORATIVE RESEARCH CENTER 531 Design and Management of Complex Technical Processes and Systems by means of Computational Intelligence Methods Upper and Lower Bounds for Randomized Search Heuristics in Black-Box Optimization , 2004 .

[5]  Andrew Chi-Chih Yao,et al.  Probabilistic computations: Toward a unified measure of complexity , 1977, 18th Annual Symposium on Foundations of Computer Science (sfcs 1977).

[6]  Benjamin Doerr,et al.  Black-box complexities of combinatorial problems , 2011, GECCO '11.

[7]  Thomas Jansen,et al.  On the analysis of the (1+1) evolutionary algorithm , 2002, Theor. Comput. Sci..

[8]  Martin Skutella,et al.  Evolutionary algorithms and matroid optimization problems , 2007, GECCO.

[9]  Benjamin Doerr,et al.  Lessons from the black-box: fast crossover-based genetic algorithms , 2013, GECCO '13.

[10]  I. Wegener,et al.  The Analysis of Evolutionary Algorithms on Sorting and Shortest Paths Problems , 2004 .

[11]  Benjamin Doerr,et al.  Edge-based representation beats vertex-based representation in shortest path problems , 2010, GECCO '10.

[12]  R. Paul Wiegand,et al.  Black-box search by elimination of fitness functions , 2009, FOGA '09.

[13]  Benjamin Doerr,et al.  Black-Box Complexity: Breaking the O(n logn) Barrier of LeadingOnes , 2011, Artificial Evolution.

[14]  Heinz Mühlenbein,et al.  How Genetic Algorithms Really Work: Mutation and Hillclimbing , 1992, PPSN.

[15]  Michael D. Vose,et al.  Unbiased black box search algorithms , 2011, GECCO '11.

[16]  Benjamin Doerr,et al.  Playing Mastermind with Many Colors , 2013, SODA.

[17]  Per Kristian Lehre,et al.  Black-Box Search by Unbiased Variation , 2010, GECCO '10.

[18]  B. Lindström On a Combinatorial Problem in Number Theory , 1965, Canadian Mathematical Bulletin.

[19]  Benjamin Doerr,et al.  Too fast unbiased black-box algorithms , 2011, GECCO '11.

[20]  Benjamin Doerr,et al.  Playing Mastermind with Constant-Size Memory , 2012, Theory of Computing Systems.

[21]  Ingo Wegener,et al.  Randomized local search, evolutionary algorithms, and the minimum spanning tree problem , 2004, Theor. Comput. Sci..

[22]  W. H. Mills,et al.  Determination of a Subset from Certain Combinatorial Properties , 1966, Canadian Journal of Mathematics.

[23]  Ingo Wegener,et al.  On the Optimization of Monotone Polynomials by Simple Randomized Search Heuristics , 2005, Combinatorics, Probability and Computing.

[24]  H. S. Shapiro,et al.  A Combinatory Detection Problem , 1963 .

[25]  Benjamin Doerr,et al.  Black-box complexities of combinatorial problems , 2013, Theor. Comput. Sci..

[26]  Per Kristian Lehre,et al.  Faster black-box algorithms through higher arity operators , 2010, FOGA '11.