Analysis of diversity mechanisms for optimisation in dynamic environments with low frequencies of change

Evolutionary dynamic optimisation has become one of the most active research areas in evolutionary computation. We consider the Balance function for which the poor expected performance of the (1+1) EA at low frequencies of change has been shown in the literature. We analyse the impact of populations and diversity mechanisms towards the robustness of evolutionary algorithms with respect to frequencies of change. We rigorously prove that there exists a sufficiently low frequency of change such that the (μ+1) EA without diversity requires exponential time with overwhelming probability for sublinear population sizes. The same result also holds if the algorithm is equipped with a genotype diversity mechanism. Furthermore we prove that a crowding mechanism makes the performance of the (μ+1) EA much worse (i. e., it is inefficient for any population size). On the positive side we prove that, independent of the frequency of change, a fitness-diversity mechanism turns the runtime from exponential to polynomial. Finally, we show how a careful use of fitness-sharing together with a crowding mechanism is effective already with a population of size 2. We shed light through experiments when our theoretical results do not cover the whole parameter range. Parts of the results appeared in the Proceedings of 15th Annual Conference on Genetic and Evolutionary Computation (GECCO 2013) [1]. Email addresses: P.Oliveto@sheffield.ac.uk (Pietro S. Oliveto), C.Zarges@cs.bham.ac.uk (Christine Zarges) P.S. Oliveto was supported in part by EPSRC under grant N. EP/H028900/1. Preprint submitted to Theoretical Computer Science October 21, 2014

[1]  Pietro Simone Oliveto,et al.  Analysis of diversity mechanisms for optimisation in dynamic environments with low frequencies of change , 2013, GECCO '13.

[2]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[3]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[4]  Xin Yao,et al.  Drift analysis and average time complexity of evolutionary algorithms , 2001, Artif. Intell..

[5]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[6]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[7]  Hui Cheng,et al.  Multi-population Genetic Algorithms with Immigrants Scheme for Dynamic Shortest Path Routing Problems in Mobile Ad Hoc Networks , 2010, EvoApplications.

[8]  Jeffrey Horn,et al.  Handbook of evolutionary computation , 1997 .

[9]  Xin Yao,et al.  The Impact of Mutation Rate on the Computation Time of Evolutionary Dynamic Optimization , 2011, ArXiv.

[10]  Pietro Simone Oliveto,et al.  Theoretical analysis of fitness-proportional selection: landscapes and efficiency , 2009, GECCO.

[11]  Carlos Cruz,et al.  Optimization in dynamic environments: a survey on problems, methods and measures , 2011, Soft Comput..

[12]  Thomas Jansen,et al.  Analyzing Evolutionary Algorithms , 2015, Natural Computing Series.

[13]  Shengxiang Yang,et al.  Non-stationary problem optimization using the primal-dual genetic algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[14]  Thomas Jansen,et al.  Exploring the Explorative Advantage of the Cooperative Coevolutionary (1+1) EA , 2003, GECCO.

[15]  Pietro Simone Oliveto,et al.  Analysis of population-based evolutionary algorithms for the vertex cover problem , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[16]  Thomas Jansen,et al.  Analyzing Evolutionary Algorithms: The Computer Science Perspective , 2012 .

[17]  Thomas Jansen,et al.  On the analysis of the (1+1) evolutionary algorithm , 2002, Theor. Comput. Sci..

[18]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[19]  Stefan Droste,et al.  Design and Management of Complex Technical Processes and Systems by Means of Computational Intelligence Methods Analysis of the (1+1) Ea for a Dynamically Bitwise Changing Onemax Analysis of the (1+1) Ea for a Dynamically Bitwise Changing Onemax , 2003 .

[20]  Carsten Witt,et al.  Runtime Analysis of the ( + 1) EA on Simple Pseudo-Boolean Functions , 2006, Evolutionary Computation.

[21]  Pietro Simone Oliveto,et al.  Analysis of Diversity-Preserving Mechanisms for Global Exploration , 2009, Evolutionary Computation.

[22]  Ronald W. Morrison,et al.  Designing Evolutionary Algorithms for Dynamic Environments , 2004, Natural Computing Series.

[23]  Ingo Wegener,et al.  Real royal road functions for constant population size , 2003, Theor. Comput. Sci..

[24]  Per Kristian Lehre,et al.  Dynamic evolutionary optimisation: an analysis of frequency and magnitude of change , 2009, GECCO.

[25]  Shane Legg,et al.  Fitness uniform optimization , 2006, IEEE Transactions on Evolutionary Computation.

[26]  Stefan Droste,et al.  Analysis of the (1+1) EA for a dynamically changing ONEMAX-variant , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[27]  Timo Kötzing,et al.  ACO Beats EA on a Dynamic Pseudo-Boolean Function , 2012, PPSN.

[28]  Mark Wineberg,et al.  The Shifting Balance Genetic Algorithm: improving the GA in a dynamic environment , 1999 .

[29]  Yao Wang,et al.  Estimation of evolvability genetic algorithm and dynamic environments , 2006, Genetic Programming and Evolvable Machines.

[30]  Frank Neumann,et al.  Bioinspired computation in combinatorial optimization: algorithms and their computational complexity , 2010, GECCO '12.

[31]  Karsten Weicker,et al.  Evolutionary algorithms and dynamic optimization problems , 2003 .

[32]  Thomas Jansen,et al.  Theoretical analysis of a mutation-based evolutionary algorithm for a tracking problem in the lattice , 2005, GECCO '05.

[33]  Anne Auger,et al.  Theory of Randomized Search Heuristics , 2012, Algorithmica.

[34]  Frank Neumann,et al.  Comparison of simple diversity mechanisms on plateau functions , 2009, Theor. Comput. Sci..

[35]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .