On the use of (1, λ )-evolution strategy as efficient local search mechanism for discrete optimization: a behavioral analysis

A major issue while conceiving or parameterizing an optimization heuristic is to ensure an appropriate balance between exploitation and exploration of the search. Evolution strategies and neighborhood-based metaheuristics constitute relevant high-level frameworks, which ease the problem solving but are often complex to configure. Moreover, their effective behavior, according to the particularities of the search landscapes, remains difficult to grasp. In this paper, we deeply investigate the sampled walk search algorithm, which is a local search equivalent of the $$(1,\lambda )$$ -evolution strategy, considering that the neighborhood relation describes mutation possibilities. We specifically designed experiments to better understand the behavior of such a strategy offering a fine way to deal with the exploration versus exploitation dilemma. The main contribution is the analysis of search trajectories by evaluating and visualizing both their width (exploration) and their height (exploitation). More generally, we aim at bringing insights about the behavior of the $$(1,\lambda )$$ -ES in a discrete optimization context and within a fitness landscape perspective.

[1]  Manuel Laguna,et al.  Tabu Search , 1997 .

[2]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[3]  Vesselin K. Vassilev,et al.  Smoothness, ruggedness and neutrality of fitness landscapes: from theory to application , 2003 .

[4]  Gabriela Ochoa,et al.  Search Trajectory Networks of Population-Based Algorithms in Continuous Spaces , 2020, EvoApplications.

[5]  Michael Lissack,et al.  Complexity: the Science, its Vocabulary, and its Relation to Organizations , 1999 .

[6]  Sébastien Vérel,et al.  A study of NK landscapes' basins and local optima networks , 2008, GECCO '08.

[7]  Adrien Goëffon,et al.  Sampled Walk and Binary Fitness Landscapes Exploration , 2017, Artificial Evolution.

[8]  Fred W. Glover,et al.  ID Walk: A Candidate List Strategy with a Simple Diversification Device , 2004, CP.

[9]  Andries P. Engelbrecht,et al.  Recent Advances in the Theory and Application of Fitness Landscapes , 2013 .

[10]  Adrien Goëffon,et al.  Toward the Design of Efficient Pivoting Rules for Local Search , 2016, GECCO.

[11]  Thomas Stützle,et al.  Stochastic Local Search: Foundations & Applications , 2004 .

[12]  Peter Merz,et al.  Advanced Fitness Landscape Analysis and the Performance of Memetic Algorithms , 2004, Evolutionary Computation.

[13]  Michael Affenzeller,et al.  A Comprehensive Survey on Fitness Landscape Analysis , 2012, Recent Advances in Intelligent Engineering Systems.

[14]  Helena Ramalhinho Dias Lourenço,et al.  Iterated Local Search , 2001, Handbook of Metaheuristics.

[15]  Hendrik Richter,et al.  Fitness Landscapes: From Evolutionary Biology to Evolutionary Computation , 2014 .

[16]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[17]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[18]  Wim Hordijk,et al.  A Measure of Landscapes , 1996, Evolutionary Computation.

[19]  Tim Jones Evolutionary Algorithms, Fitness Landscapes and Search , 1995 .

[20]  Andries Petrus Engelbrecht,et al.  A survey of techniques for characterising fitness landscapes and some possible ways forward , 2013, Inf. Sci..

[21]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[22]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[23]  Gintaras Palubeckis,et al.  Multistart Tabu Search Strategies for the Unconstrained Binary Quadratic Optimization Problem , 2004, Ann. Oper. Res..

[24]  L. Peliti,et al.  Population dynamics in a spin-glass model of chemical evolution , 1989, Journal of Molecular Evolution.

[25]  Adrien Goëffon,et al.  Hill-climbing strategies on various landscapes: an empirical comparison , 2013, GECCO '13.

[26]  E. D. Weinberger,et al.  The NK model of rugged fitness landscapes and its application to maturation of the immune response. , 1989, Journal of theoretical biology.

[27]  Michael E. Palmer,et al.  Improved Evolutionary Optimization of Difficult Landscapes: Control of Premature Convergence through Scheduled Sharing , 1991, Complex Syst..

[28]  Sébastien Vérel,et al.  Problem Features versus Algorithm Performance on Rugged Multiobjective Combinatorial Fitness Landscapes , 2016, Evolutionary Computation.

[29]  Georg Thierauf,et al.  Evolution strategies for solving discrete optimization problems , 1996 .

[30]  Adrien Goëffon,et al.  Worst Improvement Based Iterated Local Search , 2018, EvoCOP.