Performance comparison of local search operators in differential evolution for constrained numerical optimization problems

This paper analyzes the relationship between the performance of the local search operator within a Memetic Algorithm and its final results in constrained numerical optimization problems by adapting an improvement index measure, which indicates the rate of fitness improvement made by the local search operator. To perform this analysis, adaptations of Nealder-Mead, Hooke-Jeeves and Hill Climber algorithms are used as local search operators, separately, in a Memetic DE-based structure, where the best solution in the population is used to exploit promising areas in the search space by the aforementioned local search operators. The "-constrained method is adopted as a constraint-handling technique. The approaches are tested on thirty six benchmark problems used in the special session on "Single Objective Constrained Real-Parameter Optimization" in CEC'2010. The results suggest that the algorithm coordination proposed is suitable to solve constrained problems and those results also show that a poor value of the improvement index measure does not necessarily reflect on poor final results obtained by the MA in a constrained search space.

[1]  Efrén Mezura-Montes,et al.  Memetic differential evolution for constrained numerical optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[2]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[3]  Efrén Mezura-Montes,et al.  Differential evolution in constrained numerical optimization: An empirical study , 2010, Inf. Sci..

[4]  Yan Zhou,et al.  A memetic co-evolutionary differential evolution algorithm for constrained optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[5]  Ferrante Neri,et al.  An Adaptive Multimeme Algorithm for Designing HIV Multidrug Therapies , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[6]  Roger J.-B. Wets,et al.  Minimization by Random Search Techniques , 1981, Math. Oper. Res..

[7]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[8]  Carlos Cotta,et al.  Memetic algorithms and memetic computing optimization: A literature review , 2012, Swarm Evol. Comput..

[9]  Ville Tirronen,et al.  On memetic Differential Evolution frameworks: A study of advantages and limitations in hybridization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[10]  Kalyanmoy Deb,et al.  Optimization for Engineering Design: Algorithms and Examples , 2004 .

[11]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[12]  Adam P. Piotrowski,et al.  Adaptive Memetic Differential Evolution with Global and Local neighborhood-based mutation operators , 2013, Inf. Sci..

[13]  Ponnuthurai N. Suganthan,et al.  Modified differential evolution with local search algorithm for real world optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[14]  Fuqing Zhao,et al.  A Memetic Differential Evolution Algorithm with Adaptive Mutation Operator , 2012 .

[15]  Carlos A. Coello Coello,et al.  A memetic algorithm with simplex crossover for solving constrained optimization problems , 2012, WAC 2012.

[16]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[17]  Morteza Alinia Ahandani,et al.  A differential memetic algorithm , 2011, Artificial Intelligence Review.

[18]  Tetsuyuki Takahama,et al.  Constrained optimization by the ε constrained differential evolution with an archive and gradient-based mutation , 2010, IEEE Congress on Evolutionary Computation.

[19]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[20]  Antonio LaTorre,et al.  A Memetic Differential Evolution Algorithm for Continuous Optimization , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[21]  Tetsuyuki Takahama,et al.  Constrained Optimization by the ε Constrained Differential Evolution with Gradient-Based Mutation and Feasible Elites , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[22]  Tetsuyuki Takahama,et al.  Constrained Optimization by the epsilon Constrained Hybrid Algorithm of Particle Swarm Optimization and Genetic Algorithm , 2005, Australian Conference on Artificial Intelligence.

[23]  Adriana Menchaca-Mendez,et al.  A new proposal to hybridize the Nelder-Mead method to a differential evolution algorithm for constrained optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[24]  Chunmei Zhang,et al.  Distributed memetic differential evolution with the synergy of Lamarckian and Baldwinian learning , 2013, Appl. Soft Comput..

[25]  Ruhul A. Sarker,et al.  An agent-based memetic algorithm (AMA) for solving constrained optimazation problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[26]  N. Hansen,et al.  Markov Chain Analysis of Cumulative Step-Size Adaptation on a Linear Constrained Problem , 2015, Evolutionary Computation.

[27]  Efrén Mezura-Montes,et al.  A hybrid version of differential evolution with two differential mutation operators applied by stages , 2013, 2013 IEEE Congress on Evolutionary Computation.

[28]  Mauro Birattari,et al.  The irace Package: Iterated Race for Automatic Algorithm , 2011 .

[29]  Guillermo Leguizamón,et al.  Hibridación de Evolución Diferencial utilizando Hill Climbing para resolver problemas de optimizaci´on con restricciones , 2012 .

[30]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.