Self-adaptive differential evolution incorporating a heuristic mixing of operators

A considerable number of differential evolution variants have been proposed in the last few decades. However, no variant was able to consistently perform over a wide range of test problems. In this paper, propose two novel differential evolution based algorithms are proposed for solving constrained optimization problems. Both algorithms utilize the strengths of multiple mutation and crossover operators. The appropriate mix of the mutation and crossover operators, for any given problem, is determined through an adaptive learning process. In addition, to further accelerate the convergence of the algorithm, a local search technique is applied to a few selected individuals in each generation. The resulting algorithms are named as Self-Adaptive Differential Evolution Incorporating a Heuristic Mixing of Operators. The algorithms have been tested by solving 60 constrained optimization test instances. The results showed that the proposed algorithms have a competitive, if not better, performance in comparison to the-state-of-the-art algorithms.

[1]  Ruhul A. Sarker,et al.  Multi-operator based evolutionary algorithms for solving constrained optimization problems , 2011, Comput. Oper. Res..

[2]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[3]  Alan F. Murray,et al.  IEEE International Conference on Neural Networks , 1997 .

[4]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[5]  Gregory W. Corder,et al.  Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach , 2009 .

[6]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[7]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[8]  Ville Tirronen,et al.  A Memetic Differential Evolution in Filter Design for Defect Detection in Paper Production , 2009, EvoWorkshops.

[9]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[10]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[11]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[12]  Ville Tirronen,et al.  Super-fit control adaptation in memetic differential evolution frameworks , 2009, Soft Comput..

[13]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[14]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[15]  C. Coello,et al.  Cultured differential evolution for constrained optimization , 2006 .

[16]  P. N. Suganthan,et al.  Ensemble of Constraint Handling Techniques , 2010, IEEE Transactions on Evolutionary Computation.

[17]  Ville Tirronen,et al.  An Enhanced Memetic Differential Evolution in Filter Design for Defect Detection in Paper Production , 2008, Evolutionary Computation.

[18]  Chuan-Kang Ting,et al.  Varying Number of Difference Vectors in Differential Evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[19]  Mehmet Fatih Tasgetiren,et al.  An ensemble of differential evolution algorithms for constrained function optimization , 2010, IEEE Congress on Evolutionary Computation.

[20]  David B. Fogel,et al.  A Comparison of Evolutionary Programming and Genetic Algorithms on Selected Constrained Optimization Problems , 1995, Simul..

[21]  Andries Petrus Engelbrecht,et al.  Self-adaptive Differential Evolution , 2005, CIS.

[22]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[23]  Mark Sumner,et al.  A Fast Adaptive Memetic Algorithm for Online and Offline Control Design of PMSM Drives , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Tetsuyuki Takahama,et al.  Constrained optimization by the ε constrained differential evolution with an archive and gradient-based mutation , 2010, IEEE Congress on Evolutionary Computation.

[25]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[26]  Frode Rømo,et al.  Optimizing the Norwegian Natural Gas Production and Transport , 2009, Interfaces.

[27]  Xiaodong Li,et al.  Improving the Performance and Scalability of Differential Evolution , 2008, SEAL.

[28]  A. A. Ilemobade,et al.  Application of a constrained non-linear hydraulic gradient design tool to water reticulation network upgrade , 2006 .

[29]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[30]  H. Abbass The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[31]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[32]  Jani Rönkkönen ContinuousMultimodal Global Optimization with Differential Evolution-Based Methods , 2009 .

[33]  Gary G. Yen,et al.  An Adaptive Penalty Formulation for Constrained Evolutionary Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[34]  Mehmet Fatih Tasgetiren,et al.  An ensemble of discrete differential evolution algorithms for solving the generalized traveling salesman problem , 2010, Appl. Math. Comput..

[35]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[36]  Yu Gao,et al.  A Memetic Differential Evolutionary Algorithm for High Dimensional Functions' Optimization , 2007, Third International Conference on Natural Computation (ICNC 2007).

[37]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[38]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[39]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[40]  Carlos A. Coello Coello,et al.  Modified Differential Evolution for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[41]  Robert F. Dell,et al.  Optimally Stationing Army Forces , 2008, Interfaces.

[42]  Yuren Zhou,et al.  An Adaptive Tradeoff Model for Constrained Evolutionary Optimization , 2008, IEEE Transactions on Evolutionary Computation.