Constrained optimization based on modified differential evolution algorithm

This paper presents a novel Constrained Optimization based on Modified Differential Evolution algorithm (COMDE). In the new algorithm, a new directed mutation rule, based on the weighted difference vector between the best and the worst individuals at a particular generation, is introduced. The new directed mutation rule is combined with the modified basic mutation strategy DE/rand/1/bin, where only one of the two mutation rules is applied with the probability of 0.5. The proposed mutation rule is shown to enhance the local search ability of the basic Differential Evolution (DE) and to get a better trade-off between convergence rate and robustness. Two new scaling factors are introduced as uniform random variables to improve the diversity of the population and to bias the search direction. Additionally, a dynamic non-linear increased crossover probability is utilized to balance the global exploration and local exploitation. COMDE also includes a modified constraint handling technique based on feasibility and the sum of constraints violations. A new dynamic tolerance technique to handle equality constraints is also adopted. The effectiveness and benefits of the new directed mutation strategy and modified basic strategy used in COMDE has been experimentally investigated. The effect of the parameters of the crossover probability function and the parameters of the dynamic tolerance equation on the performance of COMDE have been analyzed and evaluated by different experiments. Numerical experiments on 13 well-known benchmark test functions and five engineering design problems have shown that the new approach is efficient, effective and robust. The comparison results between the COMDE and the other 28 state-of-the-art evolutionary algorithms indicate that the proposed COMDE algorithm is competitive with, and in some cases superior to, other existing algorithms in terms of the quality, efficiency, convergence rate, and robustness of the final solution.

[1]  Wenjian Luo,et al.  Differential evolution with dynamic stochastic selection for constrained optimization , 2008, Inf. Sci..

[2]  Yong Wang,et al.  Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization , 2010, Appl. Soft Comput..

[3]  Yong Wang,et al.  A hybrid multi-swarm particle swarm optimization to solve constrained optimization problems , 2009, Frontiers of Computer Science in China.

[4]  Ali Wagdy Mohamed,et al.  An alternative differential evolution algorithm for global optimization , 2012 .

[5]  Vitaliy Feoktistov.  Differential Evolution: In Search of Solutions , 2006 .

[6]  Adriana Menchaca-Mendez,et al.  A new proposal to hybridize the Nelder-Mead method to a differential evolution algorithm for constrained optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[7]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[8]  Vitaliy Feoktistov,et al.  Differential Evolution: In Search of Solutions (Springer Optimization and Its Applications) , 2006 .

[9]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[10]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[11]  Yuren Zhou,et al.  Multiobjective Optimization and Hybrid Evolutionary Algorithm to Solve Constrained Optimization Problems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Gary G. Yen,et al.  A generic framework for constrained optimization using genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[13]  Carlos A. Coello Coello,et al.  Constraint-handling in genetic algorithms through the use of dominance-based tournament selection , 2002, Adv. Eng. Informatics.

[14]  Angel Eduardo Muñoz Zavala,et al.  Continuous Constrained Optimization with Dynamic Tolerance Using the COPSO Algorithm , 2009 .

[15]  Ling Wang,et al.  An effective co-evolutionary differential evolution for constrained optimization , 2007, Appl. Math. Comput..

[16]  Carlos A. Coello Coello,et al.  Promising infeasibility and multiple offspring incorporated to differential evolution for constrained optimization , 2005, GECCO '05.

[17]  Efrén Mezura-Montes,et al.  Self-adaptive and Deterministic Parameter Control in Differential Evolution for Constrained Optimization , 2009 .

[18]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[19]  Zhun Fan,et al.  Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique , 2009 .

[20]  Carlos A. Coello Coello,et al.  THEORETICAL AND NUMERICAL CONSTRAINT-HANDLING TECHNIQUES USED WITH EVOLUTIONARY ALGORITHMS: A SURVEY OF THE STATE OF THE ART , 2002 .

[21]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[22]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms, Homomorphous Mappings, and Constrained Parameter Optimization , 1999, Evolutionary Computation.

[23]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[24]  Ling Wang,et al.  A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization , 2007, Appl. Math. Comput..

[25]  Ruhul A. Sarker,et al.  AMA: a new approach for solving constrained real-valued optimization problems , 2009, Soft Comput..

[26]  Muhammad Khurram Khan,et al.  An effective memetic differential evolution algorithm based on chaotic local search , 2011, Inf. Sci..

[27]  Xin Yao,et al.  Search biases in constrained evolutionary optimization , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Tetsuyuki Takahama,et al.  Constrained optimization by applying the /spl alpha/ constrained method to the nonlinear simplex method with mutations , 2005, IEEE Transactions on Evolutionary Computation.

[29]  Anthony Chen,et al.  Constraint handling in genetic algorithms using a gradient-based repair method , 2006, Comput. Oper. Res..

[30]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[31]  Ling Wang,et al.  An effective differential evolution with level comparison for constrained engineering design , 2010 .

[32]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[33]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[34]  Gary G. Yen,et al.  A Self Adaptive Penalty Function Based Algorithm for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[35]  Carlos A. Coello Coello,et al.  An Improved Diversity Mechanism for Solving Constrained Optimization Problems Using a Multimembered Evolution Strategy , 2004, GECCO.

[36]  Swagatam Das,et al.  An improved differential evolution algorithm with fitness-based adaptation of the control parameters , 2011, Inf. Sci..

[37]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[38]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[39]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[40]  Carlos A. Coello Coello,et al.  Simple Feasibility Rules and Differential Evolution for Constrained Optimization , 2004, MICAI.

[41]  C. Coello,et al.  Cultured differential evolution for constrained optimization , 2006 .

[42]  Ruhul A. Sarker,et al.  A Simple Ranking and Selection for Constrained Evolutionary Optimization , 2006, SEAL.

[43]  Tapabrata Ray,et al.  Society and civilization: An optimization algorithm based on the simulation of social behavior , 2003, IEEE Trans. Evol. Comput..

[44]  Ricardo Landa Becerra,et al.  Efficient evolutionary optimization through the use of a cultural algorithm , 2004 .

[45]  Efrén Mezura-Montes,et al.  Differential evolution in constrained numerical optimization: An empirical study , 2010, Inf. Sci..

[46]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[47]  J. Lampinen.  A constraint handling approach for the differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).