Differential Evolution with Novel Mutation and Adaptive Crossover Strategies for Solving Large Scale Global Optimization Problems

This paper presents Differential Evolution algorithm for solving high-dimensional optimization problems over continuous space. The proposed algorithm, namely, ANDE, introduces a new triangular mutation rule based on the convex combination vector of the triplet defined by the three randomly chosen vectors and the difference vectors between the best, better, and the worst individuals among the three randomly selected vectors. The mutation rule is combined with the basic mutation strategy DE/rand/1/bin, where the new triangular mutation rule is applied with the probability of 2/3 since it has both exploration ability and exploitation tendency. Furthermore, we propose a novel self-adaptive scheme for gradual change of the values of the crossover rate that can excellently benefit from the past experience of the individuals in the search space during evolution process which in turn can considerably balance the common trade-off between the population diversity and convergence speed. The proposed algorithm has been evaluated on the 20 standard high-dimensional benchmark numerical optimization problems for the IEEE CEC-2010 Special Session and Competition on Large Scale Global Optimization. The comparison results between ANDE and its versions and the other seven state-of-the-art evolutionary algorithms that were all tested on this test suite indicate that the proposed algorithm and its two versions are highly competitive algorithms for solving large scale global optimization problems.

[1]  Janez Brest,et al.  Large scale global optimization using self-adaptive differential evolution algorithm , 2010, IEEE Congress on Evolutionary Computation.

[2]  Ali Wagdy Mohamed,et al.  An alternative differential evolution algorithm for global optimization , 2012 .

[3]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[4]  Francisco Herrera,et al.  MA-SW-Chains: Memetic algorithm based on local search chains for large scale continuous global optimization , 2010, IEEE Congress on Evolutionary Computation.

[5]  Ali Wagdy Mohamed,et al.  A New Modified Binary Differential Evolution Algorithm and its Applications , 2016 .

[6]  Ponnuthurai N. Suganthan,et al.  Dynamic multi-swarm particle swarm optimizer with sub-regional harmony search , 2010, IEEE Congress on Evolutionary Computation.

[7]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[8]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[9]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[10]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[11]  Hegazy Zaher Sabry,et al.  Advanced Differential Evolution algorithm for global numerical optimizatiom , 2011, 2011 IEEE International Conference on Computer Applications and Industrial Electronics (ICCAIE).

[12]  Ali Wagdy Mohamed,et al.  Real parameter optimization by an effective differential evolution algorithm , 2013 .

[13]  Bin Li,et al.  A Self-adaptive Mixed Distribution Based Uni-variate Estimation of Distribution Algorithm for Large Scale Global Optimization , 2009, Nature-Inspired Algorithms for Optimisation.

[14]  Ruhul A. Sarker,et al.  An Improved Self-Adaptive Differential Evolution Algorithm for Optimization Problems , 2013, IEEE Transactions on Industrial Informatics.

[15]  Ali Wagdy Mohamed.  Solving stochastic programming problems using new approach to Differential Evolution algorithm , 2017 .

[16]  Tapabrata Ray,et al.  Differential Evolution With Dynamic Parameters Selection for Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[17]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[18]  Bassem Jarboui,et al.  A fuzzy logic control using a differential evolution algorithm aimed at modelling the financial market dynamics , 2011, Inf. Sci..

[19]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[20]  Jurij Silc,et al.  The differential Ant-Stigmergy Algorithm for large-scale global optimization , 2010, IEEE Congress on Evolutionary Computation.

[21]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[22]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[23]  Abdulrahman H. Altalhi,et al.  A Nonlinear Goal Programming Model for University Admission Capacity Planning with Modified Differential Evolution Algorithm , 2015 .

[24]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[25]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[26]  Ali Wagdy Mohamed,et al.  A Generalized National Planning Approach for Admission Capacity in Higher Education: A Nonlinear Integer Goal Programming Model with a Novel Differential Evolution Algorithm , 2016, Comput. Intell. Neurosci..

[27]  Ali Wagdy Mohamed,et al.  A novel differential evolution algorithm for solving constrained engineering optimization problems , 2017, Journal of Intelligent Manufacturing.

[28]  X. Yao,et al.  Scaling up fast evolutionary programming with cooperative coevolution , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[29]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[30]  Vitaliy Feoktistov.  Differential Evolution: In Search of Solutions , 2006 .

[31]  Zhijian Wu,et al.  Sequential DE enhanced by neighborhood search for Large Scale Global Optimization , 2010, IEEE Congress on Evolutionary Computation.

[32]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[33]  Ali Wagdy Mohamed,et al.  Constrained optimization based on modified differential evolution algorithm , 2012, Inf. Sci..

[34]  Ali Wagdy Mohamed,et al.  A Large-Scale Nonlinear Mixed-Binary Goal Programming Model to Assess Candidate Locations for Solar Energy Stations: An Improved Real-Binary Differential Evolution Algorithm with a Case Study , 2016 .

[35]  Janez Brest,et al.  Large Scale Global Optimization using Differential Evolution with self-adaptation and cooperative co-evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[36]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[37]  Ali Wagdy Mohamed,et al.  An efficient modified differential evolution algorithm for solving constrained non-linear integer and mixed-integer global optimization problems , 2015, International Journal of Machine Learning and Cybernetics.

[38]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[39]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[40]  Bin Li,et al.  Two-stage based ensemble optimization for large-scale global optimization , 2010, IEEE Congress on Evolutionary Computation.

[41]  Ivan Zelinka,et al.  ON STAGNATION OF THE DIFFERENTIAL EVOLUTION ALGORITHM , 2000 .

[42]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[43]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[44]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[45]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[46]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[47]  Ali Wagdy Mohamed,et al.  An improved differential evolution algorithm with triangular mutation for global numerical optimization , 2015, Comput. Ind. Eng..