Enhancing the search ability of differential evolution through orthogonal crossover

Differential evolution (DE) is a class of simple yet powerful evolutionary algorithms for global numerical optimization. Binomial crossover and exponential crossover are two commonly used crossover operators in current popular DE. It is noteworthy that these two operators can only generate a vertex of a hyper-rectangle defined by the mutant and target vectors. Therefore, the search ability of DE may be limited. Orthogonal crossover (OX) operators, which are based on orthogonal design, can make a systematic and rational search in a region defined by the parent solutions. In this paper, we have suggested a framework for using an OX in DE variants and proposed OXDE, a combination of DE/rand/1/bin and OX. Extensive experiments have been carried out to study OXDE and to demonstrate that our framework can also be used for improving the performance of other DE variants.

[1]  Joni-Kristian Kämäräinen,et al.  Differential Evolution Training Algorithm for Feed-Forward Neural Networks , 2003, Neural Processing Letters.

[2]  Rainer Storn,et al.  System design by constraint adaptation and differential evolution , 1999, IEEE Trans. Evol. Comput..

[3]  Carlos García-Martínez,et al.  Global and local real-coded genetic algorithms based on parent-centric crossover operators , 2008, Eur. J. Oper. Res..

[4]  Swagatam Das,et al.  A new differential evolution with improved mutation strategy , 2010, IEEE Congress on Evolutionary Computation.

[5]  Tung-Kuan Liu,et al.  Hybrid Taguchi-genetic algorithm for global numerical optimization , 2004, IEEE Transactions on Evolutionary Computation.

[6]  Stefan Janaqi,et al.  Generalization of the strategies in differential evolution , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[7]  Yuping Wang,et al.  An Evolutionary Algorithm for Global Optimization Based on Level-Set Evolution and Latin Squares , 2007, IEEE Transactions on Evolutionary Computation.

[8]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[9]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[10]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[11]  Hui Li,et al.  Enhanced Differential Evolution With Adaptive Strategies for Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[13]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[14]  Swagatam Das,et al.  An improved differential evolution algorithm with fitness-based adaptation of the control parameters , 2011, Inf. Sci..

[15]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[16]  Carlos A. Coello Coello,et al.  Modified Differential Evolution for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[17]  Muhammad Khurram Khan,et al.  An effective memetic differential evolution algorithm based on chaotic local search , 2011, Inf. Sci..

[18]  C. Coello,et al.  Cultured differential evolution for constrained optimization , 2006 .

[19]  Ruhul A. Sarker,et al.  A Combined MA-GA Approach for Solving Constrained Optimization Problems , 2007, 6th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2007).

[20]  M. Montaz Ali,et al.  Population set-based global optimization algorithms: some modifications and numerical studies , 2004, Comput. Oper. Res..

[21]  Giovanni Iacca,et al.  Disturbed Exploitation compact Differential Evolution for limited memory optimization problems , 2011, Inf. Sci..

[22]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[23]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[24]  Moo Ho Lee,et al.  Dynamic Optimization of a Continuous Polymer Reactor Using a Modified Differential Evolution Algorithm , 1999 .

[25]  Wenyin Gong,et al.  Enhancing the performance of differential evolution using orthogonal design method , 2008, Appl. Math. Comput..

[26]  Qingfu Zhang,et al.  An orthogonal genetic algorithm for multimedia multicast routing , 1999, IEEE Trans. Evol. Comput..

[27]  E. Rafajłowicz,et al.  Halton and Hammersley Sequences in Multivariate Nonparametric Regression , 2006 .

[28]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[29]  H. Iba,et al.  Differential evolution for economic load dispatch problems , 2008 .

[30]  Ruhul A. Sarker,et al.  An agent-based memetic algorithm (AMA) for solving constrained optimazation problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[31]  Yuping Wang,et al.  An orthogonal genetic algorithm with quantization for global numerical optimization , 2001, IEEE Trans. Evol. Comput..

[32]  Hakan Temeltas,et al.  Fuzzy-differential evolution algorithm for planning time-optimal trajectories of a unicycle mobile robot on a predefined path , 2004, Adv. Robotics.

[33]  Mehmet Fatih Tasgetiren,et al.  A Multi-Populated Differential Evolution Algorithm for Solving Constrained Optimization Problem , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[34]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[35]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[36]  Amit Konar,et al.  Automatic image pixel clustering with an improved differential evolution , 2009, Appl. Soft Comput..

[37]  Shinn-Ying Ho,et al.  Intelligent evolutionary algorithms for large parameter optimization problems , 2004, IEEE Trans. Evol. Comput..

[38]  Gao-Ji Sun,et al.  A new evolutionary algorithm for global numerical optimization , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[39]  Qingfu Zhang,et al.  DE/EDA: A new evolutionary algorithm for global optimization , 2005, Inf. Sci..

[40]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[41]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[42]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[43]  Sanyou Zeng,et al.  An Orthogonal Multi-objective Evolutionary Algorithm for Multi-objective Optimization Problems with Constraints , 2004, Evolutionary Computation.

[44]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[45]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[46]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[47]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[48]  Jason Teo,et al.  Exploring dynamic self-adaptive populations in differential evolution , 2006, Soft Comput..

[49]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[50]  Feng-Sheng Wang,et al.  Hybrid Differential Evolution for Problems of Kinetic Parameter Estimation and Dynamic Optimization of an Ethanol Fermentation Process , 2001 .

[51]  Arnold J. Stromberg,et al.  Number-theoretic Methods in Statistics , 1996 .

[52]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[53]  Yuren Zhou,et al.  An orthogonal design based constrained evolutionary optimization algorithm , 2007 .

[54]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.