Continuous Parameter Pools in Ensemble Differential Evolution

Ensemble of parameters and mutation strategies differential evolution (EPSDE) is an elegant promising optimization framework based on the idea that a pool of mutation and crossover strategies along, with associated pools of parameter settings, can flexibly adapt to a large variety of problems when a simple success based rule is introduced. Modern versions of this scheme successfully attempts to improve upon the original performance at the cost of a high complexity. One of most successful implementations of this algorithmic scheme is the Self-adaptive Ensemble of Parameters and Strategies Differential Evolution (SaEPSDE). This paper operates on the SaEPSDE, reducing its complexity by identifying some algorithmic components that we experimentally show as possibly unnecessary. The result of this de-constructing operation is a novel algorithm implementation, here referred to as "j" Ensemble of Strategies Differential Evolution (jESDE). The proposed implementation is drastically simpler than SaEPSDE as several parts of it have been removed or simplified. Nonetheless, jESDE appears to display a competitive performance, on diverse problems throughout various dimensionality values, with respect to the original EPSDE algorithm, as well as to SaEPSDE and three modern algorithms based on Differential Evolution.

[1]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[2]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[3]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[4]  Amit Konar,et al.  An Improved Differential Evolution Scheme for Noisy Optimization Problems , 2005, PReMI.

[5]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[6]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[7]  Ferrante Neri,et al.  Memetic Compact Differential Evolution for Cartesian Robot Control , 2010, IEEE Computational Intelligence Magazine.

[8]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[9]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[10]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[11]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[12]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  P. N. Suganthan,et al.  Ensemble of Constraint Handling Techniques , 2010, IEEE Transactions on Evolutionary Computation.

[14]  Ville Tirronen,et al.  An Enhanced Memetic Differential Evolution in Filter Design for Defect Detection in Paper Production , 2008, Evolutionary Computation.

[15]  Giovanni Iacca,et al.  Multi-Strategy coevolving aging Particle Optimization , 2014, Int. J. Neural Syst..

[16]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[17]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[18]  Chun Chen,et al.  Multiple trajectory search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[19]  Ville Tirronen,et al.  Scale factor local search in differential evolution , 2009, Memetic Comput..

[20]  Francisco Herrera,et al.  Statistical analysis of convergence performance throughout the evolutionary search: A case study with SaDE-MMTS and Sa-EPSDE-MMTS , 2013, 2013 IEEE Symposium on Differential Evolution (SDE).

[21]  Natalio Krasnogor,et al.  Towards Robust Memetic Algorithms , 2005 .

[22]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[23]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[24]  Carlos Cotta,et al.  Memetic algorithms and memetic computing optimization: A literature review , 2012, Swarm Evol. Comput..

[25]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[26]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[27]  P. Suganthan,et al.  Differential evolution algorithm with ensemble of populations for global numerical optimization , 2009 .

[28]  Arthur C. Sanderson,et al.  Minimal representation multisensor fusion using differential evolution , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[29]  Giovanni Iacca,et al.  Disturbed Exploitation compact Differential Evolution for limited memory optimization problems , 2011, Inf. Sci..

[30]  Giovanni Iacca,et al.  Ockham's Razor in memetic computing: Three stage optimal memetic exploration , 2012, Inf. Sci..

[31]  Ponnuthurai N. Suganthan,et al.  Ensemble strategies in Compact Differential Evolution , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[32]  David Naso,et al.  Compact Differential Evolution , 2011, IEEE Transactions on Evolutionary Computation.