Evaluation of Two-Stage Ensemble Evolutionary Algorithm for Numerical Optimization

In many challenging numerical optimization problems, the conflict between exploitation and exploration abilities of EAs must be balanced in an effective and efficient way. In the previous research, in order to address this issue, the Two-Stage ensemble Evolutionary Algorithm(TSEA)was originally proposed for engineering application. In TSEA, the optimization is divided into two relatively separate stages, which aims at handling the exploitation and exploration in a more reasonable way. In this paper, we try to extend the application area of TSEA from specific engineering problems to general numerical optimization problems by altering its sub-optimizers. The experimental studies presented in this paper contain three aspects: (1) The benefits of the TSEA framework are experimentally investigated by comparing TSEA with its sub-optimizers on 26 test functions; then (2) TSEA is compared with diverse state-of-the-art evolutionary algorithms (EAs) to comprehensively show its advantages; (3) To benchmark the performance of TSEA further, we compare it with 4 classical memetic algorithms (MAs) on CEC05 test functions. The experimental results definitely demonstrate the excellent effectiveness, efficiency and reliability of TSEA.

[1]  Bin Li,et al.  Two-stage based ensemble optimization for large-scale global optimization , 2010, IEEE Congress on Evolutionary Computation.

[2]  Anne Auger,et al.  Performance evaluation of an advanced local search evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[3]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[4]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[5]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[6]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[7]  Bin Li,et al.  A Self-adaptive Mixed Distribution Based Uni-variate Estimation of Distribution Algorithm for Large Scale Global Optimization , 2009, Nature-Inspired Algorithms for Optimisation.

[8]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[9]  Pedro Larrañaga,et al.  GA-EDA: hybrid evolutionary algorithm using genetic and estimation of distribution algorithms , 2004 .

[10]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[11]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[12]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[13]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[14]  Bin Li,et al.  Estimation of distribution and differential evolution cooperation for large scale economic load dispatch optimization of power systems , 2010, Inf. Sci..

[15]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[16]  Moonis Ali,et al.  Innovations in Applied Artificial Intelligence , 2005 .

[17]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[18]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[19]  Yew-Soon Ong,et al.  A Probabilistic Memetic Framework , 2009, IEEE Transactions on Evolutionary Computation.

[20]  M. J. D. Powell,et al.  A Method for Minimizing a Sum of Squares of Non-Linear Functions Without Calculating Derivatives , 1965, Comput. J..

[21]  Bruce A. Robinson,et al.  Self-Adaptive Multimethod Search for Global Optimization in Real-Parameter Spaces , 2009, IEEE Transactions on Evolutionary Computation.

[22]  Bin Li,et al.  Fixed-point digital IIR filter design using multi-objective optimization evolutionary algorithm , 2010, 2010 IEEE Youth Conference on Information, Computing and Telecommunications.

[23]  Qingfu Zhang,et al.  DE/EDA: A new evolutionary algorithm for global optimization , 2005, Inf. Sci..

[24]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[25]  Yew-Soon Ong,et al.  Memetic Computation—Past, Present & Future [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[26]  Francisco Herrera,et al.  Adaptive local search parameters for real-coded memetic algorithms , 2005, 2005 IEEE Congress on Evolutionary Computation.

[27]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.