A hybrid optimization algorithm based on chaotic differential evolution and estimation of distribution

Estimation of distribution algorithms (EDAs) and differential evolution (DE) are two types of evolutionary algorithms. The former has fast convergence rate and strong global search capability, but is easily trapped in local optimum. The latter has good local search capability with slower convergence speed. Therefore, a new hybrid optimization algorithm which combines the merits of both algorithms, a hybrid optimization algorithm based on chaotic differential evolution and estimation of distribution (cDE/EDA) was proposed. Due to its effective nature of harmonizing the global search of EDA with the local search of DE, the proposed algorithm can discover the optimal solution in a fast and reliable manner. Chaotic policy was used to strengthen the search ability of DE. Meantime the global convergence of algorithm was analyzed with the aid of limit theorem of monotone bounded sequence. The proposed algorithm was tested through a set of typical benchmark problems. The results demonstrate the effectiveness and efficiency of the proposed cDE/EDA algorithm.

[1]  Michèle Sebag,et al.  Extending Population-Based Incremental Learning to Continuous Search Spaces , 1998, PPSN.

[2]  Muhammad Khurram Khan,et al.  An effective memetic differential evolution algorithm based on chaotic local search , 2011, Inf. Sci..

[3]  Qingfu Zhang,et al.  DE/EDA: A new evolutionary algorithm for global optimization , 2005, Inf. Sci..

[4]  Ren-Jie He,et al.  Differential Evolution with Adaptive Mutation and Parameter Control Using Lévy Probability Distribution , 2012, Journal of Computer Science and Technology.

[5]  Shu-bin Li,et al.  Dynamic Analyses of Urban Expressway Network with Mesoscopic Traffic Flow Model Integrated Variable Speed Limits , 2014 .

[6]  Tapabrata Ray,et al.  An adaptive hybrid differential evolution algorithm for single objective optimization , 2014, Appl. Math. Comput..

[7]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[8]  Wei-Chang Yeh,et al.  A hybrid immune-estimation distribution of algorithm for mining thyroid gland data , 2010, Expert Syst. Appl..

[9]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[10]  Raymond Ros,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Experimental Setup , 2009 .

[11]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[12]  Jinung An,et al.  Estimation of particle swarm distribution algorithms: Combining the benefits of PSO and EDAs , 2012, Inf. Sci..

[13]  Yang Ping,et al.  Bacterial foraging optimization algorithm based on estimation of distribution , 2011 .

[14]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[15]  Lixin Tang,et al.  A novel hybrid Differential Evolution-Estimation of Distribution Algorithm for dynamic optimization problem , 2013, 2013 IEEE Congress on Evolutionary Computation.

[16]  Pedro Larrañaga,et al.  Combining variable neighborhood search and estimation of distribution algorithms in the protein side chain placement problem , 2007, J. Heuristics.

[17]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[18]  Bo Liu,et al.  Hybrid Ant Colony Algorithm and Its Application on Function Optimization , 2008, ISICA.

[19]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[20]  Juanjuan He,et al.  A hybrid membrane evolutionary algorithm for solving constrained optimization problems , 2014 .

[21]  David Corne,et al.  A parallel GA-EDA hybrid algorithm for history-matching , 2012 .

[22]  Ling Wang,et al.  An effective differential harmony search algorithm for the solving non-convex economic load dispatch problems , 2013 .

[23]  HE Jia-hua.  Research on Improvement of Differential Evolution Algorithm , 2016 .

[24]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[25]  Pedro Larrañaga,et al.  Optimization in Continuous Domains by Learning and Simulation of Gaussian Networks , 2000 .

[26]  K. Price.  Differential evolution vs. the functions of the 2/sup nd/ ICEO , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[27]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[28]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[29]  Yeu-Ruey Tzeng,et al.  A hybrid EDA with ACS for solving permutation flow shop scheduling , 2012 .

[30]  Chang Wook Ahn,et al.  Advances in Evolutionary Algorithms: Theory, Design and Practice , 2006, Studies in Computational Intelligence.

[31]  Gang Yang,et al.  Hybrid Gravitational Search and Clonal Selection Algorithm for Global Optimization , 2013, ICSI.

[32]  Bin Li,et al.  Variance priority based cooperative co-evolution differential evolution for large scale global optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[33]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[34]  Xiangtao Li,et al.  Parameter estimation for chaotic systems by hybrid differential evolution algorithm and artificial bee colony algorithm , 2014 .

[35]  Yongheng Jiang,et al.  Improved Hybrid Differential Evolution-Estimation of Distribution Algorithm with Feasibility Rules for NLP/MINLP Engineering Optimization Problems , 2012 .

[36]  Pedro Larrañaga,et al.  Estimation of Distribution Algorithms , 2002, Genetic Algorithms and Evolutionary Computation.

[37]  Mehdi Ehsan,et al.  System modeling and optimization for islanded micro-grid using multi-cross learning-based chaotic differential evolution algorithm , 2014 .

[38]  Jianzhong Zhou,et al.  Short term hydrothermal scheduling using multi-objective differential evolution with three chaotic sequences , 2013 .

[39]  Ahmet Bedri Özer,et al.  CIDE: Chaotically Initialized Differential Evolution , 2010, Expert Syst. Appl..

[40]  Chen Fang,et al.  A hybrid estimation of distribution algorithm for solving the resource-constrained project scheduling problem , 2012, Expert Syst. Appl..

[41]  Leandro dos Santos Coelho,et al.  A self-adaptive chaotic differential evolution algorithm using gamma distribution for unconstrained global optimization , 2014, Appl. Math. Comput..

[42]  Zhiyong Li,et al.  A hybrid algorithm based on particle swarm and chemical reaction optimization , 2014, Expert Syst. Appl..