Enhanced versions of differential evolution: state-of-the-art survey

Over the past few years, differential evolution (DE) is generally considered as a reliable, accurate and robust population-based evolutionary algorithm (EA). It is capable of handling non-differentiable, non-linear, multi-modal and constrained optimisation problems. However, it suffers from slow convergence rate and takes large computational time for optimising the computationally expensive objective functions including problems dimensionality, several local and global optimums. Over the last few years, several attempts have been made to overcome these drawbacks of simple DE by employing the key features of some existing evolutionary algorithms either self-adaptively and have been formed in the forms of enhanced versions of DEs. This paper reviews those efforts and gathered state-of-the-art survey of the DEs that included some novel self-adaptive mechanisms, different ensemble techniques, efficient local search optimisers and various constrained handling techniques.

[1]  Hong Li,et al.  A discrete hybrid differential evolution algorithm for solving integer programming problems , 2014 .

[3]  Wali Khan Mashwani,et al.  A decomposition-based hybrid multiobjective evolutionary algorithm with dynamic resource allocation , 2012, Appl. Soft Comput..

[4]  Antonin Ponsich,et al.  A hybrid Differential Evolution - Tabu Search algorithm for the solution of Job-Shop Scheduling Problems , 2013, Appl. Soft Comput..

[5]  Danushka Bollegala,et al.  An adaptive differential evolution algorithm , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[6]  Hongbin Dong,et al.  A novel differential evolution using a mixed mutation strategy , 2010, ICIMCS '10.

[7]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[8]  Carlos A. Coello Coello,et al.  Modified Differential Evolution for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[10]  Roger J.-B. Wets,et al.  Minimization by Random Search Techniques , 1981, Math. Oper. Res..

[11]  Genichi Taguchi,et al.  Taguchi's Quality Engineering Handbook , 2004 .

[12]  Ponnuthurai N. Suganthan,et al.  Guest Editorial Special Issue on Differential Evolution , 2011, IEEE Transactions on Evolutionary Computation.

[13]  Ponnuthurai N. Suganthan,et al.  Modified differential evolution with local search algorithm for real world optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[14]  Kalyanmoy Deb,et al.  Improving differential evolution through a unified approach , 2013, J. Glob. Optim..

[15]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[16]  Xavier Blasco Ferragud,et al.  Hybrid DE algorithm with adaptive crossover operator for solving real-world numerical optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[17]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[18]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[19]  Wenjian Luo,et al.  A Hybrid of Differential Evolution and Genetic Algorithm for Constrained Multiobjective Optimization Problems , 2006, SEAL.

[20]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[21]  Yong Wang,et al.  A Dynamic Hybrid Framework for Constrained Evolutionary Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Carlos A. Coello Coello,et al.  DEMORS: A hybrid multi-objective optimization algorithm using differential evolution and rough set theory for constrained problems , 2010, Comput. Oper. Res..

[23]  Xiao-Wei Shi,et al.  Modified Differential Evolution Algorithm for Pattern Synthesis of Antenna Arrays , 2013 .

[24]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[25]  Ponnuthurai N. Suganthan,et al.  A Differential Covariance Matrix Adaptation Evolutionary Algorithm for real parameter optimization , 2012, Inf. Sci..

[26]  Bo Liu,et al.  Hybrid differential evolution for noisy optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[27]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[28]  Ajith Abraham,et al.  A differential evolution based Memetic Algorithm for workload optimization in power generation plants , 2011, 2011 11th International Conference on Hybrid Intelligent Systems (HIS).

[29]  H. Abbass The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[30]  Vadlamani Ravi,et al.  Differential evolution and threshold accepting hybrid algorithm for unconstrained optimisation , 2010, Int. J. Bio Inspired Comput..

[31]  Arvind S. Mohais,et al.  DynDE: a differential evolution for dynamic optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[32]  Ning Dong,et al.  Hybrid Multiobjective Differential Evolution Incorporating Preference Based Local Search , 2014, Int. J. Comput. Intell. Syst..

[33]  Ning Dong,et al.  A Hybrid Multiobjective Differential Evolution Algorithm Based on Improved e-Dominance , 2011, 2011 Seventh International Conference on Computational Intelligence and Security.

[34]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[35]  Ali R. Yildiz,et al.  Hybrid Taguchi-differential evolution algorithm for optimization of multi-pass turning operations , 2013, Appl. Soft Comput..

[37]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[38]  Chao Lung Chiang,et al.  Hybrid Differential Evolution for Power Economic Dispatch Problems Considering the Incorporated Cost Model , 2013 .

[39]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[40]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[41]  Carlos A. Coello Coello,et al.  Promising infeasibility and multiple offspring incorporated to differential evolution for constrained optimization , 2005, GECCO '05.

[42]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[43]  Minghao Yin,et al.  Hybrid Differential Evolution with Biogeography-Based Optimization for Design of a Reconfigurable Antenna Array with Discrete Phase Shifters , 2011 .

[44]  Tapabrata Ray,et al.  Performance of a hybrid EA-DE-memetic algorithm on CEC 2011 real world optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[45]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[46]  Patrick Siarry,et al.  A multi-swarm PSO using charged particles in a partitioned search space for continuous optimization , 2012, Comput. Optim. Appl..

[47]  Josiah Adeyemo,et al.  Multi-Objective Differential Evolution Algorithm for Solving Engineering Problems , 2009 .

[48]  Janez Brest,et al.  Differential Evolution with Self-adaptation and Local Search for Constrained Multiobjective Optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[49]  Qingfu Zhang,et al.  MOEA/D-DRA with two crossover operators , 2010, 2010 UK Workshop on Computational Intelligence (UKCI).

[50]  Ferrante Neri,et al.  Differential Evolution with Scale Factor Local Search for Large Scale Problems , 2010 .

[51]  Sandra M. Venske,et al.  ADEMO/D: Adaptive Differential Evolution for Multiobjective Problems , 2012, 2012 Brazilian Symposium on Neural Networks.

[52]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[53]  Xin Yao,et al.  Search biases in constrained evolutionary optimization , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[54]  Wenyin Gong,et al.  DE/BBO: a hybrid differential evolution with biogeography-based optimization for global numerical optimization , 2010, Soft Comput..

[55]  Bidyadhar Subudhi,et al.  A differential evolution based neural network approach to nonlinear system identification , 2011, Appl. Soft Comput..

[56]  Ke-jun Wang,et al.  Ranking-Based Elitist Differential Evolution for Many-Objective Optimization , 2013, 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[57]  Yong Wang,et al.  Combining Multiobjective Optimization With Differential Evolution to Solve Constrained Optimization Problems , 2012, IEEE Transactions on Evolutionary Computation.

[58]  N. Madavan Multiobjective optimization using a Pareto differential evolution approach , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[59]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[60]  Bijaya K. Panigrahi,et al.  Economic Load Dispatch Using a Chemotactic Differential Evolution Algorithm , 2009, HAIS.

[61]  Danushka Bollegala,et al.  Differential evolution with self adaptive local search , 2011, GECCO '11.

[62]  Chao Lung Chiang,et al.  Power Economic Dispatch Problems Considering Prohibited Operating Zones and Spinning Reserve: A Hybrid Differential Evolution , 2012 .

[63]  Ye Xu,et al.  A Hybrid Algorithm Based on Simplex Search and Differential Evolution for Resource-Constrained Project Scheduling Problem , 2011, ICIC.

[64]  Ville Tirronen,et al.  A Memetic Differential Evolution in Filter Design for Defect Detection in Paper Production , 2009, EvoWorkshops.

[65]  Chao-Lung Chiang,et al.  Hybrid differential evolution for cogeneration economic dispatch problem , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[66]  Jihui Zhang,et al.  A New Differential Evolution for Constrained Optimization Problems , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[67]  H. Abbass,et al.  PDE: a Pareto-frontier differential evolution approach for multi-objective optimization problems , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[68]  Ajith Abraham,et al.  A simple adaptive Differential Evolution algorithm , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[69]  Ajith Abraham,et al.  Hybrid differential evolution - Particle Swarm Optimization algorithm for solving global optimization problems , 2008, 2008 Third International Conference on Digital Information Management.

[70]  Qingfu Zhang,et al.  Enhancing the search ability of differential evolution through orthogonal crossover , 2012, Inf. Sci..

[71]  Wali Khan Mashwani A multimethod search approach based on adaptive generations level , 2011, 2011 Seventh International Conference on Natural Computation.

[72]  Paul T. Boggs,et al.  Sequential Quadratic Programming , 1995, Acta Numerica.

[73]  Ajith Abraham,et al.  Differential Evolution with Laplace mutation operator , 2009, 2009 IEEE Congress on Evolutionary Computation.

[74]  Andries Petrus Engelbrecht,et al.  Using Competitive Population Evaluation in a differential evolution algorithm for dynamic environments , 2012, Eur. J. Oper. Res..

[75]  Wali Khan Mashwani MOEA/D with DE and PSO: MOEA/D-DE+PSO , 2011, SGAI Conf..

[76]  Ankit Pat,et al.  An adaptive quantum-inspired differential evolution algorithm for 0–1 knapsack problem , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[77]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[78]  Chao Lung Chiang Hybrid Differential Evolution Based Multi-Objective Approach for Hydrothermal Power Systems , 2012 .

[79]  Peng Li,et al.  Application of chaotic theory in differential evolution algorithms , 2010, 2010 Sixth International Conference on Natural Computation.

[80]  Jia-Sheng Heh,et al.  A 2-Opt based differential evolution for global optimization , 2010, Appl. Soft Comput..

[81]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[82]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[83]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[84]  Lei Peng,et al.  A Novel Opposition-Based Multi-objective Differential Evolution Algorithm for Multi-objective Optimization , 2008, ISICA.

[85]  Efrén Mezura-Montes,et al.  A Combination of Specialized Differential Evolution Variants for Constrained Optimization , 2012, IBERAMIA.

[86]  Janez Brest,et al.  Dynamic optimization using Self-Adaptive Differential Evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[87]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[88]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[89]  Ji-Pyng Chiou,et al.  A hybrid method of differential evolution with application to optimal control problems of a bioprocess system , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[90]  Maurice Clerc,et al.  Hybridization of Differential Evolution and Particle Swarm Optimization in a New Algorithm: DEPSO-2S , 2012, ICAISC.

[91]  Y. Ao,et al.  An Adaptive Differential Evolution Algorithm to Solve Constrained Optimization Problems in Engineering Design , 2010 .

[92]  Ruhul A. Sarker,et al.  Differential evolution with a mix of Constraint Consenus methods for solving a real-world Optimization Problem , 2012, 2012 IEEE Congress on Evolutionary Computation.

[93]  Yong Wang,et al.  Constrained Evolutionary Optimization by Means of ( + )-Differential Evolution and Improved Adaptive Trade-Off Model , 2011, Evolutionary Computation.

[94]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[95]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[96]  Antonio LaTorre,et al.  Benchmarking a hybrid DE-RHC algorithm on real world problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[97]  Shiyan Hu,et al.  Hybrid trigonometric differential evolution for optimizing harmonic distribution , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[98]  Wang Fuli,et al.  Study on RBF NN based on improved differential evolution , 2009, 2009 Chinese Control and Decision Conference.

[99]  Amit Konar,et al.  An Adaptive Memetic Algorithm using a synergy of Differential Evolution and Learning Automata , 2012, 2012 IEEE Congress on Evolutionary Computation.

[100]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[101]  Wali Khan Mashwani,et al.  Comprehensive Survey of the Hybrid Evolutionary Algorithms , 2013, Int. J. Appl. Evol. Comput..

[102]  Qingfu Zhang,et al.  A Multiobjective Differential Evolution Based on Decomposition for Multiobjective Optimization with Variable Linkages , 2006, PPSN.

[103]  Hussein A. Abbass,et al.  The Pareto Differential Evolution Algorithm , 2002, Int. J. Artif. Intell. Tools.

[104]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[105]  B. Eua-Arporn,et al.  Hybrid Self-adaptive Differential Evolution Method with Augmented Lagrange Multiplier for Power Economic Dispatch of Units with Valve-Point Effects and Multiple Fuels , 2006, 2006 IEEE PES Power Systems Conference and Exposition.

[106]  P. Suganthan,et al.  Constrained multi-objective optimization algorithm with an ensemble of constraint handling methods , 2011 .

[107]  Adriana Menchaca-Mendez,et al.  A new proposal to hybridize the Nelder-Mead method to a differential evolution algorithm for constrained optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[108]  Ye Xu,et al.  An Effective Hybrid Algorithm Based on Simplex Search and Differential Evolution for Global Optimization , 2009, ICIC.

[109]  A. Kai Qin,et al.  Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[110]  Ling Wang,et al.  A hybrid Differential Evolution with double populations for constrained optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[111]  Bingyan Zhao,et al.  Hybrid Differential Evolution for Knapsack Problem , 2010, ICSI.

[112]  Yong Wang,et al.  A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[113]  Ruhul A. Sarker,et al.  Differential evolution with multi-constraint consensus methods for constrained optimization , 2013, J. Glob. Optim..

[114]  Ali R. Yildiz,et al.  A new hybrid differential evolution algorithm for the selection of optimal machining parameters in milling operations , 2013, Appl. Soft Comput..

[115]  Debashisha Jena,et al.  A combined differential evolution and neural network approach to nonlinear system identification , 2008, TENCON 2008 - 2008 IEEE Region 10 Conference.

[117]  Swagatam Das,et al.  An Informative Differential Evolution Algorithm with Self Adaptive Re-Clustering Technique for the Optimization of Phased Antenna Array , 2012 .

[118]  Ajith Abraham,et al.  A Hybrid Ant Colony Differential Evolution and its application to water resources problems , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[119]  Ville Tirronen,et al.  On memetic Differential Evolution frameworks: A study of advantages and limitations in hybridization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[120]  Muhammad Khurram Khan,et al.  An effective memetic differential evolution algorithm based on chaotic local search , 2011, Inf. Sci..

[121]  Efrén Mezura-Montes,et al.  Parameter control in Differential Evolution for constrained optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.