CADE: A hybridization of Cultural Algorithm and Differential Evolution for numerical optimization

Abstract Many real-world problems can be formulated as optimization problems. Such problems pose a challenge for researchers in the design of efficient algorithms capable of finding the best solution with the least computational cost. In this paper, a new evolutionary algorithm is proposed that combines the explorative and exploitative capabilities of two evolutionary algorithms, Cultural Algorithm (CA) and Differential Evolution (DE) algorithm. This hybridization follows the HTH (High-level Teamwork Hybrid) nomenclature in which two meta-heuristics are executed in parallel. The new algorithm named as CADE, manages an overall population which is shared between CA and DE simultaneously. Four modified knowledge sources have been used in proposed CA which are: topographical, situational, normative and domain. The role of the used acceptance function in belief space is to select the knowledge of the best individuals to update the current knowledge. A novel quality function is used to determine the participation ratio for both CA and DE, and then a competitive selection takes place in order to select the proportion of function evaluations allocated for each technique. This collaborative synergy emerges between the DE and CA techniques and is shown to improve the quality of solutions, beyond what each of these two algorithms alone. The performance of the algorithm is evaluated on a set of 50 scalable optimization problems taken from two sources. The first set of 35 came from existing benchmark sets available in the literature. The second set came from the 2014 IEEE Single Function optimization competition. The overall results show that CADE has a favorable performance and scalability behaviors when compared to other recent state-of-the-art algorithms. CADE's overall performance ranked at number 1 for each of the two sets of problems. It is suggested that CADE's success across such a broad spectrum of problem types and complexities bodes well for its application to new and novel applications.

[1]  Mostafa Z. Ali,et al.  A novel class of niche hybrid Cultural Algorithms for continuous engineering optimization , 2014, Inf. Sci..

[2]  Robert G. Reynolds,et al.  Hybrid niche Cultural Algorithm for numerical global optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[3]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[4]  F. Glover.  HEURISTICS FOR INTEGER PROGRAMMING USING SURROGATE CONSTRAINTS , 1977 .

[5]  Robert G. Reynolds,et al.  Cultural Algorithms: Knowledge-driven engineering optimization via weaving a social fabric as an enhanced influence function , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[6]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.

[7]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[8]  Zhijian Wu,et al.  Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems , 2011, Soft Comput..

[9]  Lei Chen,et al.  An evolutionary algorithm based on Covariance Matrix Leaning and Searching Preference for solving CEC 2014 benchmark problems , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[10]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[11]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[12]  Antero Arkkio,et al.  A hybrid optimization method for wind generator design , 2012 .

[13]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[14]  Min Yao,et al.  A Novel Selection Operator of Cultural Algorithm , 2011 .

[15]  Mostafa Z. Ali,et al.  Cultural Algorithm with improved local search for optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[16]  Ville Tirronen,et al.  Shuffle or update parallel differential evolution for large-scale optimization , 2011, Soft Comput..

[17]  Fuyuan Xu,et al.  Chaotic-search-based cultural algorithm for solving unconstrained optimization problem , 2011 .

[18]  Chin-Teng Lin,et al.  A Hybrid of Cooperative Particle Swarm Optimization and Cultural Algorithm for Neural Fuzzy Networks and Its Prediction Applications , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[19]  Arthur C. Sanderson,et al.  An approximate gaussian model of Differential Evolution with spherical fitness functions , 2007, 2007 IEEE Congress on Evolutionary Computation.

[20]  Jie Chen,et al.  Optimal Contraction Theorem for Exploration–Exploitation Tradeoff in Search and Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[21]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[22]  Xin Yao,et al.  An Experimental Study of Hybridizing Cultural Algorithms and Local Search , 2008, Int. J. Neural Syst..

[23]  Robert G. Reynolds,et al.  Cultural algorithms: knowledge learning in dynamic environments , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[24]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[25]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[26]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[27]  Janez Brest,et al.  Population size reduction for the differential evolution algorithm , 2008, Applied Intelligence.

[28]  C. Coello,et al.  Cultured differential evolution for constrained optimization , 2006 .

[29]  Jian Cheng,et al.  A novel multi-population cultural algorithm adopting knowledge migration , 2011, Soft Comput..

[30]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[31]  Lingbo Zhang,et al.  A hybrid co-evolutionary cultural algorithm based on particle swarm optimization for solving global optimization problems , 2012, Neurocomputing.

[32]  Arthur C. Sanderson,et al.  Differential evolution for discrete optimization: An experimental study on Combinatorial Auction problems , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[33]  Minho Lee,et al.  Gaussian adaptation based parameter adaptation for differential evolution , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[34]  Wenyin Gong,et al.  A clustering-based differential evolution for global optimization , 2011, Appl. Soft Comput..

[35]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[36]  Jie Chen,et al.  Hybridizing Differential Evolution and Particle Swarm Optimization to Design Powerful Optimizers: A Review and Taxonomy , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[37]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[38]  Pinar Çivicioglu,et al.  Artificial cooperative search algorithm for numerical optimization problems , 2013, Inf. Sci..

[39]  El-Ghazali Talbi,et al.  A Taxonomy of Hybrid Metaheuristics , 2002, J. Heuristics.

[40]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[41]  Xin Yao,et al.  Scalability of generalized adaptive differential evolution for large-scale continuous optimization , 2010, Soft Comput..

[42]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[43]  Leandro dos Santos Coelho,et al.  An Efficient Particle Swarm Optimization Approach Based on Cultural Algorithm Applied to Mechanical Design , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[44]  Hao Zheng,et al.  A novel clustering-based differential evolution with 2 multi-parent crossovers for global optimization , 2012, Appl. Soft Comput..

[45]  M. Tremayne,et al.  Combined optimization using Cultural and Differential Evolution: application to crystal structure solution from powder diffraction data. , 2006, Chemical communications.

[46]  Sung-Bae Cho,et al.  A Hybrid Cultural Algorithm with Local Search for Traveling Salesman Problem , 2009, 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation - (CIRA).

[47]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.