Large-scale cooperative co-evolution using niching-based multi-modal optimization and adaptive fast clustering

Abstract The divide-and-conquer problem-solving manner endows the cooperative co-evolutionary (CC) algorithms with a promising perspective for the large-scale global optimization (LSGO). However, by dividing a problem into several sub-components, the co-evolutionary information can be lost to some extent, which may lead to sub-optimization. Thus, information compensation is a crucial aspect of the design of efficient CC algorithms. This paper aims to scale up the information compensation for the LSGO. First, a niching-based multi-modal optimization procedure was introduced into the canonical CC framework to provide more informative collaborators for the sub-components. The information compensation was achieved with these informative collaborators, which is positive for the LSGO. Second, a simple but efficient clustering method was extended to run without manually setting the cut-off distance and identifying clusters. This clustering method, together with a simple scheme, was incorporated to prevent the combinational explosion when mixing the collaborator with a given individual to conduct the fitness evaluation. The effectiveness and superiority of the proposed algorithm were justified by a comprehensive experimental study that compared 8 state-of-the-art large-scale CC algorithms and 8 metaheuristic algorithms on two 1000-dimensional benchmark suites with 20 and 15 test functions, respectively.

[1]  Nikolaus Hansen,et al.  Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[2]  Roger J.-B. Wets,et al.  Minimization by Random Search Techniques , 1981, Math. Oper. Res..

[3]  Ian C. Parmee,et al.  Adaptive Restricted Tournament Selection for the Identification of Multiple Sub-Optima in a Multi-Modal Function , 1996, Evolutionary Computing, AISB Workshop.

[4]  KabánA.,et al.  Toward large-scale continuous eda , 2016 .

[5]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[6]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[7]  Janez Brest,et al.  Self-adaptive differential evolution algorithm with a small and varying population size , 2012, 2012 IEEE Congress on Evolutionary Computation.

[8]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[9]  Swagatam Das,et al.  An Improved Parent-Centric Mutation With Normalized Neighborhoods for Inducing Niching Behavior in Differential Evolution , 2014, IEEE Transactions on Cybernetics.

[10]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[11]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[12]  Sean Luke,et al.  Selecting informative actions improves cooperative multiagent learning , 2006, AAMAS '06.

[13]  Sean Luke,et al.  Time-dependent Collaboration Schemes for Cooperative Coevolutionary Algorithms , 2005, AAAI Fall Symposium: Coevolutionary and Coadaptive Systems.

[14]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[15]  Jonathan E. Fieldsend,et al.  Running Up Those Hills: Multi-modal search with the niching migratory multi-swarm optimiser , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[16]  Michael G. Epitropakis,et al.  Results of the 2013 IEEE CEC Competition on Niching Methods for Multimodal Optimization , 2013 .

[17]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[18]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[19]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[20]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[21]  P. John Clarkson,et al.  Erratum: A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2003, Evolutionary Computation.

[22]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[23]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[24]  Xiaodong Li,et al.  Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms , 2011, GECCO '11.

[25]  Francisco Herrera,et al.  MA-SW-Chains: Memetic algorithm based on local search chains for large scale continuous global optimization , 2010, IEEE Congress on Evolutionary Computation.

[26]  Xiaodong Li,et al.  Designing benchmark problems for large-scale continuous optimization , 2015, Inf. Sci..

[27]  Antonio LaTorre,et al.  Large scale global optimization: Experimental results with MOS-based hybrid algorithms , 2013, 2013 IEEE Congress on Evolutionary Computation.

[28]  I. Barany,et al.  Central limit theorems for Gaussian polytopes , 2006 .

[29]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[30]  Rudolf Paul Wiegand,et al.  An analysis of cooperative coevolutionary algorithms , 2004 .

[31]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[32]  Kalyanmoy Deb,et al.  Multimodal Optimization by Covariance Matrix Self-Adaptation Evolution Strategy with Repelling Subpopulations , 2017, Evolutionary Computation.

[33]  Shuliang Wang,et al.  Comment on "Clustering by fast search and find of density peaks" , 2015, ArXiv.

[34]  Yaochu Jin,et al.  A dynamic optimization approach to the design of cooperative co-evolutionary algorithms , 2016, Knowl. Based Syst..

[35]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[36]  Chun Chen,et al.  Multiple trajectory search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[37]  Antonio LaTorre,et al.  Multiple Offspring Sampling in Large Scale Global Optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[38]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[39]  Liviu Panait,et al.  Theoretical Convergence Guarantees for Cooperative Coevolutionary Algorithms , 2010, Evolutionary Computation.

[40]  Bin Li,et al.  Two-stage based ensemble optimization for large-scale global optimization , 2010, IEEE Congress on Evolutionary Computation.

[41]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[42]  Andries Petrus Engelbrecht,et al.  A novel particle swarm niching technique based on extensive vector operations , 2010, Natural Computing.

[43]  Ke Tang,et al.  Scaling Up Covariance Matrix Adaptation Evolution Strategy Using Cooperative Coevolution , 2013, IDEAL.

[44]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[45]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[46]  Kay Chen Tan,et al.  Multimodal Optimization Using a Biobjective Differential Evolution Algorithm Enhanced With Mean Distance-Based Selection , 2013, IEEE Transactions on Evolutionary Computation.

[47]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[48]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[49]  Samir W. Mahfoud.  Niching methods for genetic algorithms , 1996 .

[50]  Ata Kabán,et al.  Toward Large-Scale Continuous EDA: A Random Matrix Theory Perspective , 2013, Evolutionary Computation.

[51]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[52]  Sanyang Liu,et al.  A Cluster-Based Differential Evolution With Self-Adaptive Strategy for Multimodal Optimization , 2014, IEEE Transactions on Cybernetics.

[53]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Tutorial , 2016, ArXiv.