Dynamic Cooperative Coevolution for Large Scale Optimization

The cooperative coevolution (CC) framework achieves a promising performance in solving large scale global optimization problems. The framework encounters difficulties on nonseparable problems, where variables interact with each other. Using the static grouping methods, variables will be theoretically grouped into one big subcomponent, whereas the random grouping strategy endures low efficiency. In this paper, a dynamic CC framework is proposed to tackle the challenge. The proposed framework works in a computationally efficient manner, in which the computational resources are allocated to a series of elitist subcomponents consisting of superior variables. First, a novel estimation method is proposed to evaluate the contribution of variables using the historical information of the best overall fitness. Based on the contribution and the interaction information, a dynamic grouping strategy is conducted to construct the dynamic subcomponent that evolves in the next evolutionary period. The constructed subcomponents are different from each other, and therefore the required parameters to control the optimization of each subcomponent vary a lot in each evolutionary period. A stage-by-stage parameter adaptation strategy is proposed to adapt the optimizer to the dynamic optimization environment. Experimental results indicate that the proposed framework achieves competitive results compared with the state-of-the-art CC frameworks.

[1]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[2]  Dirk Helbing,et al.  Saving Human Lives: What Complexity Science and Information Systems can Contribute , 2014, Journal of statistical physics.

[3]  Xiaodong Li,et al.  CBCC3 — A contribution-based cooperative co-evolutionary algorithm with improved exploration/exploitation balance , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[4]  Xiaodong Li,et al.  DG2: A Faster and More Accurate Differential Grouping for Large-Scale Black-Box Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[5]  Robert G. Reynolds,et al.  An Adaptive Multipopulation Differential Evolution With Dynamic Population Reduction , 2017, IEEE Transactions on Cybernetics.

[6]  C. T. Kelley,et al.  A Locally-Biased form of the DIRECT Algorithm , 2001, J. Glob. Optim..

[7]  Hsiao-Dong Chiang,et al.  A Novel Consensus-Based Particle Swarm Optimization-Assisted Trust-Tech Methodology for Large-Scale Global Optimization , 2017, IEEE Transactions on Cybernetics.

[8]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[9]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[10]  Dawei Zhao,et al.  Statistical physics of vaccination , 2016, ArXiv.

[11]  M. Perc,et al.  Resolution of the Stochastic Strategy Spatial Prisoner's Dilemma by Means of Particle Swarm Optimization , 2011, PloS one.

[12]  Iztok Fister,et al.  Toward the Discovery of Citation Cartels in Citation Networks , 2016, Front. Phys..

[13]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[14]  Manuel Mucientes,et al.  Hybrid Optimization Algorithm for Large-Scale QoS-Aware Service Composition , 2015, IEEE Transactions on Services Computing.

[15]  Zhi-hui Zhan,et al.  Kuhn–Munkres Parallel Genetic Algorithm for the Set Cover Problem and Its Application to Large-Scale Wireless Sensor Networks , 2016, IEEE Transactions on Evolutionary Computation.

[16]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[17]  Jun Zhang,et al.  Overlapped cooperative co-evolution for large scale optimization , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[18]  Xiaodong Li,et al.  Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms , 2011, GECCO '11.

[19]  Iztok Fister,et al.  Artificial neural network regression as a local search heuristic for ensemble strategies in differential evolution , 2015, Nonlinear Dynamics.

[20]  Jun Zhang,et al.  Genetic Learning Particle Swarm Optimization , 2016, IEEE Transactions on Cybernetics.

[21]  Ahmed A. Kishk,et al.  Use of Group Delay of Sub-Circuits in Optimization of Wideband Large-Scale Bandpass Filters and Diplexers , 2017, IEEE Transactions on Microwave Theory and Techniques.

[22]  Xiaodong Li,et al.  Effects of population initialization on differential evolution for large scale optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[23]  Abdullah Al Mamun,et al.  Evolutionary big optimization (BigOpt) of signals , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[24]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[25]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[26]  YaoXin,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008 .

[27]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[28]  Shane Strasser,et al.  Factored Evolutionary Algorithms , 2017, IEEE Transactions on Evolutionary Computation.

[29]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[30]  Jun Zhang,et al.  Segment-Based Predominant Learning Swarm Optimizer for Large-Scale Optimization , 2017, IEEE Transactions on Cybernetics.

[31]  Jun Wang,et al.  Cooperative Coevolution for Large-Scale Optimization Based on Kernel Fuzzy Clustering and Variable Trust Region Methods , 2014, IEEE Transactions on Fuzzy Systems.

[32]  Attila Szolnoki,et al.  Statistical Physics of Human Cooperation , 2017, ArXiv.

[33]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[34]  Vladimiro Miranda,et al.  Optimizing Large Scale Problems With Metaheuristics in a Reduced Space Mapped by Autoencoders—Application to the Wind-Hydro Coordination , 2014, IEEE Transactions on Power Systems.

[35]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[36]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[37]  Xin Yao,et al.  Meta-Heuristic Algorithms in Car Engine Design: A Literature Survey , 2015, IEEE Transactions on Evolutionary Computation.

[38]  Ananth Ranganathan,et al.  The Levenberg-Marquardt Algorithm , 2004 .

[39]  Yuan Sun,et al.  Extended Differential Grouping for Large Scale Global Optimization with Direct and Indirect Variable Interactions , 2015, GECCO.

[40]  Dongbin Zhao,et al.  Computational Intelligence in Urban Traffic Signal Control: A Survey , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[41]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[42]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[43]  Jian Yin,et al.  A Divide-and-Conquer Method for Scalable Robust Multitask Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Xiaodong Li,et al.  Efficient Resource Allocation in Cooperative Co-Evolution for Large-Scale Global Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[45]  C. L. Philip Chen,et al.  Cooperative Hierarchical PSO With Two Stage Variable Interaction Reconstruction for Large Scale Optimization , 2017, IEEE Transactions on Cybernetics.

[46]  Dengfeng Sun,et al.  A Parallel Computing Framework for Large-Scale Air Traffic Flow Optimization , 2012, IEEE Transactions on Intelligent Transportation Systems.

[47]  Attila Szolnoki,et al.  Coevolutionary Games - A Mini Review , 2009, Biosyst..