Incremental cooperative coevolution for large-scale global optimization

Cooperative coevolution (CC) is an efficient framework for solving large-scale global optimization (LSGO) problems. It uses a decomposition method to divide the LSGO problems into several low-dimensional subcomponents; then, subcomponents are optimized. Since CC algorithms do not consider any imbalance feature, their performance degrades during solving imbalanced LSGO problems. In this paper, we propose an incremental CC (ICC) algorithm in which the algorithm optimizes an integrated subcomponent which subcomponents are dynamically added to it. Therefore, the search space of the optimizer is grown incrementally toward the original problem search space. Various search spaces are built according to three approaches, namely random-based, sensitivity analysis-based, and random sensitivity analysis-based methods; then, ICC explores these search spaces effectively. Random-based selects a subcomponent randomly for adding it to the current search space and the sensitivity analysis-based method uses a sensitivity analysis strategy to select a subcomponent. The random sensitivity analysis-based strategy is a hybrid of the random and sensitivity analysis-based methods. Theoretical analysis is provided to demonstrate that the proposed ICC-based algorithms are effective for solving imbalanced LSGO problems. Finally, the efficiency of these algorithms is benchmarked on the complex imbalanced LSGO problems. Simulation results confirm that ICC obtains a better performance overall.

[1]  Xiaodong Li,et al.  A Comparative Study of CMA-ES on Large Scale Global Optimisation , 2010, Australasian Conference on Artificial Intelligence.

[2]  Xiaodong Li,et al.  Effective decomposition of large-scale separable continuous functions for cooperative co-evolutionary algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[3]  Mitchell A. Potter,et al.  The design and analysis of a computational model of cooperative coevolution , 1997 .

[4]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[5]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[6]  Yanchun Liang,et al.  A cooperative particle swarm optimizer with statistical variable interdependence learning , 2012, Inf. Sci..

[7]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[8]  G. G. Wang,et al.  Metamodeling for High Dimensional Simulation-Based Design Problems , 2010 .

[9]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[10]  Dirk Sudholt,et al.  When do evolutionary algorithms optimize separable functions in parallel? , 2013, FOGA XII '13.

[11]  Hongfei Teng,et al.  Cooperative Co-evolutionary Differential Evolution for Function Optimization , 2005, ICNC.

[12]  M. Giphart-Gassler,et al.  Thermo-inducible expression of cloned early genes of bacteriophage Mu. , 1979, Gene.

[13]  Xiaodong Li,et al.  Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms , 2011, GECCO '11.

[14]  Tapabrata Ray,et al.  Divide and Conquer in Coevolution: A Difficult Balancing Act , 2010 .

[15]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[16]  Francisco Herrera,et al.  A study on the use of statistical tests for experimentation with neural networks: Analysis of parametric test conditions and non-parametric tests , 2007, Expert Syst. Appl..

[17]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[18]  Francisco Herrera,et al.  MA-SW-Chains: Memetic algorithm based on local search chains for large scale continuous global optimization , 2010, IEEE Congress on Evolutionary Computation.

[19]  Shahryar Rahnamayan,et al.  Metaheuristics in large-scale global continues optimization: A survey , 2015, Inf. Sci..

[20]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[21]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[22]  Singiresu S. Rao.  Engineering Optimization : Theory and Practice , 2010 .

[23]  Ruhul A. Sarker,et al.  Dependency Identification technique for large scale optimization problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[24]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[25]  Ke Tang,et al.  Scaling Up Covariance Matrix Adaptation Evolution Strategy Using Cooperative Coevolution , 2013, IDEAL.

[26]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[27]  Yujiang Fang,et al.  Specific expression pattern of a novel Otx2 splicing variant during neural differentiation. , 2013, Gene.

[28]  David E. Goldberg,et al.  Genetic Algorithms, Tournament Selection, and the Effects of Noise , 1995, Complex Syst..

[29]  Francisco Herrera,et al.  A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability , 2009, Soft Comput..

[30]  Karsten Weicker,et al.  On the improvement of coevolutionary optimizers by learning variable interdependencies , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[31]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[32]  Tapabrata Ray,et al.  A cooperative coevolutionary algorithm with Correlation based Adaptive Variable Partitioning , 2009, 2009 IEEE Congress on Evolutionary Computation.

[33]  Jasbir S. Arora,et al.  Introduction to Optimum Design , 1988 .

[34]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[35]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[36]  Zhijian Wu,et al.  Parallel differential evolution with self-adapting control parameters and generalized opposition-based learning for solving high-dimensional optimization problems , 2013, J. Parallel Distributed Comput..

[37]  Junchi Yan,et al.  Two-stage based ensemble optimization framework for large-scale global optimization , 2013, Eur. J. Oper. Res..

[38]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[39]  Andrea Saltelli,et al.  An effective screening design for sensitivity analysis of large models , 2007, Environ. Model. Softw..

[40]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[41]  Shahryar Rahnamayan,et al.  Cooperative Co-evolution with a new decomposition method for large-scale optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[42]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[43]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[44]  Ruhul A. Sarker,et al.  Using Hybrid Dependency Identification with a Memetic Algorithm for Large Scale Optimization Problems , 2012, SEAL.

[45]  H. Rabitz,et al.  General foundations of high‐dimensional model representations , 1999 .

[46]  X. Yao,et al.  Scaling up fast evolutionary programming with cooperative coevolution , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[47]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Tutorial , 2016, ArXiv.