Surrogate model assisted cooperative coevolution for large scale optimization

It has been shown that cooperative coevolution (CC) can effectively deal with large scale optimization problems (LSOPs) through a ‘divide-and-conquer’ strategy. However, its performance is severely restricted by the current context-vector-based sub-solution evaluation method, since this method needs to invoke the original high dimensional simulation model when evaluating each sub-solution, thus requiring many computation resources. To alleviate this issue, this study proposes a novel surrogate model assisted cooperative coevolution (SACC) framework. SACC constructs a surrogate model for each sub-problem and employs it to evaluate corresponding sub-solutions. The original simulation model is only adopted to reevaluate a small number of promising sub-solutions selected by surrogate models, and these really evaluated sub-solutions will in turn be employed to update surrogate models. By this means, the computation cost could be greatly reduced without significantly sacrificing evaluation quality. By taking the radial basis function (RBF) and the success-history based adaptive differential evolution (SHADE) as surrogate model and optimizer, respectively, this study further designs a concrete SACC algorithm named RBF-SHADE-SACC. RBF and SHADE have only been proved to be effective on small and medium scale problems. This study scales them up to LSOPs under the SACC framework, where they are tailored to a certain extent for adapting to the characteristics of LSOPs and SACC. Empirical studies on IEEE CEC 2010 benchmark functions demonstrate that SACC can significantly enhance the sub-solution evaluation efficiency, and even with much fewer computation resources, RBF-SHADE-SACC can find much better solutions than traditional CC algorithms.

[1]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[2]  Christine A. Shoemaker,et al.  Global Convergence of Radial Basis Function Trust Region Derivative-Free Algorithms , 2011, SIAM J. Optim..

[3]  Xin Li,et al.  Adaptive multi-context cooperatively coevolving in differential evolution , 2017, Applied Intelligence.

[4]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[5]  Lin Wang,et al.  An efficient vector-growth decomposition algorithm for cooperative coevolution in solving large scale problems , 2017, GECCO.

[6]  Jürgen Branke,et al.  Faster convergence by means of fitness estimation , 2005, Soft Comput..

[7]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[8]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[9]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[10]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[11]  Francisco Herrera,et al.  Since CEC 2005 competition on real-parameter optimisation: a decade of research, progress and comparative analysis’s weakness , 2017, Soft Comput..

[12]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[13]  Jianchao Zeng,et al.  Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems , 2017, IEEE Transactions on Evolutionary Computation.

[14]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[15]  Zhou Wu,et al.  Leap on large-scale nonseparable problems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[16]  YaoXin,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016 .

[17]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[18]  Qingfu Zhang,et al.  A Gaussian Process Surrogate Model Assisted Evolutionary Algorithm for Medium Scale Expensive Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[19]  Bernhard Sendhoff,et al.  Generalizing Surrogate-Assisted Evolutionary Computation , 2010, IEEE Transactions on Evolutionary Computation.

[20]  Bernhard Sendhoff,et al.  A framework for evolutionary optimization with approximate fitness functions , 2002, IEEE Trans. Evol. Comput..

[21]  John Yearwood,et al.  Heterogeneous Cooperative Co-Evolution Memetic Differential Evolution Algorithm for Big Data Optimization Problems , 2017, IEEE Transactions on Evolutionary Computation.

[22]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[23]  Shahryar Rahnamayan,et al.  Cooperative co-evolution with sensitivity analysis-based budget assignment strategy for large-scale global optimization , 2017, Applied Intelligence.

[24]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[25]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[26]  Yaochu Jin,et al.  A dynamic optimization approach to the design of cooperative co-evolutionary algorithms , 2016, Knowl. Based Syst..

[27]  Yang Yu,et al.  A two-layer surrogate-assisted particle swarm optimization algorithm , 2014, Soft Computing.

[28]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[29]  Shahryar Rahnamayan,et al.  Metaheuristics in large-scale global continues optimization: A survey , 2015, Inf. Sci..

[30]  Jeng-Shyang Pan,et al.  Similarity-based evolution control for fitness estimation in particle swarm optimization , 2013, 2013 IEEE Symposium on Computational Intelligence in Dynamic and Uncertain Environments (CIDUE).

[31]  Carlos A. Coello Coello,et al.  Comparison of metamodeling techniques in evolutionary algorithms , 2017, Soft Comput..

[32]  Xiaodong Li,et al.  DG2: A Faster and More Accurate Differential Grouping for Large-Scale Black-Box Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[33]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[34]  John Doherty,et al.  Committee-Based Active Learning for Surrogate-Assisted Particle Swarm Optimization of Expensive Problems , 2017, IEEE Transactions on Cybernetics.

[35]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[36]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[37]  Xiaodong Li,et al.  Efficient Resource Allocation in Cooperative Co-Evolution for Large-Scale Global Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[38]  Graham J. Williams,et al.  Big Data Opportunities and Challenges: Discussions from Data Analytics Perspectives [Discussion Forum] , 2014, IEEE Computational Intelligence Magazine.