Improved Constructive Cooperative Coevolutionary Differential Evolution for Large-Scale Optimisation

The Differential Evolution (DE) algorithm is widely used for real-world global optimisation problems in many different domains. To improve DE's performance on large-scale optimisation problems, it has been combined with the Cooperative Coevolution (CCDE) algorithm. CCDE adopts a divide-and-conquer strategy to optimise smaller subcomponents separately instead of tackling the large-scale problem at once. DE then evolves a separate subpopulation for each subcomponent but there is cooperation between the subpopulations to co-adapt the individuals of the subpopulations with each other. The Constructive Cooperative Coevolution (C3DE) algorithm, previously proposed by the authors, is an extended version of CCDE that has a better performance on large-scale problems, interestingly also on non-separable problems. This paper proposes a new version, called the Improved Constructive Cooperative Coevolutionary Differential Evolution (C3iDE), which removes several limitations with the previous version. A novel element of C3iDE is the advanced initialisation of the subpopulations. C3iDE initially optimises the subpopulations in a partially co-adaptive fashion. During the initial optimisation of a subpopulation, only a subset of the other subcomponents is considered for the co-adaptation. This subset increases stepwise until all subcomponents are considered. The experimental evaluation of C3iDE on 36 high-dimensional benchmark functions (up to 1000 dimensions) shows an improved solution quality on large-scale global optimisation problems compared to CCDE and DE. The greediness of the co-adaptation with C3iDE is also investigated in this paper.

[1]  Andries Petrus Engelbrecht,et al.  Differential evolution in high-dimensional search spaces , 2007, 2007 IEEE Congress on Evolutionary Computation.

[2]  Tapabrata Ray,et al.  A cooperative coevolutionary algorithm with Correlation based Adaptive Variable Partitioning , 2009, 2009 IEEE Congress on Evolutionary Computation.

[3]  Janez Brest,et al.  Self-adaptive differential evolution algorithm with a small and varying population size , 2012, 2012 IEEE Congress on Evolutionary Computation.

[4]  R. Paul Wiegand,et al.  An empirical analysis of collaboration methods in cooperative coevolutionary algorithms , 2001 .

[5]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[6]  Janez Brest,et al.  Large Scale Global Optimization using Differential Evolution with self-adaptation and cooperative co-evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[7]  Xin Yao,et al.  An adaptive coevolutionary Differential Evolution algorithm for large-scale optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[8]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[9]  Xin-She Yang,et al.  A literature survey of benchmark functions for global optimisation problems , 2013, Int. J. Math. Model. Numer. Optimisation.

[10]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[11]  Emile Glorieux,et al.  Constructive cooperative coevolution for optimising interacting production stations , 2015 .

[12]  Ilpo Poikolainen,et al.  Cluster-Based Population Initialization for differential evolution frameworks , 2015, Inf. Sci..

[13]  Bengt Lennartson,et al.  A Constructive Cooperative Coevolutionary Algorithm Applied to Press Line Optimisation , 2014 .

[14]  Bengt Lennartson,et al.  Optimisation of interacting production stations using a Constructive Cooperative Coevolutionary approach , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[15]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[16]  Edwin D. de Jong,et al.  Coevolutionary Principles , 2012, Handbook of Natural Computing.

[17]  Janez Brest,et al.  Some Improvements of the Self-Adaptive jDE Algorithm , 2014, 2014 IEEE Symposium on Differential Evolution (SDE).

[18]  Jason Teo,et al.  Self-adaptive population sizing for a tune-free differential evolution , 2009, Soft Comput..

[19]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[20]  Bin Li,et al.  Variance priority based cooperative co-evolution differential evolution for large scale global optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[21]  Xiaodong Li,et al.  Designing benchmark problems for large-scale continuous optimization , 2015, Inf. Sci..

[22]  Bengt Lennartson,et al.  Constructive cooperative coevolutionary optimisation for interacting production stations , 2015 .

[23]  Giuseppe A. Trunfio,et al.  Adaptation in Cooperative Coevolutionary Optimization , 2015 .

[24]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[25]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[26]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[27]  Ville Tirronen,et al.  Two algorithmic enhancements for the parallel differential evolution , 2011 .

[28]  Xiaodong Li,et al.  Effective decomposition of large-scale separable continuous functions for cooperative co-evolutionary algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).