Decomposition for Large-scale Optimization Problems with Overlapping Components

In this paper we use a divide-and-conquer approach to tackle large-scale optimization problems with overlapping components. Decomposition for an overlapping problem is challenging as its components depend on one another. The existing decomposition methods typically assign all the linked decision variables into one group, thus cannot reduce the original problem size. To address this issue we modify the Recursive Differential Grouping (RDG) method to decompose overlapping problems, by breaking the linkage at variables shared by multiple components. To evaluate the efficacy of our method, we extend two existing overlapping benchmark problems considering various level of overlap. Experimental results show that our method can greatly improve the search ability of an optimization algorithm via divide-and-conquer, and outperforms RDG, random decomposition as well as other state-of-the-art methods. We further evaluate our method using the CEC’2013 benchmark problems and show that our method is very competitive when equipped with a component optimizer.

[1]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[2]  David E. Goldberg,et al.  Linkage Problem, Distribution Estimation, and Bayesian Networks , 2000, Evolutionary Computation.

[3]  Ruhul A. Sarker,et al.  Dependency Identification technique for large scale optimization problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[4]  Xiaodong Li,et al.  Cooperative co-evolution with online optimizer selection for large-scale optimization , 2018, GECCO.

[5]  Qingfu Zhang,et al.  A Survey on Cooperative Co-Evolutionary Algorithms , 2019, IEEE Transactions on Evolutionary Computation.

[6]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[7]  Jun Zhang,et al.  Overlapped cooperative co-evolution for large scale optimization , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[8]  Xiaodong Li,et al.  Efficient Resource Allocation in Cooperative Co-Evolution for Large-Scale Global Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[9]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[10]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[11]  Saman K. Halgamuge,et al.  A Recursive Decomposition Method for Large Scale Continuous Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[12]  Xiaodong Li,et al.  Designing benchmark problems for large-scale continuous optimization , 2015, Inf. Sci..

[13]  Wei-neng Chen,et al.  Cooperation coevolution with fast interdependency identification for large scale optimization , 2017, Inf. Sci..

[14]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[15]  David E. Goldberg,et al.  Dependency Structure Matrix, Genetic Algorithms, and Effective Recombination , 2009, Evolutionary Computation.

[16]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[17]  Yanchun Liang,et al.  A cooperative particle swarm optimizer with statistical variable interdependence learning , 2012, Inf. Sci..

[18]  Zbigniew Michalewicz,et al.  Quo Vadis, Evolutionary Computation? - On a Growing Gap between Theory and Practice , 2012, WCCI.

[19]  Z. Michalewicz,et al.  Optimising the wine supply chain , 2010 .

[20]  Xin Yang,et al.  Cooperative differential evolution with fast variable interdependence learning and cross-cluster mutation , 2015, Appl. Soft Comput..

[21]  Zbigniew Michalewicz,et al.  Evolutionary computation for multicomponent problems: opportunities and future directions , 2016, Optimization in Industry.

[22]  Xiaodong Li,et al.  Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms , 2011, GECCO '11.

[23]  Shane Strasser,et al.  Factored Evolutionary Algorithms , 2017, IEEE Transactions on Evolutionary Computation.

[24]  Xin Yao,et al.  Bandit-based cooperative coevolution for tackling contribution imbalance in large-scale optimization problems , 2019, Appl. Soft Comput..

[25]  Xiaodong Li,et al.  Effective decomposition of large-scale separable continuous functions for cooperative co-evolutionary algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[26]  Arvind Mohais,et al.  Combining vehicle routing and packing for optimal delivery schedules of water tanks , 2013, OR Insight.

[27]  Lin Wang,et al.  Boosting Cooperative Coevolution for Large Scale Optimization With a Fine-Grained Computation Resource Allocation Strategy , 2018, IEEE Transactions on Cybernetics.

[28]  Xiaodong Li,et al.  CBCC3 — A contribution-based cooperative co-evolutionary algorithm with improved exploration/exploitation balance , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[29]  Xiaodong Li,et al.  Adaptive threshold parameter estimation with recursive differential grouping for problem decomposition , 2018, GECCO.

[30]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[31]  David E. Goldberg,et al.  Linkage Identification by Non-monotonicity Detection for Overlapping Functions , 1999, Evolutionary Computation.

[32]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[33]  Yuan Sun,et al.  Extended Differential Grouping for Large Scale Global Optimization with Direct and Indirect Variable Interactions , 2015, GECCO.

[34]  Daryl Essam,et al.  Decomposition-based evolutionary algorithm for large scale constrained problems , 2015, Inf. Sci..

[35]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[36]  Saman K. Halgamuge,et al.  Quantifying Variable Interactions in Continuous Optimization Problems , 2017, IEEE Transactions on Evolutionary Computation.

[37]  David E. Goldberg,et al.  Linkage learning, overlapping building blocks, and systematic strategy for scalable recombination , 2005, GECCO '05.

[38]  Masaharu Munetomo,et al.  Linkage Identification by Nonlinearity Check for Real-Coded Genetic Algorithms , 2004, GECCO.

[39]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[40]  Michael Affenzeller,et al.  Enabling high-dimensional surrogate-assisted optimization by using sliding windows , 2017, GECCO.

[41]  Xiaodong Li,et al.  DG2: A Faster and More Accurate Differential Grouping for Large-Scale Black-Box Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[42]  Jun Zhang,et al.  Distributed Cooperative Co-Evolution With Adaptive Computing Resource Allocation for Large Scale Optimization , 2019, IEEE Transactions on Evolutionary Computation.