A local cooperative approach to solve large-scale constrained optimization problems

Abstract Cooperative Co-evolutionary algorithms are very popular to solve large-scale problems. A significant part of these algorithms is the decomposition of the problems according to the variables interaction. In this paper, an approach based on a memetic scheme, where its local stage (and not the global stage) is guided by the decomposition method (Local Cooperative Search LoCoS), is presented to solve large-scale constrained optimization problems. Two decomposition methods are tested: the improved version of the Variable Interdependence Identification for Constrained problems and Differential Grouping version 2. A recently-proposed benchmark with eighteen test problems with different features is solved to assess the performance of LoCoS when compared against a similar memetic algorithm but without decomposition and also against a state-of-the-art cooperative co-evolutionary algorithm. The results show a faster convergence, better final results and higher feasibility ratio by LoCosS with respect to the values provided by the compared algorithms.

[1]  Wang Rui,et al.  MEMETIC ALGORITHM BASED ON SELF-ADAPTIVE DIFFERENTIAL EVOLUTION AND IMPROVED SIMPLEX CROSSOVER FOR LARGE SCALE GLOBAL OPTIMIZATION , 2016 .

[2]  Roger J.-B. Wets,et al.  Minimization by Random Search Techniques , 1981, Math. Oper. Res..

[3]  Tapabrata Ray,et al.  A cooperative coevolutionary algorithm with Correlation based Adaptive Variable Partitioning , 2009, 2009 IEEE Congress on Evolutionary Computation.

[4]  Janez Brest,et al.  Large Scale Global Optimization using Differential Evolution with self-adaptation and cooperative co-evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[5]  Swagatam Das,et al.  A Fuzzy Rule-Based Penalty Function Approach for Constrained Evolutionary Optimization , 2016, IEEE Transactions on Cybernetics.

[6]  Qingfu Zhang,et al.  A Survey on Cooperative Co-Evolutionary Algorithms , 2019, IEEE Transactions on Evolutionary Computation.

[7]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[8]  Bin Li,et al.  Cooperative Coevolution with global search for large scale global optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[9]  Feliu Sagols,et al.  An evolutionary algorithm coupled with the Hooke-Jeeves algorithm for tuning a chess evaluation function , 2012, 2012 IEEE Congress on Evolutionary Computation.

[10]  Chen Peng,et al.  Comparison of differential grouping and random grouping methods on sCCPSO for large-scale constrained optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[11]  Daryl Essam,et al.  Decomposition-based evolutionary algorithm for large scale constrained problems , 2015, Inf. Sci..

[12]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[13]  Irene Moser Hooke-Jeeves revisited , 2009, 2009 IEEE Congress on Evolutionary Computation.

[14]  Chun Chen,et al.  Multiple trajectory search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[15]  Yong Wang,et al.  Utilizing the Correlation Between Constraints and Objective Function for Constrained Evolutionary Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[16]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[17]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[18]  Jinliang Ding,et al.  A preferred learning based adaptive differential evolution algorithm for large scale optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[19]  Haiyan Liu,et al.  Empirical study of effect of grouping strategies for large scale optimization , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[20]  Yuhui Shi,et al.  An effective cooperative coevolution framework integrating global and local search for large scale optimization problems , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[21]  Lin Yan,et al.  A hybrid method combining genetic algorithm and Hooke-Jeeves method for 4PLRP , 2014, 2014 IEEE/CIC International Conference on Communications in China - Workshops (CIC/ICCC).

[22]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[23]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[24]  Leslie Pérez Cáceres,et al.  The irace package: Iterated racing for automatic algorithm configuration , 2016 .

[25]  Xiaodong Li,et al.  DG2: A Faster and More Accurate Differential Grouping for Large-Scale Black-Box Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[26]  Jun Zhang,et al.  A multi-optimizer cooperative coevolution method for large scale optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[27]  Li Li,et al.  A Novel Hybrid Particle Swarm Optimization Algorithm Combined with Harmony Search for High Dimensional Optimization Problems , 2007 .

[28]  Efrén Mezura-Montes,et al.  Performance comparison of local search operators in differential evolution for constrained numerical optimization problems , 2014, 2014 IEEE Symposium on Differential Evolution (SDE).

[29]  Carlos Cotta,et al.  Memetic algorithms and memetic computing optimization: A literature review , 2012, Swarm Evol. Comput..

[30]  Antonio LaTorre,et al.  A Memetic Differential Evolution Algorithm for Continuous Optimization , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[31]  Hisao Ishibuchi,et al.  Mutation operators based on variable grouping for multi-objective large-scale optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[32]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[33]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[34]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[35]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[36]  Xiaodong Li,et al.  Tackling high dimensional nonseparable optimization problems by cooperatively coevolving particle swarms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[37]  Ruhul A. Sarker,et al.  On an evolutionary approach for constrained optimization problem solving , 2012, Appl. Soft Comput..

[38]  Ruhul A. Sarker,et al.  Decomposition of large-scale constrained problems using a genetic-based search , 2016, 2016 IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC).

[39]  Saman K. Halgamuge,et al.  Quantifying Variable Interactions in Continuous Optimization Problems , 2017, IEEE Transactions on Evolutionary Computation.

[40]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[41]  Francisco Herrera,et al.  MA-SW-Chains: Memetic algorithm based on local search chains for large scale continuous global optimization , 2010, IEEE Congress on Evolutionary Computation.

[42]  Chen Peng,et al.  Epsilon-Constrained CCPSO with Different Improvement Detection Techniques for Large-Scale Constrained Optimization , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[43]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[44]  Antonio LaTorre,et al.  Multiple Offspring Sampling in Large Scale Global Optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[45]  Efrén Mezura-Montes,et al.  Study of direct local search operators influence in memetic differential evolution for constrained numerical optimization problems , 2017, 2017 International Conference on Electronics, Communications and Computers (CONIELECOMP).

[46]  Raymond Chiong,et al.  A Hooke-Jeeves Based Memetic Algorithm for Solving Dynamic Optimisation Problems , 2009, HAIS.

[47]  Ruhul A. Sarker,et al.  Dependency Identification technique for large scale optimization problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[48]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.