Multi-Space Evolutionary Search for Large-Scale Optimization

In recent years, to improve the evolutionary algorithms used to solve optimization problems involving a large number of decision variables, many attempts have been made to simplify the problem solution space of a given problem for the evolutionary search. In the literature, the existing approaches can generally be categorized as decomposition-based methods and dimension-reduction-based methods. The former decomposes a large-scale problem into several smaller subproblems, while the latter transforms the original high-dimensional solution space into a low-dimensional space. However, it is worth noting that a given large-scale optimization problem may not always be decomposable, and it is also difficult to guarantee that the global optimum of the original problem is preserved in the reduced low-dimensional problem space. This paper thus proposes a new search paradigm, namely the multi-space evolutionary search, to enhance the existing evolutionary search methods for solving large-scale optimization problems. In contrast to existing approaches that perform an evolutionary search in a single search space, the proposed paradigm is designed to conduct a search in multiple solution spaces that are derived from the given problem, each possessing a unique landscape. The proposed paradigm makes no assumptions about the large-scale optimization problem of interest, such as that the problem is decomposable or that a certain relationship exists among the decision variables. To verify the efficacy of the proposed paradigm, comprehensive empirical studies in comparison to four state-of-the-art algorithms were conducted using the CEC2013 large-scale benchmark problems.

[1]  Lei Zhou,et al.  Evolutionary Multitasking via Explicit Autoencoding , 2019, IEEE Transactions on Cybernetics.

[2]  Jing Liu,et al.  A Unified Framework of Graph-Based Evolutionary Multitasking Hyper-Heuristic , 2020, IEEE Transactions on Evolutionary Computation.

[3]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[4]  Maoguo Gong,et al.  Evolutionary Multitasking With Dynamic Resource Allocating Strategy , 2019, IEEE Transactions on Evolutionary Computation.

[5]  Jun Zhang,et al.  Evolution Consistency Based Decomposition for Cooperative Coevolution , 2018, IEEE Access.

[6]  Xin Yao,et al.  Accelerating Large-Scale Multiobjective Optimization via Problem Reformulation , 2019, IEEE Transactions on Evolutionary Computation.

[7]  Zbigniew Michalewicz,et al.  Variants of Evolutionary Algorithms for Real-World Applications , 2011, Variants of Evolutionary Algorithms for Real-World Applications.

[8]  Ying Lin,et al.  Dynamic Group Learning Distributed Particle Swarm Optimization for Large-Scale Optimization and Its Application in Cloud Workflow Scheduling , 2020, IEEE Transactions on Cybernetics.

[9]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[10]  Ha H. Nguyen,et al.  Optimal Training Sequences for Large-Scale MIMO-OFDM Systems , 2017, IEEE Transactions on Signal Processing.

[11]  Hisao Ishibuchi,et al.  A Framework for Large-Scale Multiobjective Optimization Based on Problem Transformation , 2018, IEEE Transactions on Evolutionary Computation.

[12]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[13]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[14]  Ata Kabán,et al.  Toward Large-Scale Continuous EDA: A Random Matrix Theory Perspective , 2013, Evolutionary Computation.

[15]  Xiaodong Li,et al.  DG2: A Faster and More Accurate Differential Grouping for Large-Scale Black-Box Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[16]  Maoguo Gong,et al.  Evolutionary Multitasking Sparse Reconstruction: Framework and Case Study , 2019, IEEE Transactions on Evolutionary Computation.

[17]  Xiaonan Luo,et al.  A Hierarchical Sorting Swarm Optimizer for Large-Scale Optimization , 2019, IEEE Access.

[18]  Jiancheng Lv,et al.  Automatically Designing CNN Architectures Using Genetic Algorithm for Image Classification , 2018, ArXiv.

[19]  I K Fodor,et al.  A Survey of Dimension Reduction Techniques , 2002 .

[20]  Saman K. Halgamuge,et al.  A Recursive Decomposition Method for Large Scale Continuous Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[21]  Kay Chen Tan,et al.  Multiobjective Multifactorial Optimization in Evolutionary Multitasking , 2017, IEEE Transactions on Cybernetics.

[22]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[23]  Qingfu Zhang,et al.  Fast Covariance Matrix Adaptation for Large-Scale Black-Box Optimization , 2020, IEEE Transactions on Cybernetics.

[24]  Abhishek Gupta,et al.  Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II , 2020, IEEE Transactions on Evolutionary Computation.

[25]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[26]  Yvan R. Petillot,et al.  Image processing optimization by genetic algorithm with a new coding scheme , 1995, Pattern Recognit. Lett..

[27]  Jun Zhang,et al.  A Distributed Swarm Optimizer With Adaptive Communication for Large-Scale Optimization , 2020, IEEE Transactions on Cybernetics.

[28]  Mengjie Zhang,et al.  Evolving Deep Convolutional Neural Networks for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[29]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[30]  Feng Zhao,et al.  A Cooperative Co-Evolutionary Approach to Large-Scale Multisource Water Distribution Network Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[31]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[32]  Liang Feng,et al.  Autoencoding Evolutionary Search With Learning Across Heterogeneous Problems , 2017, IEEE Transactions on Evolutionary Computation.

[33]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[34]  T. Lumley,et al.  PRINCIPAL COMPONENT ANALYSIS AND FACTOR ANALYSIS , 2004, Statistical Methods for Biomedical Research.

[35]  Y. Hou,et al.  Memetic Multi-agent Optimization in High Dimensions using Random Embeddings , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[36]  Yang Yu,et al.  Scaling Simultaneous Optimistic Optimization for High-Dimensional Non-Convex Functions with Low Effective Dimensions , 2016, AAAI.

[37]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[38]  Shahryar Rahnamayan,et al.  Metaheuristics in large-scale global continues optimization: A survey , 2015, Inf. Sci..

[39]  Zhi-Hui Zhan,et al.  Large-scale evolutionary optimization: a survey and experimental comparative study , 2020, Int. J. Mach. Learn. Cybern..

[40]  YaoXin,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016 .

[41]  Ye Tian,et al.  An Evolutionary Algorithm for Large-Scale Sparse Multiobjective Optimization Problems , 2020, IEEE Transactions on Evolutionary Computation.

[42]  Yuan Sun,et al.  Extended Differential Grouping for Large Scale Global Optimization with Direct and Indirect Variable Interactions , 2015, GECCO.

[43]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[44]  Xin Yao,et al.  A Parallel Divide-and-Conquer-Based Evolutionary Algorithm for Large-Scale Optimization , 2018, IEEE Access.

[45]  Handing Wang,et al.  Multimodal Optimization Enhanced Cooperative Coevolution for Large-Scale Optimization , 2019, IEEE Transactions on Cybernetics.

[46]  Tianyou Chai,et al.  Generalized Multitasking for Evolutionary Optimization of Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[47]  Soummya Kar,et al.  Higher Dimensional Consensus: Learning in Large-Scale Networks , 2009, IEEE Transactions on Signal Processing.