Feature Extraction for Recommendation of Constrained Multiobjective Evolutionary Algorithms

The evolutionary algorithm recommendation is catching increasing attention when solving practical application problems since different algorithms often perform differently on different problems. To achieve the algorithm recommendation, extracting effective features to accurately characterize the problems is necessary, which is related to the feature extraction problem. So far, most feature extraction methods focus on single-objective optimization problems, and only a few studies are conducted on multiobjective optimization problems and constrained optimization problems, let alone constrained multiobjective optimization problems (CMOPs) that are widely encountered in the real world. To fill the gap, this article proposes an evolution-based constrained multiobjective feature extraction method (ECMOFE), in which the information generated in the evolutionary process is leveraged to form the feature matrix. To be specific, we create two populations to, respectively, optimize constraints and objectives for some generations. Furthermore, two complementary evolutionary operators are used to generate offspring for each population. In the environmental selection, the successful rate of offspring individuals generated by each operator of each population is recorded to form the feature matrix. Then, a dimension reduction method is designed to compress the size of the feature matrix. By the above process, the feature vector that can reflect the global relationship between constraints and objectives and the difficulty of the CMOP is formed. Based on the formed features, several algorithm recommendation methods are built on the basis of classifiers. The results based on multiple metrics show the effectiveness of the proposed ECMOFE.

[1]  B. Qu,et al.  Dynamic Auxiliary Task-Based Evolutionary Multitasking for Constrained Multiobjective Optimization , 2023, IEEE Transactions on Evolutionary Computation.

[2]  B. Qu,et al.  A Survey on Evolutionary Constrained Multiobjective Optimization , 2023, IEEE Transactions on Evolutionary Computation.

[3]  Qingfu Zhang,et al.  Cooperative Multiobjective Evolutionary Algorithm With Propulsive Population for Constrained Multiobjective Optimization , 2022, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  B. Qu,et al.  Utilizing the Relationship Between Unconstrained and Constrained Pareto Fronts for Constrained Multiobjective Optimization , 2022, IEEE Transactions on Cybernetics.

[5]  Jing J. Liang,et al.  An Evolutionary Multitasking Optimization Framework for Constrained Multiobjective Optimization Problems , 2022, IEEE Transactions on Evolutionary Computation.

[6]  B. Qu,et al.  Differential Evolution with Level-Based Learning Mechanism , 2022, Complex System Modeling and Simulation.

[7]  Caitong Yue,et al.  Self-adaptive resources allocation-based differential evolution for constrained evolutionary optimization , 2021, Knowl. Based Syst..

[8]  Sébastien Vérel,et al.  Landscape features and automated algorithm selection for multi-objective interpolated continuous optimisation problems , 2021, GECCO.

[9]  Zhaoshui He,et al.  Indicator-Based Evolutionary Algorithm for Solving Constrained Multiobjective Optimization Problems , 2021, IEEE Transactions on Evolutionary Computation.

[10]  Ye Tian,et al.  A multi-stage evolutionary algorithm for multi-objective optimization with complex constraints , 2021, Inf. Sci..

[11]  Xin Yao,et al.  Enhanced Constraint Handling for Reliability-Constrained Multiobjective Testing Resource Allocation , 2021, IEEE Transactions on Evolutionary Computation.

[12]  Zhongwei Ma,et al.  Shift-Based Penalty for Evolutionary Constrained Multiobjective Optimization and its Application , 2021, IEEE Transactions on Cybernetics.

[13]  Ye Tian,et al.  Feature Construction for Meta-heuristic Algorithm Recommendation of Capacitated Vehicle Routing Problems , 2021 .

[14]  K. Tang,et al.  Handling Constrained Multiobjective Optimization Problems via Bidirectional Coevolution , 2021, IEEE Transactions on Cybernetics.

[15]  Yaochu Jin,et al.  Balancing Objective Optimization and Constraint Satisfaction in Constrained Evolutionary Multiobjective Optimization , 2021, IEEE Transactions on Cybernetics.

[16]  Dipti Srinivasan,et al.  A Dual-Population-Based Evolutionary Algorithm for Constrained Multiobjective Optimization , 2021, IEEE Transactions on Evolutionary Computation.

[17]  Jing J. Liang,et al.  Dynamic Selection Preference-Assisted Constrained Multiobjective Differential Evolution , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[18]  Tao Zhang,et al.  A Coevolutionary Framework for Constrained Multiobjective Optimization Problems , 2021, IEEE Transactions on Evolutionary Computation.

[19]  Yi Xiang,et al.  Constrained Multiobjective Optimization: Test Problem Construction and Performance Evaluations , 2021, IEEE Transactions on Evolutionary Computation.

[20]  Jing J. Liang,et al.  A clustering-based differential evolution algorithm for solving multimodal multi-objective optimization problems , 2021, Swarm Evol. Comput..

[21]  Jing J. Liang,et al.  Purpose-directed two-phase multiobjective differential evolution for constrained multiobjective optimization , 2021, Swarm Evol. Comput..

[22]  Bilel Derbel,et al.  Landscape-Aware Performance Prediction for Evolutionary Multiobjective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[23]  Changhe Li,et al.  Handling Constrained Many-Objective Optimization Problems via Problem Transformation , 2020, IEEE Transactions on Cybernetics.

[24]  Giorgio Visani,et al.  Metrics for Multi-Class Classification: an Overview , 2020, ArXiv.

[25]  Xingyi Zhang,et al.  A Recommender System for Metaheuristic Algorithms for Continuous Optimization Based on Deep Recurrent Neural Networks , 2020, IEEE Transactions on Artificial Intelligence.

[26]  Jing Liu,et al.  A Unified Framework of Graph-Based Evolutionary Multitasking Hyper-Heuristic , 2020, IEEE Transactions on Evolutionary Computation.

[27]  Qingfu Zhang,et al.  A Constrained Multiobjective Evolutionary Algorithm With Detect-and-Escape Strategy , 2020, IEEE Transactions on Evolutionary Computation.

[28]  Abhishek Gupta,et al.  Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II , 2020, IEEE Transactions on Evolutionary Computation.

[29]  S. Y. Yuen,et al.  Black Box Algorithm Selection by Convolutional Neural Network , 2019, LOD.

[30]  Yong Wang,et al.  Indicator-Based Constrained Multiobjective Evolutionary Algorithms , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[31]  Yaochu Jin,et al.  Automated Selection of Evolutionary Multi-objective Optimization Algorithms , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[32]  Yong Wang,et al.  A New Fitness Function With Two Rankings for Evolutionary Constrained Multiobjective Optimization , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[33]  Honghai Wang,et al.  A multi-objective differential evolutionary algorithm for constrained multi-objective optimization problems with low feasible ratio , 2019, Appl. Soft Comput..

[34]  Xin Yao,et al.  A Scalable Indicator-Based Evolutionary Algorithm for Large-Scale Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[35]  Yong Wang,et al.  Evolutionary Constrained Multiobjective Optimization: Test Suite Construction and Performance Comparisons , 2019, IEEE Transactions on Evolutionary Computation.

[36]  Li Li,et al.  Adaptive recommendation model using meta-learning for population-based algorithms , 2019, Inf. Sci..

[37]  Ender Özcan,et al.  A Learning Automata-Based Multiobjective Hyper-Heuristic , 2019, IEEE Transactions on Evolutionary Computation.

[38]  Yong Wang,et al.  Handling Constrained Multiobjective Optimization Problems With Constraints in Both the Decision and Objective Spaces , 2019, IEEE Transactions on Evolutionary Computation.

[39]  Katherine Mary Malan,et al.  Landscape-Aware Constraint Handling Applied to Differential Evolution , 2018, TPNC.

[40]  Heike Trautmann,et al.  Automated Algorithm Selection: Survey and Perspectives , 2018, Evolutionary Computation.

[41]  Xin Yao,et al.  Population Evolvability: Dynamic Fitness Landscape Analysis for Population-Based Metaheuristic Algorithms , 2018, IEEE Transactions on Evolutionary Computation.

[42]  Aurora Trinidad Ramirez Pozo,et al.  A Meta-Learning Algorithm Selection Approach for the Quadratic Assignment Problem , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[43]  Xin Yao,et al.  Two-Archive Evolutionary Algorithm for Constrained Multiobjective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[44]  Qingfu Zhang,et al.  Push and Pull Search for Solving Constrained Multi-objective Optimization Problems , 2017, Swarm Evol. Comput..

[45]  Erik D. Goodman,et al.  An improved epsilon constraint-handling method in MOEA/D for CMOPs with large infeasible regions , 2017, Soft Computing.

[46]  Qingfu Zhang,et al.  Difficulty Adjustable and Scalable Constrained Multiobjective Test Problem Toolkit , 2016, Evolutionary Computation.

[47]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[48]  Andries Petrus Engelbrecht,et al.  Characterising constrained continuous optimisation problems , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[49]  Saman K. Halgamuge,et al.  Exploratory Landscape Analysis of Continuous Space Optimization Problems Using Information Content , 2015, IEEE Transactions on Evolutionary Computation.

[50]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[51]  Bernd Bischl,et al.  Exploratory landscape analysis , 2011, GECCO '11.

[52]  P. Suganthan,et al.  Constrained multi-objective optimization algorithm with an ensemble of constraint handling methods , 2011 .

[53]  Gary G. Yen,et al.  Constraint Handling in Multiobjective Evolutionary Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[54]  Kate Smith-Miles,et al.  Towards insightful algorithm selection for optimisation using meta-learning concepts , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[55]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[56]  Tapabrata Ray,et al.  A Swarm Metaphor for Multiobjective Design Optimization , 2002 .

[57]  K. C. Seow,et al.  MULTIOBJECTIVE DESIGN OPTIMIZATION BY AN EVOLUTIONARY ALGORITHM , 2001 .

[58]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[59]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[60]  Masahiro Tanaka,et al.  GA-based decision support system for multicriteria optimization , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[61]  A. Osyczka,et al.  A new method to solve generalized multicriteria optimization problems using the simple genetic algorithm , 1995 .

[62]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[63]  Wenyin Gong,et al.  A simple two-stage evolutionary algorithm for constrained multi-objective optimization , 2021, Knowl. Based Syst..

[64]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[65]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[66]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[67]  T. T. Binh MOBES : A multiobjective evolution strategy for constrained optimization problems , 1997 .

[68]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..