A Hybrid Regressor and Classifier-Assisted Evolutionary Algorithm for Expensive Optimization With Incomplete Constraint Information

Surrogate-assisted evolutionary algorithms (SAEAs) have become a popular tool to solve expensive optimization problems and have been gradually used to deal with expensive constraints. To handle inequality expensive constraints, existing SAEAs need both the information of constraint violation and satisfaction to construct surrogate models for constraints. However, many problems only feedback whether the candidate solution is feasible or how much degree it violates constraints. There is no detailed information of how much degree the candidate satisfies constraints. The performance of most existing SAEAs decreases a lot in solving expensive constrained optimization problems (ECOPs) with such incomplete constraint information. To solve the problem, this article proposes a hybrid regressor and classifier-assisted evolutionary algorithm (HRCEA). HRCEA adopts a radial basis function regression model to approximate the degree of constraint violation. In order to make a more credible prediction, a logistic regression classifier (LRC) is constructed for the offspring rectification. The classifier works in cooperation with the $\alpha $ -cut strategy, in which the high confidence level can significantly improve the prediction reliability. Besides, the LRC is built based on the boundary training data selection strategy, which is devised to select samples around feasible boundaries. This strategy is helpful for the LRC to fit the local feasibility structure. Extensive experiments on commonly used benchmark functions in CEC2006 and CEC 2010 demonstrate that HRCEA has satisfactory performance in found results and execution efficiency when solving ECOPs with incomplete constraint information. Furthermore, HRCEA is utilized to solve ceramic formula design optimization problem, which shows its promising application in real-world optimization problems.

[1]  Wei-neng Chen,et al.  Distributed and Expensive Evolutionary Constrained Optimization With On-Demand Evaluation , 2023, IEEE Transactions on Evolutionary Computation.

[2]  K. Lai,et al.  PriMPSO: A Privacy-Preserving Multiagent Particle Swarm Optimization Algorithm. , 2022, IEEE transactions on cybernetics.

[3]  Jun Zhang,et al.  Edge–Cloud Co-Evolutionary Algorithms for Distributed Data-Driven Optimization Problems , 2022, IEEE Transactions on Cybernetics.

[4]  Tianyou Chai,et al.  Evolutionary Optimization of High-Dimensional Multiobjective and Many-Objective Expensive Problems Assisted by a Dropout Neural Network , 2022, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Ye Tian,et al.  A Multistage Evolutionary Algorithm for Better Diversity Preservation in Multiobjective Optimization , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Yuanchao Liu,et al.  Surrogate-Assisted Multipopulation Particle Swarm Optimizer for High-Dimensional Expensive Optimization , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  Yuanping Su,et al.  Hybrid Surrogate-Based Constrained Optimization With a New Constraint-Handling Method , 2020, IEEE Transactions on Cybernetics.

[8]  Peng Wang,et al.  Kriging-assisted teaching-learning-based optimization (KTLBO) to solve computationally expensive constrained problems , 2020, Inf. Sci..

[9]  Tianlong Gu,et al.  Ant Colony Optimization for the Control of Pollutant Spreading on Social Networks , 2020, IEEE Transactions on Cybernetics.

[10]  Jun Zhang,et al.  A Classifier-Assisted Level-Based Learning Swarm Optimizer for Expensive Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[11]  Handing Wang,et al.  A Random Forest-Assisted Evolutionary Algorithm for Data-Driven Constrained Multiobjective Combinatorial Optimization of Trauma Systems , 2020, IEEE Transactions on Cybernetics.

[12]  Witold Pedrycz,et al.  Solving Many-Objective Optimization Problems via Multistage Evolutionary Search , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Yong Wang,et al.  Composite Differential Evolution for Constrained Evolutionary Optimization , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Chen Jiang,et al.  A Novel Surrogate-assisted Differential Evolution for Expensive Optimization Problems with both Equality and Inequality Constraints , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[15]  Dan Guo,et al.  Data-Driven Evolutionary Optimization: An Overview and Case Studies , 2019, IEEE Transactions on Evolutionary Computation.

[16]  Yong Wang,et al.  Global and Local Surrogate-Assisted Differential Evolution for Expensive Constrained Optimization Problems With Inequality Constraints , 2019, IEEE Transactions on Cybernetics.

[17]  Tapabrata Ray,et al.  A Multiple Surrogate Assisted Decomposition-Based Evolutionary Algorithm for Expensive Multi/Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[18]  Jun Zhang,et al.  Distributed Virtual Network Embedding System With Historical Archives and Set-Based Particle Swarm Optimization , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[19]  Jun Zhang,et al.  Multimodal Estimation of Distribution Algorithms , 2017, IEEE Transactions on Cybernetics.

[20]  R. Miikkulainen,et al.  Surrogate-based evolutionary optimization for friction stir welding , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[21]  Thomas Bäck,et al.  Solving the G-problems in less than 500 iterations: Improved efficient constrained optimization by surrogate modeling and adaptive parameter control , 2015, ArXiv.

[22]  Florin Capitanescu,et al.  Some efficient approaches for multi-objective constrained optimization of computationally expensive black-box model problems , 2015, Comput. Chem. Eng..

[23]  Amin A. Shoukry,et al.  Constrained Dynamic Differential Evolution using a novel hybrid constraint handling technique , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[24]  Tom Dhaene,et al.  A constrained multi-objective surrogate-based optimization algorithm , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[25]  Rommel G. Regis,et al.  Evolutionary Programming for High-Dimensional Constrained Expensive Black-Box Optimization Using Radial Basis Functions , 2014, IEEE Transactions on Evolutionary Computation.

[26]  R. Regis.  Constrained optimization by radial basis function interpolation for high-dimensional expensive black-box problems with infeasible initial points , 2014 .

[27]  Francisco V. Fernández,et al.  Automated Design of Analog and High-frequency Circuits - A Computational Intelligence Approach , 2013, Studies in Computational Intelligence.

[28]  K. Rashid,et al.  An adaptive multiquadric radial basis function method for expensive black-box mixed-integer nonlinear constrained optimization , 2013 .

[29]  Yong Wang,et al.  Combining Multiobjective Optimization With Differential Evolution to Solve Constrained Optimization Problems , 2012, IEEE Transactions on Evolutionary Computation.

[30]  Li-Chen Fu,et al.  A hybrid constraint handling mechanism with differential evolution for constrained multiobjective optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[31]  Gary G. Yen,et al.  Constraint Handling in Multiobjective Evolutionary Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[32]  Andy J. Keane,et al.  Optimization using surrogate models and partially converged computational fluid dynamics simulations , 2006, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[33]  L. Ayalew,et al.  The application of GIS-based logistic regression for landslide susceptibility mapping in the Kakuda-Yahiko Mountains, Central Japan , 2005 .

[34]  Martin D. Buhmann,et al.  Radial Basis Functions: Theory and Implementations: Preface , 2003 .

[35]  Felipe Cucker,et al.  On the mathematical foundations of learning , 2001 .

[36]  Giuseppe Cultrone,et al.  Carbonate and silicate phase reactions during ceramic firing , 2001 .

[37]  Hans-Martin Gutmann,et al.  A Radial Basis Function Method for Global Optimization , 2001, J. Glob. Optim..

[38]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[39]  Paul D. Allison,et al.  Logistic regression using sas®: theory and application , 1999 .

[40]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[41]  M. Powell.  The uniform convergence of thin plate spline interpolation in two dimensions , 1994 .

[42]  M. Stein.  Large sample properties of simulations using latin hypercube sampling , 1987 .

[43]  Afonso Celso de Castro Lemonge,et al.  A surrogate assisted differential evolution to solve constrained optimization problems , 2017, 2017 IEEE Latin American Conference on Computational Intelligence (LA-CCI).

[44]  Qingfu Zhang,et al.  A surrogate-model-assisted evolutionary algorithm for computationally expensive design optimization problems with inequality constraints , 2016 .

[45]  Kristin L. Sainani,et al.  Logistic Regression , 2014, PM & R : the journal of injury, function, and rehabilitation.

[46]  Jonathan R. Folstein,et al.  Task-irrelevant perceptual expertise University of Hong Kong , Hong Kong , 2011 .

[47]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[48]  Tetsuyuki Takahama,et al.  Efficient Constrained Optimization by the ε Constrained Differential Evolution Using an Approximation Model with Low Accuracy , 2009 .

[49]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[50]  M. Golitschek,et al.  Interpolation by Polynomials and Radial Basis Functions on Spheres , 2000 .

[51]  Zongmin Wu,et al.  Local error estimates for radial basis function interpolation of scattered data , 1993 .