This paper presents a surrogate-based approach that uses a relatively simple population-based optimisation algorithm, a basic Differential Evolution algorithm (DE), and experiments with two complementary approaches to construct a surrogate. This surrogate-based optimisation uses a predictive model in-line and decides whether to calculate a candidate individual (using the simulation model) or discard it as part of the optimisation process. The complementary approaches for the design of the surrogate are (1) a traditional regression-based surrogate that approximates the surface of the fitness landscape using a supervised continuous machine learning algorithm (XGBoost), and (2) a pairwise approach that models the surrogate as a binary classification problem for a machine learning algorithm (in this experiment we proposed a Decision Tree binary classifier). Although there is no statistical difference in the performance of both surrogate approaches, the surface/regression one obtains a slightly better performance when the execution is limited to 200 fitness evaluations. In contrast, the pairwise/classification approach obtains the lowest value and a lower mean in executions with 750 fitness evaluations.
[1]
Wei-Yin Loh,et al.
Classification and regression trees
,
2011,
WIREs Data Mining Knowl. Discov..
[2]
Zhong-Hua Han,et al.
Surrogate-Based Optimization
,
2012,
Engineering Design Optimization.
[3]
Thomas Bartz-Beielstein,et al.
Hospital Capacity Planning Using Discrete Event Simulation Under Special Consideration of the COVID-19 Pandemic
,
2020,
ArXiv.
[4]
Thomas Bartz-Beielstein,et al.
Resource planning for hospitals under special consideration of the COVID-19 pandemic: optimization and sensitivity analysis
,
2021,
GECCO Companion.
[5]
Thomas Bartz-Beielstein,et al.
Comparison of parallel surrogate-assisted optimization approaches
,
2018,
GECCO.
[6]
J. Friedman.
Greedy function approximation: A gradient boosting machine.
,
2001
.
[7]
B. Ripley.
Classification and Regression Trees
,
2015
.
[8]
Kalyanmoy Deb,et al.
Optimization for Engineering Design: Algorithms and Examples
,
2004
.