Hospital simulation model optimisation with a random ReLU expansion surrogate model

The industrial challenge of the GECCO 2021 conference is an expensive optimisation problem, where the parameters of a hospital simulation model need to be tuned to optimality. We show how a surrogate-based optimisation framework, with a random ReLU expansion as the surrogate model, outperforms other methods such as Bayesian optimisation, Hyperopt, and random search on this problem.

[1]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[2]  A. Rahimi,et al.  Uniform approximation of functions with random bases , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[3]  Thomas Bartz-Beielstein,et al.  Hospital Capacity Planning Using Discrete Event Simulation Under Special Consideration of the COVID-19 Pandemic , 2020, ArXiv.

[4]  Thomas Bartz-Beielstein,et al.  Optimization of High-dimensional Simulation Models Using Synthetic Data , 2020, ArXiv.

[5]  Thomas Kailath,et al.  Recursive least-squares adaptive filters , 1998 .

[6]  David D. Cox,et al.  Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures , 2013, ICML.

[7]  Michel Verhaegen,et al.  Online function minimization with convex random relu expansions , 2017, 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP).

[8]  Thomas Bartz-Beielstein,et al.  Resource planning for hospitals under special consideration of the COVID-19 pandemic: optimization and sensitivity analysis , 2021, GECCO Companion.

[9]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[10]  Michel Verhaegen,et al.  Online Optimization With Costly and Noisy Measurements Using Random Fourier Expansions , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Mathijs de Weerdt,et al.  Black-box mixed-variable optimisation using a surrogate model that satisfies integer constraints , 2020, GECCO Companion.