Mixed-Variable Black-Box Optimisation Using Value Proposal Trees

Many real-world optimisation problems are defined over both categorical and continuous variables, yet efficient optimisation methods such as Bayesian Optimisation (BO) are ill-equipped to handle such mixed-variable search spaces. The optimisation breadth introduced by categorical variables in the mixed-input setting has seen recent approaches operating on local trust regions, but these methods can be greedy in suboptimal regions of the search space. In this paper, we adopt a holistic view and aim to consolidate optimisation of the categorical and continuous sub-spaces under a single acquisition metric. We develop a tree-based method which retains a global view of the optimisation spaces by identifying regions in the search space with high potential candidates which we call value proposals. Our method uses these proposals to make selections on both the categorical and continuous components of the input. We show that this approach significantly outperforms existing mixed-variable optimisation approaches across several mixed-variable black-box optimisation tasks.

[1]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[2]  P. Sanders,et al.  Utilization of Bayesian Optimization and KWN Modeling for Increased Efficiency of Al-Sc Precipitation Strengthening , 2022, Metals.

[3]  I. Chades,et al.  Bayesian Optimisation for Mixed-Variable Inputs using Value Proposals , 2022, ArXiv.

[4]  F. Hutter,et al.  Automated Reinforcement Learning (AutoRL): A Survey and Open Problems , 2022, J. Artif. Intell. Res..

[5]  Stephen Roberts,et al.  Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRL , 2021, NeurIPS.

[6]  Michael A. Osborne,et al.  Think Global and Act Local: Bayesian Optimisation over High-Dimensional Categorical and Mixed Search Spaces , 2021, ICML.

[7]  Ryan P. Adams,et al.  Bayesian reaction optimization as a tool for chemical synthesis , 2021, Nature.

[8]  Tom Drummond,et al.  Improved Training of Generative Adversarial Networks Using Decision Forests , 2021, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[9]  A. Shpilman,et al.  Solving Black-Box Optimization Challenge via Learning Search Space Partition for Local Bayesian Optimization , 2020, NeurIPS.

[10]  H. Ammar,et al.  HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisation , 2020, 2012.03826.

[11]  Yan Zuo,et al.  Residual Likelihood Forests , 2020, BMVC.

[12]  Frank D. Wood,et al.  Gaussian Process Bandit Optimization of theThermodynamic Variational Objective , 2020, NeurIPS.

[13]  Santu Rana,et al.  Bayesian Optimization for Categorical and Category-Specific Continuous Inputs , 2019, AAAI.

[14]  Matthias Poloczek,et al.  Scalable Global Optimization via Local Bayesian Optimization , 2019, NeurIPS.

[15]  Michael A. Osborne,et al.  Bayesian Optimisation over Multiple Continuous and Categorical Inputs , 2019, ICML.

[16]  Michael A. Osborne,et al.  Knowing The What But Not The Where in Bayesian Optimization , 2019, ICML.

[17]  Ian Gibson,et al.  Accelerating Experimental Design by Incorporating Experimenter Hunches , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[18]  Tom Drummond,et al.  Generative Adversarial Forests for Better Conditioned Adversarial Learning , 2018, ArXiv.

[19]  Richard N. Zare,et al.  Optimizing Chemical Reactions with Deep Reinforcement Learning , 2017, ACS central science.

[20]  Tom Drummond,et al.  Fast Residual Forests: Rapid Ensemble Learning for Semantic Segmentation , 2017, CoRL.

[21]  José Miguel Hernández-Lobato,et al.  Constrained Bayesian Optimization for Automatic Chemical Design , 2017, 1709.05501.

[22]  D. Sculley,et al.  Google Vizier: A Service for Black-Box Optimization , 2017, KDD.

[23]  Eduardo C. Garrido-Merchán,et al.  Dealing with Categorical and Integer-valued Variables in Bayesian Optimization with Gaussian Processes , 2017, Neurocomputing.

[24]  Neil D. Lawrence,et al.  Batch Bayesian Optimization via Local Penalization , 2015, AISTATS.

[25]  Matt J. Kusner,et al.  Bayesian Optimization with Inequality Constraints , 2014, ICML.

[26]  Sean Gerrish,et al.  Black Box Variational Inference , 2013, AISTATS.

[27]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[28]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[29]  Lihong Li,et al.  An Empirical Evaluation of Thompson Sampling , 2011, NIPS.

[30]  Adam D. Bull,et al.  Convergence Rates of Efficient Global Optimization Algorithms , 2011, J. Mach. Learn. Res..

[31]  Kevin Leyton-Brown,et al.  Sequential Model-Based Optimization for General Algorithm Configuration , 2011, LION.

[32]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[33]  Thomas Bartz-Beielstein,et al.  Tuning search algorithms for real-world applications: a regression tree based approach , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[34]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[35]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[36]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[37]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[38]  Richard M. Dudley,et al.  Sample Functions of the Gaussian Process , 1973 .

[39]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[40]  Think Global and Act Local: Bayesian Optimisation over High-Dimensional Categorical and Mixed Search Spaces , 2021 .

[41]  Berna Bakir Batu,et al.  Automated Machine Learning: Methods, Systems, Challenges , 2019, The Springer Series on Challenges in Machine Learning.

[42]  Svetha Venkatesh,et al.  Algorithmic Assurance: An Active Approach to Algorithmic Testing using Bayesian Optimisation , 2018, NeurIPS.

[43]  Cheng Li,et al.  High Dimensional Bayesian Optimization with Elastic Gaussian Process , 2017, ICML.

[44]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[45]  Tanja Hueber,et al.  Gaussian Processes For Machine Learning , 2016 .

[46]  Guido Sanguinetti,et al.  Advances in Neural Information Processing Systems 24 , 2011 .

[47]  L. Breiman.  Random Forests , 2001, Machine Learning.

[48]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..