Value-at-Risk Optimization with Gaussian Processes

Value-at-risk (VAR) is an established measure to assess risks in critical real-world applications with random environmental factors. This paper presents a novel VAR upper confidence bound (V-UCB) algorithm for maximizing the VAR of a black-box objective function with the first noregret guarantee. To realize this, we first derive a confidence bound of VAR and then prove the existence of values of the environmental random variable (to be selected to achieve no regret) such that the confidence bound of VAR lies within that of the objective function evaluated at such values. Our V-UCB algorithm empirically demonstrates state-of-the-art performance in optimizing synthetic benchmark functions, a portfolio optimization problem, and a simulated robot task.

[1]  Bryan Kian Hsiang Low,et al.  Information-Based Multi-Fidelity Bayesian Optimization , 2017 .

[2]  Kian Hsiang Low,et al.  Bayesian Optimization with Binary Auxiliary Information , 2019, UAI.

[3]  Volkan Cevher,et al.  Adversarially Robust Optimization with Gaussian Processes , 2018, NeurIPS.

[4]  Peter I. Frazier,et al.  Bayesian Optimization with Expensive Integrands , 2018, SIAM J. Optim..

[5]  Warren B. Powell,et al.  The Correlated Knowledge Gradient for Simulation Optimization of Continuous Parameters using Gaussian Process Regression , 2011, SIAM J. Optim..

[6]  R. Koenker,et al.  Regression Quantiles , 2007 .

[7]  Thomas J. Santner,et al.  Sequential design of computer experiments to minimize integrated response functions , 2000 .

[8]  Melvyn Sim,et al.  Portfolio Value-at-Risk Optimization for Asymmetrically Distributed Asset Returns , 2012, Eur. J. Oper. Res..

[9]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[10]  Léonard Torossian,et al.  Bayesian Quantile and Expectile Optimisation , 2020, ArXiv.

[11]  Ichiro Takeuchi,et al.  Mean-Variance Analysis in Bayesian Optimization under Uncertainty , 2020, AISTATS.

[12]  Kian Hsiang Low,et al.  Distributed Batch Gaussian Process Optimization , 2017, ICML.

[13]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[14]  Patrick Jaillet,et al.  Top-k Ranking Bayesian Optimization , 2020, AAAI.

[15]  Kian Hsiang Low,et al.  Private Outsourced Bayesian Optimization , 2020, ICML.

[16]  Johannes Kirschner,et al.  Distributionally Robust Bayesian Optimization , 2020, AISTATS.

[17]  Enlu Zhou,et al.  Bayesian Optimization of Risk Measures , 2020, NeurIPS.

[18]  Zi Wang,et al.  Max-value Entropy Search for Efficient Bayesian Optimization , 2017, ICML.

[19]  Andreas Krause,et al.  Truncated Variance Reduction: A Unified Approach to Bayesian Optimization and Level-Set Estimation , 2016, NIPS.

[20]  Santu Rana,et al.  Distributionally Robust Bayesian Quadrature Optimization , 2020, AISTATS.

[21]  Kian Hsiang Low,et al.  Decentralized High-Dimensional Bayesian Optimization with Factor Graphs , 2017, AAAI.