Robust Super-Level Set Estimation using Gaussian Processes

This paper focuses on the problem of determining as large a region as possible where a function exceeds a given threshold with high probability. We assume that we only have access to a noise-corrupted version of the function and that function evaluations are costly. To select the next query point, we propose maximizing the expected volume of the domain identified as above the threshold as predicted by a Gaussian process, robustified by a variance term. We also give asymptotic guarantees on the exploration effect of the algorithm, regardless of the prior misspecification. We show by various numerical examples that our approach also outperforms existing techniques in the literature in practice.

[1]  Jingxian Wu,et al.  Level set estimation with dynamic sparse sensing , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[2]  Alkis Gotovos,et al.  Active Learning for Level Set Estimation , 2022 .

[3]  Daniel Busby,et al.  Hierarchical adaptive experimental design for Gaussian process emulators , 2009, Reliab. Eng. Syst. Saf..

[4]  Andreas Krause,et al.  Truncated Variance Reduction: A Unified Approach to Bayesian Optimization and Level-Set Estimation , 2016, NIPS.

[5]  Rebecca Willett,et al.  Level Set Estimation from Projection Measurements: Performance Guarantees and Fast Computation , 2012, SIAM J. Imaging Sci..

[6]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[7]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[8]  Larry A. Wasserman,et al.  Active Learning For Identifying Function Threshold Boundaries , 2005, NIPS.

[9]  Harold J. Kushner,et al.  A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise , 1964 .

[10]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[11]  Dirk Helbing,et al.  General Lane-Changing Model MOBIL for Car-Following Models , 2007 .

[12]  Robert D. Nowak,et al.  Minimax Optimal Level-Set Estimation , 2007, IEEE Transactions on Image Processing.

[13]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[14]  Jarvis D. Haupt,et al.  Level set estimation from compressive measurements using box constrained total variation regularization , 2012, 2012 19th IEEE International Conference on Image Processing.

[15]  Roman Garnett,et al.  Active Area Search via Bayesian Quadrature , 2014, AISTATS.

[16]  Roman Garnett,et al.  Active Pointillistic Pattern Search , 2015, AISTATS.

[17]  Helbing,et al.  Congested traffic states in empirical observations and microscopic simulations , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[18]  Matthew W. Hoffman,et al.  An Entropy Search Portfolio for Bayesian Optimization , 2014, ArXiv.

[19]  Ling Li,et al.  Sequential design of computer experiments for the estimation of a probability of failure , 2010, Statistics and Computing.

[20]  Jorge Vicent,et al.  Automatic emulator and optimized look-up table generation for radiative transfer models , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[21]  Victor Picheny,et al.  Fast Parallel Kriging-Based Stepwise Uncertainty Reduction With Application to the Identification of an Excursion Set , 2014, Technometrics.