Data-Driven Distributionally Robust Optimization over Time

Stochastic optimization (SO) is a classical approach for optimization under uncertainty that typically requires knowledge about the probability distribution of uncertain parameters. Because the latter is often unknown, distributionally robust optimization (DRO) provides a strong alternative that determines the best guaranteed solution over a set of distributions (ambiguity set). In this work, we present an approach for DRO over time that uses online learning and scenario observations arriving as a data stream to learn more about the uncertainty. Our robust solutions adapt over time and reduce the cost of protection with shrinking ambiguity. For various kinds of ambiguity sets, the robust solutions converge to the SO solution. Our algorithm achieves the optimization and learning goals without solving the DRO problem exactly at any step. We also provide a regret bound for the quality of the online strategy that converges at a rate of [Formula: see text], where T is the number of iterations. Furthermore, we illustrate the effectiveness of our procedure by numerical experiments on mixed-integer optimization instances from popular benchmark libraries and give practical examples stemming from telecommunications and routing. Our algorithm is able to solve the DRO over time problem significantly faster than standard reformulations. Funding: This work was supported by Deutsche Forschungsgemeinschaft (DFG): Projects B06 and B10 in CRC TRR 154 and Project-ID 416229255 - SFB 1411 and Federal Ministry for Economic Affairs and Energy, Germany [Grant 03EI1036A]. Supplemental Material: The e-companion is available at https://doi.org/10.1287/ijoo.2023.0091 .

[1]  A. V. Hengel,et al.  Distributionally Robust Bayesian Optimization with φ-divergences , 2022, ArXiv.

[2]  Sebastian Pokutta,et al.  Adversaries in Online Learning Revisited: with applications in Robust Optimization and Adversarial training , 2021, ArXiv.

[3]  Timo Berthold,et al.  MIPLIB 2017: data-driven compilation of the 6th mixed-integer programming library , 2021, Mathematical Programming Computation.

[4]  Tianbao Yang,et al.  An Online Method for A Class of Distributionally Robust Optimization with Non-convex Objectives , 2020, NeurIPS.

[5]  Daniel Kuhn,et al.  From Data to Decisions: Distributionally Robust Optimization is Optimal , 2017, Manag. Sci..

[6]  John Duchi,et al.  Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach , 2016, Math. Oper. Res..

[7]  Yair Carmon,et al.  Large-Scale Methods for Distributionally Robust Optimization , 2020, NeurIPS.

[8]  Zhi-Hua Zhou,et al.  Dynamic Regret of Convex and Smooth Functions , 2020, NeurIPS.

[9]  Melvyn Sim,et al.  Robust Stochastic Optimization Made Easy with RSOME , 2020, Manag. Sci..

[10]  Maryam Kamgarpour,et al.  Mixed Strategies for Robust Optimization of Unknown Objectives , 2020, AISTATS.

[11]  A. Krause,et al.  Distributionally Robust Bayesian Optimization , 2020, AISTATS.

[12]  Sanjay Mehrotra,et al.  Distributionally Robust Optimization: A Review , 2019, ArXiv.

[13]  Andrea Lodi,et al.  QPLIB: a library of quadratic programming instances , 2018, Mathematical Programming Computation.

[14]  Sebastian Pokutta,et al.  An Online-Learning Approach to Inverse Optimization , 2018, ArXiv.

[15]  Nam Ho-Nguyen,et al.  Online First-Order Framework for Robust Convex Optimization , 2016, Oper. Res..

[16]  Daniel Kuhn,et al.  Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations , 2015, Mathematical Programming.

[17]  Vishal Gupta,et al.  Data-driven robust optimization , 2013, Math. Program..

[18]  Sebastian Pokutta,et al.  Emulating the Expert: Inverse Optimization through Online Learning , 2017, ICML.

[19]  Robert S. Chen,et al.  Robust Optimization for Non-Convex Objectives , 2017, NIPS.

[20]  Benjamin Müller,et al.  The SCIP Optimization Suite 5.0 , 2017, 2112.08872.

[21]  Alexander Martin,et al.  Robust runway scheduling under uncertain conditions , 2016 .

[22]  Norbert Fürstenau,et al.  Pre-tactical optimization of runway utilization under uncertainty , 2016 .

[23]  Elad Hazan,et al.  Introduction to Online Convex Optimization , 2016, Found. Trends Optim..

[24]  Michael Jünger,et al.  Single-commodity robust network design with finite and Hose demand sets , 2016, Math. Program..

[25]  Aryan Mokhtari,et al.  Optimization in Dynamic Environments : Improved Regret Rates for Strongly Convex Problems , 2016 .

[26]  John C. Duchi,et al.  Stochastic Gradient Methods for Distributionally Robust Optimization with f-divergences , 2016, NIPS.

[27]  Güzin Bayraksan,et al.  Data-Driven Stochastic Programming Using Phi-Divergences , 2015 .

[28]  Daniel Kuhn,et al.  A distributionally robust perspective on uncertainty quantification and chance constrained programming , 2015, Mathematical Programming.

[29]  Shie Mannor,et al.  Oracle-Based Robust Optimization via Online Learning , 2014, Oper. Res..

[30]  Omar Besbes,et al.  Non-Stationary Stochastic Optimization , 2013, Oper. Res..

[31]  Daniel Kuhn,et al.  Distributionally Robust Convex Optimization , 2014, Oper. Res..

[32]  Alberto Leon-Garcia,et al.  Robust network design , 2013, 2013 IEEE International Conference on Communications (ICC).

[33]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[34]  Antonio Alonso Ayuso,et al.  Introduction to Stochastic Programming , 2009 .

[35]  Laurent El Ghaoui,et al.  Robust Optimization , 2021, ICORES.

[36]  Hsiuying Wang,et al.  Exact confidence coefficients of simultaneous confidence intervals for multinomial proportions , 2008 .

[37]  Edoardo Amaldi,et al.  Provisioning virtual private networks under traffic uncertainty , 2007, Networks.

[38]  G. Calafiore,et al.  On Distributionally Robust Chance-Constrained Linear Programs , 2006 .

[39]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[40]  Martin Zinkevich,et al.  Online Convex Programming and Generalized Infinitesimal Gradient Ascent , 2003, ICML.

[41]  E. Ordentlich,et al.  Inequalities for the L1 Deviation of the Empirical Distribution , 2003 .

[42]  Alexander Shapiro,et al.  The Sample Average Approximation Method for Stochastic Discrete Optimization , 2002, SIAM J. Optim..

[43]  Alastair Scott,et al.  Quick Simultaneous Confidence Intervals for Multinomial Proportions , 1987 .