Robust Stochastic Optimization with Rare-Event Modeling

In this paper, we propose a novel robust stochastic optimization approach with a distinctive consideration for rare events, in which divergence measures are used to bound the event-wise ambiguity sets. This is done by using the Poisson distribution with uncertain expected value parameter to model rare events and showing that the distribution possesses theoretical properties that enable the derivation of rare-event probability bounds. We employ the proven bijection between the Bregman divergence and the Poisson distribution to characterize variations within the probability bounds, and demonstrate that the explicit use of the Poissonspecific Bregman divergence results in reduced conservatism in decision-making. Moreover, we derive a probability bound on this conservatism reduction, which is a concept akin to the popular probability of constraint violation in robust optimization. The bound shows that the rarer the event, the more the rareevent information becomes powerful. Finally, we provide tractable reformulations for our robust counterparts under rare events. Our computational study, based on a realistic case study involving 18 years of Brazilian flood and landslide data, reveals that our new approach generates significantly better decisions than stateof-the-art approaches that are not driven by rare events.

[1]  Z. Q. Lu Statistical Inference Based on Divergence Measures , 2007 .

[2]  Claudia Neuhauser,et al.  A Poisson Approximation for Sequence Comparisons with Insertions and Deletions , 1994 .

[3]  Ana Paula Barbosa-Póvoa,et al.  Building disaster preparedness and response capacity in humanitarian supply chains using the Social Vulnerability Index , 2020, Eur. J. Oper. Res..

[4]  Herbert E. Scarf,et al.  A Min-Max Solution of an Inventory Problem , 1957 .

[5]  Hong Yan,et al.  Managing Relief Inventories Responding to Natural Disasters: Gaps Between Practice and Literature , 2019, Production and Operations Management.

[6]  Alexander Shapiro,et al.  The Sample Average Approximation Method for Stochastic Discrete Optimization , 2002, SIAM J. Optim..

[7]  Stephen P. Boyd,et al.  Convex piecewise-linear fitting , 2009 .

[8]  柳井 浩,et al.  A Min Max Solution of an inventory problem , 1959 .

[9]  Daniel Kuhn,et al.  Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations , 2015, Mathematical Programming.

[10]  Garud Iyengar,et al.  Ambiguous chance constrained problems and robust optimization , 2006, Math. Program..

[11]  Julie Rozenberg,et al.  Unbreakable: Building the Resilience of the Poor in the Face of Natural Disasters , 2016 .

[12]  A. Labib,et al.  Operationalizing Learning from Rare Events: Framework for Middle Humanitarian Operations Managers , 2019, Production and Operations Management.

[13]  Bertrand Melenberg,et al.  Robust Optimization with Ambiguous Stochastic Constraints Under Mean and Dispersion Information , 2018, Oper. Res..

[14]  A. Barka,et al.  Heightened odds of large earthquakes near istanbul: An interaction-based probability calculation , 2000, Science.

[15]  Andrzej Stachurski,et al.  Parallel Optimization: Theory, Algorithms and Applications , 2000, Parallel Distributed Comput. Pract..

[16]  Anant P. Godbole,et al.  Poisson approximations for runs and patterns of rare events , 1991, Advances in Applied Probability.

[17]  Daniel Kuhn,et al.  Distributionally Robust Convex Optimization , 2014, Oper. Res..

[18]  Anja De Waegenaere,et al.  Robust Solutions of Optimization Problems Affected by Uncertain Probabilities , 2011, Manag. Sci..

[19]  J. Hüsler,et al.  Laws of Small Numbers: Extremes and Rare Events , 1994 .

[20]  Ruiwei Jiang,et al.  Data-driven chance constrained stochastic program , 2015, Mathematical Programming.

[21]  R C Grimson,et al.  Clustering of rare events. , 1983, Biometrics.

[22]  Inderjit S. Dhillon,et al.  Clustering with Bregman Divergences , 2005, J. Mach. Learn. Res..

[23]  A. Kleywegt,et al.  Distributionally Robust Stochastic Optimization with Wasserstein Distance , 2016, Math. Oper. Res..

[24]  Yongpei Guan,et al.  Data-driven risk-averse stochastic optimization with Wasserstein metric , 2018, Oper. Res. Lett..

[25]  Daniel Kuhn,et al.  Distributionally robust joint chance constraints with second-order moment information , 2011, Mathematical Programming.

[26]  Melvyn Sim,et al.  Distributionally Robust Optimization and Its Tractable Approximations , 2010, Oper. Res..

[27]  Sanjay Mehrotra,et al.  Decomposition Algorithm for Distributionally Robust Optimization using Wasserstein Metric , 2017, 1704.03920.

[28]  Constantine Caramanis,et al.  Theory and Applications of Robust Optimization , 2010, SIAM Rev..

[29]  Zhaolin Hu,et al.  Kullback-Leibler divergence constrained distributionally robust optimization , 2012 .

[30]  Daniel Kuhn,et al.  Conic Programming Reformulations of Two-Stage Distributionally Robust Linear Programs over Wasserstein Balls , 2016, Oper. Res..

[31]  E. Thorbecke,et al.  A Class of Decomposable Poverty Measures , 1984 .

[32]  Melvyn Sim,et al.  Robust Stochastic Optimization Made Easy with RSOME , 2020, Manag. Sci..

[33]  Amy Prendergast,et al.  Medieval forewarning of the 2004 Indian Ocean tsunami in Thailand , 2008, Nature.

[34]  Hardeo Sahai,et al.  Confidence Intervals for the Mean of a Poisson Distribution: A Review , 1993 .

[35]  Melvyn Sim,et al.  Adaptive Distributionally Robust Optimization , 2019, Manag. Sci..

[36]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[37]  Huifu Xu,et al.  Convergence Analysis for Distributionally Robust Optimization and Equilibrium Problems , 2016, Math. Oper. Res..

[38]  Güzin Bayraksan,et al.  Phi-Divergence Constrained Ambiguous Stochastic Programs for Data-Driven Optimization , 2016 .

[39]  L. Pardo Statistical Inference Based on Divergence Measures , 2005 .

[40]  L. Haan,et al.  Extreme value theory : an introduction , 2006 .