Robust Modeling and Planning: Insights from Three Industrial Applications

Abstract Optimization under uncertainty has been a well-studied field, with significant interest generated in this field in the past four decades. This paper is both practical and expository -- its purpose is to: discuss the process of generating robust solutions, highlight issues that arise in practice, and discuss ways to address such issues. For illustrative purposes, we study three different, commonly adopted, approaches for optimization under uncertainty (chance-constrained programming, robust optimization and conditional value at risk); and apply these approaches to three real-world application-based case studies. Our case studies are chosen to span a variety of problem characteristics. For each case study, we discuss the applicability of each of the three approaches, practical issues that arose during application, and robustness and further characteristics of the subsequent solutions. We point out associated advantages and limitations, and illustrate the gap between the theoretical and actual performance of these approaches for each case study. We also discuss how some of the discovered limitations can be overcome using extensions of the approaches or through a better understanding of the data. We conclude by summarizing common and generalizable insights obtained across the three case studies. Our findings suggest the effectiveness of solutions is dependent on: the methods, the size of the problem, the underlying pattern of uncertainty in data, and the metrics of interest. While we provide some guidelines to identify the most suitable approach to a given problem, our experience matches theory to suggest that under carefully tuned parameters accompanied by simulation, the different approaches can generate results that are similar and provide comparable tradeoffs between the mean and robustness metric. However, this could also require considerable tuning requiring experience, and we provide some guidelines to achieve such results. This illustrates that generating high quality robust solutions is both an art and a science.

[1]  Georgia Perakis,et al.  Robust Controls for Network Revenue Management , 2010, Manuf. Serv. Oper. Manag..

[2]  Andrzej Ruszczynski,et al.  Probabilistic programming with discrete distributions and precedence constrained knapsack polyhedra , 2002, Math. Program..

[3]  Lavanya Marla,et al.  Airline schedule planning and operations : optimization-based approaches for delay mitigation , 2010 .

[4]  Alexander Shapiro,et al.  Convex Approximations of Chance Constrained Programs , 2006, SIAM J. Optim..

[5]  Nikolaos Trichakis,et al.  Pareto Efficiency in Robust Optimization , 2014, Manag. Sci..

[6]  Arkadi Nemirovski,et al.  Robust solutions of uncertain linear programs , 1999, Oper. Res. Lett..

[7]  Suvrajeet Sen Relaxations for probabilistically constrained programs with discrete random variables , 1992, Oper. Res. Lett..

[8]  R. Rockafellar,et al.  Conditional Value-at-Risk for General Loss Distributions , 2001 .

[9]  Cécile Murat,et al.  Recent advances in robust optimization: An overview , 2014, Eur. J. Oper. Res..

[10]  John R. Birge,et al.  Introduction to Stochastic Programming , 1997 .

[11]  Lavanya Marla Robust optimization for network-based resource allocation problems under uncertainty , 2007 .

[12]  Johanna L. Mathieu,et al.  Distributionally Robust Chance-Constrained Optimal Power Flow With Uncertain Renewables and Uncertain Reserves Provided by Loads , 2017, IEEE Transactions on Power Systems.

[13]  Donald Goldfarb,et al.  Robust Portfolio Selection Problems , 2003, Math. Oper. Res..

[14]  A. Charnes,et al.  Chance-Constrained Programming , 1959 .

[15]  S. Uryasev,et al.  Asset/Liability Management for Pension Funds Using CVaR Constraints , 2001 .

[16]  Marco C. Campi,et al.  A Sampling-and-Discarding Approach to Chance-Constrained Optimization: Feasibility and Optimality , 2011, J. Optim. Theory Appl..

[17]  Xu Andy Sun,et al.  The Adaptive Robust Multi-Period Alternating Current Optimal Power Flow Problem , 2018, IEEE Transactions on Power Systems.

[18]  Melvyn Sim,et al.  The Price of Robustness , 2004, Oper. Res..

[19]  Martin W. P. Savelsbergh,et al.  Robust Optimization for Empty Repositioning Problems , 2009, Oper. Res..

[20]  Matthias Koenig,et al.  List pricing versus dynamic pricing: Impact on the revenue risk , 2010, Eur. J. Oper. Res..

[21]  Melvyn Sim,et al.  Distributionally Robust Optimization and Its Tractable Approximations , 2010, Oper. Res..

[22]  Philippe Artzner,et al.  Coherent Measures of Risk , 1999 .

[23]  Dimitris Bertsimas,et al.  A Robust Optimization Approach to Inventory Theory , 2006, Oper. Res..

[24]  Dimitris Bertsimas,et al.  Robust Queueing Theory , 2015, Oper. Res..

[25]  Siqian Shen,et al.  Multi-objective probabilistically constrained programs with variable risk: Models for multi-portfolio financial optimization , 2016, Eur. J. Oper. Res..

[26]  Philemon Sakamoto UAV Mission Planning under Uncertainty , 2006 .

[27]  Melvyn Sim,et al.  From CVaR to Uncertainty Set: Implications in Joint Chance-Constrained Optimization , 2010, Oper. Res..

[28]  Arkadi Nemirovski,et al.  Robust Convex Optimization , 1998, Math. Oper. Res..

[29]  Siqian Shen,et al.  Decomposition algorithms for optimizing multi-server appointment scheduling with chance constraints , 2016, Math. Program..

[30]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[31]  Dimitris Bertsimas,et al.  Tractable stochastic analysis in high dimensions via robust optimization , 2012, Mathematical Programming.

[32]  András Prékopa,et al.  Contributions to the theory of stochastic programming , 1973, Math. Program..

[33]  Peter Kall,et al.  Stochastic Linear Programming , 1975 .

[34]  James R. Luedtke,et al.  Branch-and-cut approaches for chance-constrained formulations of reliable network design problems , 2013, Mathematical Programming Computation.

[35]  Cynthia Barnhart,et al.  Robust optimization: Lessons learned from aircraft routing , 2018, Comput. Oper. Res..

[36]  Matthias Koenig,et al.  Risk management policies for dynamic capacity control , 2015, Comput. Oper. Res..

[37]  Cynthia Barnhart,et al.  Planning for Robust Airline Operations: Optimizing Aircraft Routings and Flight Departure Times to Minimize Passenger Disruptions , 2006, Transp. Sci..

[38]  Vijay S. Bawa,et al.  On Chance Constrained Programming Problems with Joint Constraints , 1973 .

[39]  Jonathan Cole Smith,et al.  Expectation and Chance-Constrained Models and Algorithms for Insuring Critical Paths , 2010, Manag. Sci..

[40]  Giuseppe Carlo Calafiore,et al.  Uncertain convex programs: randomized solutions and confidence levels , 2005, Math. Program..

[41]  P. Krokhmal,et al.  Portfolio optimization with conditional value-at-risk objective and constraints , 2001 .

[42]  Cynthia Barnhart,et al.  Applications of Operations Research in the Air Transport Industry , 2003, Transp. Sci..

[43]  A. Shapiro,et al.  Financial prediction with constrained tail risk , 2007 .

[44]  James R. Luedtke,et al.  Chance-Constrained Binary Packing Problems , 2014, INFORMS J. Comput..

[45]  Siqian Shen,et al.  Chance-Constrained Programming Models and Approximations for General Stochastic Bottleneck Spanning Tree Problems , 2015, INFORMS J. Comput..

[46]  Diego Klabjan,et al.  Robust Airline Scheduling Under Block-Time Uncertainty , 2011, Transp. Sci..

[47]  Huseyin Topaloglu,et al.  Robust Assortment Optimization in Revenue Management Under the Multinomial Logit Choice Model , 2012, Oper. Res..

[48]  Darinka Dentcheva,et al.  Concavity and efficient points of discrete distributions in probabilistic programming , 2000, Math. Program..

[49]  Daniel Kuhn,et al.  Distributionally Robust Convex Optimization , 2014, Oper. Res..

[50]  E. Beale ON MINIMIZING A CONVEX FUNCTION SUBJECT TO LINEAR INEQUALITIES , 1955 .

[51]  Daniel Kuhn,et al.  A distributionally robust perspective on uncertainty quantification and chance constrained programming , 2015, Mathematical Programming.

[52]  Zhe George Zhang,et al.  Technical Note - A Risk-Averse Newsvendor Model Under the CVaR Criterion , 2009, Oper. Res..

[53]  B. L. Miller,et al.  Chance Constrained Programming with Joint Constraints , 1965 .

[54]  Arkadi Nemirovski,et al.  Robust solutions of Linear Programming problems contaminated with uncertain data , 2000, Math. Program..

[55]  Gert de Cooman,et al.  Robust queueing theory: an initial study using imprecise probabilities , 2016, Queueing Syst. Theory Appl..

[56]  Daniel Kuhn,et al.  Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations , 2015, Mathematical Programming.

[57]  G. Pflug Some Remarks on the Value-at-Risk and the Conditional Value-at-Risk , 2000 .

[58]  Nikolaos V. Sahinidis,et al.  Optimization under uncertainty: state-of-the-art and opportunities , 2004, Comput. Chem. Eng..

[59]  Allen L. Soyster,et al.  Technical Note - Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming , 1973, Oper. Res..

[60]  Manoranjan Maiti,et al.  A single period inventory model with imperfect production and stochastic demand under chance and imprecise constraints , 2008, Eur. J. Oper. Res..

[61]  Vishal Gupta,et al.  Data-driven robust optimization , 2013, Math. Program..

[62]  R. Rockafellar,et al.  Optimization of conditional value-at risk , 2000 .

[63]  John M. Mulvey,et al.  Applying CVaR for decentralized risk management of financial companies , 2006 .

[64]  George B. Dantzig,et al.  Linear Programming Under Uncertainty , 2004, Manag. Sci..

[65]  Ionel Vechiu,et al.  CVaR-based energy management scheme for optimal resilience and operational cost in commercial building microgrids , 2018, International Journal of Electrical Power & Energy Systems.

[66]  Giuseppe Carlo Calafiore,et al.  The scenario approach to robust control design , 2006, IEEE Transactions on Automatic Control.

[67]  D. Bertsimas,et al.  Robust and Data-Driven Optimization: Modern Decision-Making Under Uncertainty , 2006 .

[68]  Chiwei Yan,et al.  Robust Aircraft Routing , 2016 .

[69]  Simge Küçükyavuz,et al.  On mixing sets arising in chance-constrained programming , 2012, Math. Program..

[70]  Patrizia Beraldi,et al.  A branch and bound method for stochastic integer problems under probabilistic constraints , 2002, Optim. Methods Softw..

[71]  George L. Nemhauser,et al.  An integer programming approach for linear programs with probabilistic constraints , 2010, Math. Program..

[72]  Jochen Gönsch,et al.  A Survey on Risk-Averse and Robust Revenue Management , 2017, Eur. J. Oper. Res..

[73]  A. Charnes,et al.  Cost Horizons and Certainty Equivalents: An Approach to Stochastic Programming of Heating Oil , 1958 .

[74]  P. Beamish,et al.  INTERNATIONAL DIVERSIFICATION AND FIRM PERFORMANCE: THE S-CURVE HYPOTHESIS , 2004 .

[75]  George L. Nemhauser,et al.  The aircraft rotation problem , 1997, Ann. Oper. Res..

[76]  Dimitris Bertsimas,et al.  Constructing Uncertainty Sets for Robust Linear Optimization , 2009, Oper. Res..

[77]  Gary L. Lilien,et al.  Marketing Engineering: Computer-Assisted Marketing Analysis and Planning , 1998 .

[78]  Melvyn Sim,et al.  Robust discrete optimization and network flows , 2003, Math. Program..

[79]  Jochen Gönsch,et al.  Optimizing the conditional value-at-risk in revenue management , 2013 .

[80]  Robert J. Vanderbei,et al.  Robust Optimization of Large-Scale Systems , 1995, Oper. Res..

[81]  Yingjie Lan,et al.  Revenue Management with Limited Demand Information , 2008, Manag. Sci..

[82]  R. Jagannathan,et al.  Chance-Constrained Programming with Joint Constraints , 1974, Oper. Res..

[83]  Dimitris Bertsimas,et al.  Closure to the Discussion of “Adaptive Robust Optimization for the Security Constrained Unit Commitment Problem” , 2014 .

[84]  Corban Harrell Bryant Robust Planning for Effects-Based Operations , 2006 .

[85]  Richard E. Rosenthal,et al.  Optimization Tradecraft: Hard-Won Insights from Real-World Decision Support , 2008, Interfaces.