Efficient solution selection for two-stage stochastic programs

Abstract Sampling-based stochastic programs are extensively applied in practice. However, the resulting models tend to be computationally challenging. A reasonable number of samples needs to be identified to represent the random data, and a group of approximate models can then be constructed using such a number of samples. These approximate models can produce a set of potential solutions for the original model. In this paper, we consider the problem of allocating a finite computational budget among numerous potential solutions of a two-stage linear stochastic program, which aims to identify the best solution among potential ones by conducting simulation under a given computational budget. We propose a two-stage heuristic approach to solve the computational resource allocation problem. First, we utilise a Wasserstein-based screening rule to remove potentially inferior solutions from the simulation. Next, we use a ranking and selection technique to efficiently collect performance information of the remaining solutions. The performance of our approach is demonstrated through well-known benchmark problems. Results show that our method provides good trade-offs between computational effort and solution performance.

[1]  E. Beale ON MINIMIZING A CONVEX FUNCTION SUBJECT TO LINEAR INEQUALITIES , 1955 .

[2]  Roger J.-B. Wets,et al.  Programming under uncertainty: The complete problem , 1966 .

[3]  Werner Römisch,et al.  Scenario tree reduction for multistage stochastic programs , 2009, Comput. Manag. Sci..

[4]  George B. Dantzig,et al.  Decomposition Principle for Linear Programs , 1960 .

[5]  Changzheng Liu,et al.  A two-stage stochastic programming model for transportation network protection , 2009, Comput. Oper. Res..

[6]  Jitka Dupacová,et al.  Scenario reduction in stochastic programming , 2003, Math. Program..

[7]  Michal Kaut,et al.  A Heuristic for Moment-Matching Scenario Generation , 2003, Comput. Optim. Appl..

[8]  Patrizia Beraldi,et al.  A two-stage stochastic programming model for electric energy producers , 2008, Comput. Oper. Res..

[9]  Marc Goetschalckx,et al.  A stochastic programming approach for supply chain network design under uncertainty , 2004, Eur. J. Oper. Res..

[10]  R. M. Dudley,et al.  Real Analysis and Probability , 1989 .

[11]  Y. Smeers,et al.  Optimal Investments for Electricity Generation: A Stochastic Model and a Test-Problem , 1988 .

[12]  A. Ruszczynski,et al.  Accelerating the regularized decomposition method for two stage stochastic linear problems , 1997 .

[13]  Güzin Bayraksan,et al.  A probability metrics approach for reducing the bias of optimality gap estimators in two-stage stochastic linear programming , 2013, Math. Program..

[14]  Yongjia Song,et al.  Adaptive Partition-Based Level Decomposition Methods for Solving Two-Stage Stochastic Programs with Fixed Recourse , 2018, INFORMS J. Comput..

[15]  Gül Gürkan,et al.  Sample-path optimization in simulation , 1994, Proceedings of Winter Simulation Conference.

[16]  Werner Römisch,et al.  A note on scenario reduction for two-stage stochastic programs , 2007, Oper. Res. Lett..

[17]  Loo Hay Lee,et al.  MO2TOS: Multi-Fidelity Optimization with Ordinal Transformation and Optimal Sampling , 2016, Asia Pac. J. Oper. Res..

[18]  Michael C. Georgiadis,et al.  A two-stage stochastic programming model for the optimal design of distributed energy systems , 2013 .

[19]  Louis Wehenkel,et al.  Scenario Trees and Policy Selection for Multistage Stochastic Programming Using Machine Learning , 2011, INFORMS J. Comput..

[20]  Jitka Dupacová,et al.  Portfolio optimization via stochastic programming: Methods of output analysis , 1999, Math. Methods Oper. Res..

[21]  Julie L. Swann,et al.  Simple Procedures for Selecting the Best Simulated System When the Number of Alternatives is Large , 2001, Oper. Res..

[22]  David P. Morton,et al.  Monte Carlo bounding techniques for determining solution quality in stochastic programs , 1999, Oper. Res. Lett..

[23]  George B. Dantzig,et al.  Linear Programming Under Uncertainty , 2004, Manag. Sci..

[24]  Stephen J. Wright,et al.  Decomposition Algorithms for Stochastic Programming on a Computational Grid , 2001, Comput. Optim. Appl..

[25]  R. Wets,et al.  L-SHAPED LINEAR PROGRAMS WITH APPLICATIONS TO OPTIMAL CONTROL AND STOCHASTIC PROGRAMMING. , 1969 .

[26]  Georg Ch. Pflug,et al.  Scenario tree generation for multiperiod financial optimization by optimal discretization , 2001, Math. Program..

[27]  Chun-Hung Chen,et al.  Opportunity Cost and OCBA Selection Procedures in Ordinal Optimization for a Fixed Number of Alternative Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Tito Homem-de-Mello,et al.  Monte Carlo sampling-based methods for stochastic optimization , 2014 .

[29]  Alexander Shapiro,et al.  A simulation-based approach to two-stage stochastic programming with recourse , 1998, Math. Program..

[30]  J. Birge,et al.  A multicut algorithm for two-stage stochastic linear programs , 1988 .

[31]  Chuen-Yih Chen,et al.  A Two-Stage Stochastic Network Model and Solution Methods for the Dynamic Empty Container Allocation Problem , 1998, Transp. Sci..

[32]  Leena Suhl,et al.  Applying oracles of on-demand accuracy in two-stage stochastic programming - A computational study , 2014, Eur. J. Oper. Res..

[33]  Werner Römisch,et al.  Are Quasi-Monte Carlo algorithms efficient for two-stage stochastic programs? , 2013, Comput. Optim. Appl..

[34]  Loo Hay Lee,et al.  A general framework on the simulation-based optimization under fixed computing budget , 2006, Eur. J. Oper. Res..

[35]  Alexander Shapiro,et al.  Conditioning of convex piecewise linear stochastic programs , 2002, Math. Program..

[36]  Daniel Kuhn,et al.  Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations , 2015, Mathematical Programming.

[37]  B. Rustem,et al.  Simulation and optimization approaches to scenario tree generation , 2004 .

[38]  B. Abbasi,et al.  A two-stage stochastic programming model for inventory management in the blood supply chain , 2017 .

[39]  Alexander Shapiro,et al.  The Sample Average Approximation Method for Stochastic Discrete Optimization , 2002, SIAM J. Optim..

[40]  Sarah M. Ryan,et al.  Solution sensitivity-based scenario reduction for stochastic unit commitment , 2014, Computational Management Science.

[41]  Gülay Barbarosoglu,et al.  A two-stage stochastic programming framework for transportation planning in disaster response , 2004, J. Oper. Res. Soc..

[42]  Werner Römisch,et al.  Quasi-Monte Carlo methods for linear two-stage stochastic programming problems , 2015, Math. Program..

[43]  E. Silver,et al.  Application of the scenario aggregation approach to a two-stage, stochastic, common component, inventory problem with a budget constraint , 1993 .

[44]  Naomi Miller,et al.  Risk-Averse Two-Stage Stochastic Linear Programming: Modeling and Decomposition , 2011, Oper. Res..

[45]  M. Tzur,et al.  The multilocation transshipment problem , 2006 .

[46]  Jürgen Branke,et al.  Selecting a Selection Procedure , 2007, Manag. Sci..

[47]  Robert D. Doverspike,et al.  Network planning with random demand , 1994, Telecommun. Syst..

[48]  Alexander Shapiro,et al.  The empirical behavior of sampling methods for stochastic programming , 2006, Ann. Oper. Res..

[49]  Berk Ustun,et al.  Importance Sampling in Stochastic Programming: A Markov Chain Monte Carlo Approach , 2015, INFORMS J. Comput..

[50]  Michel Gendreau,et al.  The Benders decomposition algorithm: A literature review , 2017, Eur. J. Oper. Res..