A parallel Branch-and-Fix Coordination based matheuristic algorithm for solving large sized multistage stochastic mixed 0-1 problems

A parallel matheuristic algorithm is presented as a spin-off from the exact Branch-and-Fix Coordination (BFC) algorithm for solving multistage stochastic mixed 0–1 problems. Some steps to guarantee the solution’s optimality are relaxed in the BFC algorithm, such that an incomplete backward branching scheme is considered for solving large sized problems. Additionally, a new branching criterion is considered, based on dynamically-guided and stage-wise ordering schemes, such that fewer Twin Node Families are expected to be visited during the execution of the so-called H-DBFC algorithm. The inner parallelization IH-DBFC of the new approach, allows to solve in parallel scenario clusters MIP submodels at different steps of the algorithm. The outer parallel version, OH-DBFC, considers independent paths and allows iterative incumbent solution values exchanges to obtain tighter bounds of the solution value of the original problem. A broad computational experience is reported for assessing the quality of the matheuristic solution for large sized instances. The instances dimensions that are considered are up to two orders of magnitude larger than in some other works that we are aware of. The optimality gap of the H-DBFC solution value versus the one obtained by a state-of-the-art MIP solver is very small, if any. The new approach frequently outperforms it in terms of solution’s quality and computing time. A comparison with our Stochastic Dynamic Programming algorithm is also reported. The use of parallel computing provides, on one hand, a perspective for solving very large sized instances and, on the other hand, an expected large reduction in elapsed time.

[1]  A. S. Abramson,et al.  Parallel algorithms for solving Stochastic Linear Programs , 1994 .

[2]  John R. Birge,et al.  Introduction to Stochastic programming (2nd edition), Springer verlag, New York , 2011 .

[3]  A. Erera,et al.  Scenario Set Partition Dual Bounds for Multistage Stochastic Programming : A Hierarchy of Bounds and a Partition Sampling Approach , 2016 .

[4]  Xiang Li,et al.  A parallel dynamic programming algorithm for multi-reservoir system optimization , 2014 .

[5]  Andrzej Ruszczynski,et al.  Parallel decomposition of multistage stochastic programming problems , 1993, Math. Program..

[6]  Zukui Li,et al.  Capacity expansion planning through augmented Lagrangian optimization and scenario decomposition , 2012 .

[7]  Warren B. Powell,et al.  Regularized Decomposition of High-Dimensional Multistage Stochastic Programs with Markov Uncertainty , 2015, SIAM J. Optim..

[8]  Laureano F. Escudero,et al.  Expected Future Value Decomposition Based Bid Price Generation for Large-Scale Network Revenue Management , 2013, Transp. Sci..

[9]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[10]  M. V. F. Pereira,et al.  Multi-stage stochastic optimization applied to energy planning , 1991, Math. Program..

[11]  R. Wets,et al.  L-SHAPED LINEAR PROGRAMS WITH APPLICATIONS TO OPTIMAL CONTROL AND STOCHASTIC PROGRAMMING. , 1969 .

[12]  V. Kozmík,et al.  Risk-Averse Stochastic Dual Dynamic Programming , 2013 .

[13]  Stavros A. Zenios,et al.  Scalable Parallel Benders Decomposition for Stochastic Linear Programming , 1997, Parallel Comput..

[14]  André Luís Marques Marcato,et al.  Parallel computing applied to the stochastic dynamic programming for long term operation planning of hydrothermal power systems , 2013, Eur. J. Oper. Res..

[15]  Roberto Musmanno,et al.  Parallel algorithms to solve two-stage stochastic linear programs with robustness constraints , 2000, Parallel Comput..

[16]  Burhaneddin Sandıkçı,et al.  A Scalable Bounding Method for Multi-Stage Stochastic Integer Programs , 2014 .

[17]  David L. Woodruff,et al.  Obtaining lower bounds from the progressive hedging algorithm for stochastic mixed-integer programs , 2016, Math. Program..

[18]  Alan J. King,et al.  Modeling with Stochastic Programming , 2012 .

[19]  María Merino,et al.  An algorithmic framework for solving large scale multistage stochastic mixed 0-1 problems with nonsymmetric scenario trees , 2012, Comput. Oper. Res..

[20]  Laureano F. Escudero,et al.  Cluster Lagrangean decomposition in multistage stochastic optimization , 2016, Comput. Oper. Res..

[21]  Unai Aldasoro,et al.  On parallelization of a stochastic dynamic programming algorithm for solving large-scale mixed 0–1 problems under uncertainty , 2015, TOP.

[22]  Alexander Shapiro,et al.  The empirical behavior of sampling methods for stochastic programming , 2006, Ann. Oper. Res..

[23]  George B. Dantzig,et al.  Parallel processors for planning under uncertainty , 1990 .

[24]  R. Wets,et al.  Stochastic programming , 1989 .

[25]  Eleni Hadjiconstantinou,et al.  A decomposition-based stochastic programming approach for the project scheduling problem under time/cost trade-off settings and uncertain durations , 2010, Comput. Oper. Res..

[26]  G. Pflug,et al.  Multistage Stochastic Optimization , 2014 .

[27]  María Merino,et al.  On BFC-MSMIP strategies for scenario cluster partitioning, and twin node family branching selection and bounding for multistage stochastic mixed integer programming , 2010, Comput. Oper. Res..

[28]  Laureano F. Escudero,et al.  An SDP approach for multiperiod mixed 0-1 linear programming models with stochastic dominance constraints for risk management , 2015, Comput. Oper. Res..

[29]  John R. Birge,et al.  A parallel implementation of the nested decomposition algorithm for multistage stochastic linear programs , 1996, Math. Program..

[30]  Alexander Shapiro,et al.  Risk neutral and risk averse Stochastic Dual Dynamic Programming method , 2013, Eur. J. Oper. Res..

[31]  Jörgen Blomvall A multistage stochastic programming algorithm suitable for parallel computing , 2003, Parallel Comput..

[32]  Laureano F. Escudero,et al.  On the time-consistent stochastic dominance risk averse measure for tactical supply chain planning under uncertainty , 2017, Comput. Oper. Res..

[33]  Gloria Pérez,et al.  Stochastic Models for Optimizing Immunization Strategies in Fixed-Income Security Portfolios under Some Sources of Uncertainty , 2013 .

[34]  Vincent Guigues,et al.  SDDP for some interstage dependent risk-averse problems and application to hydro-thermal planning , 2014, Comput. Optim. Appl..

[35]  R. Tyrrell Rockafellar,et al.  Scenarios and Policy Aggregation in Optimization Under Uncertainty , 1991, Math. Oper. Res..

[36]  Zhihong Zhou,et al.  Multistage Stochastic Decomposition: A Bridge between Stochastic Programming and Approximate Dynamic Programming , 2014, SIAM J. Optim..

[37]  Laureano F. Escudero,et al.  On stochastic dynamic programming for solving large-scale planning problems under uncertainty , 2009, Comput. Oper. Res..

[38]  Arthur M. Geoffrion,et al.  Lagrangian Relaxation for Integer Programming , 2010, 50 Years of Integer Programming.

[39]  M. Guignard Lagrangean relaxation , 2003 .

[40]  Rym M'Hallah,et al.  A two-stage stochastic programming model for the parallel machine scheduling problem with machine capacity , 2011, Comput. Oper. Res..

[41]  John M. Mulvey,et al.  A New Scenario Decomposition Method for Large-Scale Stochastic Optimization , 1995, Oper. Res..

[42]  M. Pereira,et al.  Stochastic Optimization of a Multireservoir Hydroelectric System: A Decomposition Approach , 1985 .

[43]  Gerardo A. Pérez-Valdés,et al.  A parallelised distributed implementation of a Branch and Fix Coordination algorithm , 2015, Eur. J. Oper. Res..

[44]  David A. Patterson,et al.  Computer Architecture: A Quantitative Approach , 1969 .

[45]  L. Escudero On a mixture of the fix-and-relax coordination and Lagrangian substitution schemes for multistage stochastic mixed integer programming , 2009 .

[46]  Laureano F. Escudero,et al.  On time stochastic dominance induced by mixed integer-linear recourse in multistage stochastic programs , 2016, Eur. J. Oper. Res..

[47]  María Merino,et al.  An algorithmic framework for solving large-scale multistage stochastic mixed 0-1 problems with nonsymmetric scenario trees , 2012, Comput. Oper. Res..

[48]  María Merino,et al.  BFC-MSMIP: an exact branch-and-fix coordination approach for solving multistage stochastic mixed 0–1 problems , 2009 .

[49]  John R. Birge,et al.  Decomposition and Partitioning Methods for Multistage Stochastic Linear Programs , 1985, Oper. Res..

[50]  A. Ruszczynski,et al.  Accelerating the regularized decomposition method for two stage stochastic linear problems , 1997 .

[51]  Suvrajeet Sen,et al.  A Branch-and-Price Algorithm for Multistage Stochastic Integer Programming with Application to Stochastic Batch-Sizing Problems , 2004, Manag. Sci..

[52]  William T. Ziemba,et al.  Applications of Stochastic Programming (MPS-SIAM Series in Optimization) , 2005 .

[53]  Hugh Garraway Parallel Computer Architecture: A Hardware/Software Approach , 1999, IEEE Concurrency.

[54]  Unai Aldasoro Marcellan On parallel computing for stochastic optimization models and algorithms , 2015 .

[55]  R. Wets Stochastic Programs with Fixed Recourse: The Equivalent Deterministic Program , 1974 .

[56]  Unai Aldasoro,et al.  An algorithmic framework for solving large-scale multistage stochastic mixed 0-1 problems with nonsymmetric scenario trees. Part II: Parallelization , 2013, Comput. Oper. Res..

[57]  Li Hong,et al.  Parallel Computing for Dynamic Asset Allocation Based on the Stochastic Programming , 2010, 2010 WASE International Conference on Information Engineering.

[58]  Andrew J. Schaefer,et al.  Scenario-Tree Decomposition : Bounds for Multistage Stochastic Mixed-Integer Programs , 2014 .

[59]  Andrew J. Schaefer,et al.  A hierarchy of bounds for stochastic mixed-integer programs , 2013, Math. Program..

[60]  John M. Wilson,et al.  Introduction to Stochastic Programming , 1998, J. Oper. Res. Soc..

[61]  Andrzej Ruszczynski,et al.  On Convergence of an Augmented Lagrangian Decomposition Method for Sparse Convex Optimization , 1995, Math. Oper. Res..

[62]  Suvrajeet Sen,et al.  A heuristic procedure for stochastic integer programs with complete recourse , 2006, Eur. J. Oper. Res..

[63]  W. Marsden I and J , 2012 .

[64]  Laureano F. Escudero,et al.  A parallel computation approach for solvingmultistage stochastic network problems , 1999, Ann. Oper. Res..

[65]  David L. Woodruff,et al.  Progressive hedging innovations for a class of stochastic mixed-integer resource allocation problems , 2011, Comput. Manag. Sci..

[66]  J. F. Benders Partitioning procedures for solving mixed-variables programming problems , 1962 .

[67]  Mária Lucká,et al.  Application of multistage stochastic programs solved in parallel in portfolio management , 2008, Parallel Comput..

[68]  Hercules Vladimirou,et al.  Scalable parallel computations forlarge-scale stochastic programming , 1999, Ann. Oper. Res..

[69]  Debora Mahlke,et al.  A Scenario Tree-Based Decomposition for Solving Multistage Stochastic Programs: With Application in Energy Production , 2010 .

[70]  Andres Ramos,et al.  Optimal Design of the Electrical Layout of an Offshore Wind Farm Applying Decomposition Strategies , 2013, IEEE Transactions on Power Systems.