Progressive Hedging Innovations for a Class of Stochastic Resource Allocation Problems

Progressive hedging (PH) is a scenario-based decomposition technique for solving stochastic programs. While PH has been successfully applied to a number of problems, a variety of issues arise when implementing PH in practice, especially when dealing with very difficult or large-scale mixed-integer problems. In particular, decisions must be made regarding the value of the penalty parameter p, criteria for termination, and techniques for accelerating convergence. We investigate these issues in the context of a class of scenario-based resource allocation problem in which decision variables represent resources available at a cost and constraints enforce needs for sufficient combinations of resources. We introduce techniques for selecting p in proportion to the unit-cost of the associated decision variable, a mathematically-based heuristic for setting the p parameter, novel techniques for convergence acceleration, and methods for detecting and recovering from oscillatory behavior. The efficacy of these techniques is empirically assessed on two test cases: a difficult "laboratory" stochastic network flow problem and a largescale, real-world, robust spare parts procurement planning problem. Both test problems have integer variables in both stages. Additionally, we demonstrate that variable-specific p values are more effective than traditional fixed p values, and that the PH algorithm can serve as an effective heuristic even when the mathematical conditions for convergence are not respected.

[1]  Rommert Dekker,et al.  A Scenario Aggregation - Based Approach for Determining a Robust Airline Fleet Composition for Dynamic Capacity Allocation , 2002, Transp. Sci..

[2]  R. Wets,et al.  Stochastic programming , 1989 .

[3]  Randall M King,et al.  Prototype Aircraft Sustainability Model , 1987 .

[4]  R. Tyrrell Rockafellar,et al.  Scenarios and Policy Aggregation in Optimization Under Uncertainty , 1991, Math. Oper. Res..

[5]  Computational Experience with the Parallel Progressive Hedging Algorithm for Stochastic Linear Programs , 1993 .

[6]  Lee W. Schruben,et al.  On the Generality of Event-Graph Models , 2005, INFORMS J. Comput..

[7]  Saul I. Gass,et al.  Stigler's Diet Problem Revisited , 2001, Oper. Res..

[8]  David L. Woodruff,et al.  Hashing vectors for tabu search , 1993, Ann. Oper. Res..

[9]  Maarten H. van der Vlerk,et al.  Stochastic Integer Programming Bibliography , 2007 .

[10]  David L. Woodruff,et al.  Progressive hedging and tabu search applied to mixed integer (0,1) multistage stochastic programming , 1996, J. Heuristics.

[11]  Shabbir Ahmed,et al.  On Bridging the Gap Between Stochastic Integer Programming and MIP Solver Technologies , 2004, INFORMS J. Comput..

[12]  Roger J.-B. Wets,et al.  The aggregation principle in scenario analysis stochastic optimization , 1989 .

[13]  Patrik Alfredsson,et al.  Optimization of multi-echelon repairable item inventory systems with simultaneous location of repair facilities , 1997 .

[14]  John A. Muckstadt,et al.  Analysis and Algorithms for Service Parts Supply Chains , 2008 .

[15]  Craig C. Sherbrooke,et al.  Metric: A Multi-Echelon Technique for Recoverable Item Control , 1968, Oper. Res..

[16]  John M. Mulvey,et al.  Applying the progressive hedging algorithm to stochastic generalized networks , 1991, Ann. Oper. Res..

[17]  Abhijit Gosavi,et al.  Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning , 2003 .

[18]  Andrzej Ruszczynski,et al.  Probabilistic programming with discrete distributions and precedence constrained knapsack polyhedra , 2002, Math. Program..

[19]  Kjetil K. Haugen,et al.  Mixing stochastic dynamic programming and scenario aggregation , 1996, Ann. Oper. Res..

[20]  Robert M. Cranwell,et al.  SEM: Enterprise Modeling of JSF Global Sustainment , 2006, Proceedings of the 2006 Winter Simulation Conference.