EVPI‐based importance sampling solution proceduresfor multistage stochastic linear programmeson parallel MIMD architectures

Multistage stochastic linear programming has many practical applications for problemswhose current decisions have to be made under future uncertainty. There are a variety ofmethods for solving the deterministic equivalent forms of these dynamic problems, includingthe simplex and interior‐point methods and nested Benders decomposition, which decomposesthe original problem into a set of smaller linear programming problems and hasrecently been shown to be superior to the alternatives for large problems. The Benderssubproblems can be visualised as being attached to the nodes of a tree which is formed fromthe realisations of the random data process determining the uncertainty in the problem. Thispaper describes a parallel implementation of the nested Benders algorithm which employsa farming technique to parallelize nodal subproblem solutions. Differing structures of thetest problems cause differing levels of speed‐up on a variety of multicomputing platforms:problems with few variables and constraints per node do not gain from this parallelisation.We therefore employ stage aggregation to such problems to improve their parallel solutionefficiency by increasing the size of the nodes and therefore the time spent calculating relativeto the time spent communicating between processors. A parallel version of a sequentialimportance sampling solution algorithm based on local expected value of perfect information(EVPI) is developed which is applicable to extremely large multistage stochastic linearprogrammes which either have too many data paths to solve directly or a continuous distributionof possible realisations. It utilises the parallel nested Benders algorithm and a parallelversion of an algorithm designed to calculate the local EVPI values for the nodes of the treeand achieves near linear speed‐up.

[1]  Yuri Ermoliev,et al.  Numerical techniques for stochastic optimization , 1988 .

[2]  Andrzej Ruszczynski,et al.  Parallel decomposition of multistage stochastic programming problems , 1993, Math. Program..

[3]  Horand I. Gassmann,et al.  Mslip: A computer code for the multistage stochastic linear programming problem , 1990, Math. Program..

[4]  John R. Birge,et al.  Decomposition and Partitioning Methods for Multistage Stochastic Linear Programs , 1985, Oper. Res..

[5]  R. Wets,et al.  Stochastic programming , 1989 .

[6]  Jonathan Eckstein,et al.  Stochastic dedication: designing fixed income portfolios using massively parallel Benders decomposition , 1993 .

[7]  Michael A. H. Dempster,et al.  Parallelization and Aggregation of Nested Benders Decomposition , 1997 .

[8]  R. Wets,et al.  L-SHAPED LINEAR PROGRAMS WITH APPLICATIONS TO OPTIMAL CONTROL AND STOCHASTIC PROGRAMMING. , 1969 .

[9]  John R. Birge,et al.  A parallel implementation of the nested decomposition algorithm for multistage stochastic linear programs , 1996, Math. Program..

[10]  R. Tyrrell Rockafellar,et al.  Scenarios and Policy Aggregation in Optimization Under Uncertainty , 1991, Math. Oper. Res..

[11]  J. F. Benders Partitioning procedures for solving mixed-variables programming problems , 1962 .

[12]  G. Mitra,et al.  A Distributed Processing Algorithm for Solving Integer Programs Using a Cluster of Workstations , 1997, Parallel Comput..

[13]  G. B. Dantzig,et al.  Solving stochastic linear programs on a Hypercube multicomputer. Technical report , 1991 .

[14]  George B. Dantzig,et al.  The parallel decomposition of linear programs , 1989 .

[15]  George B. Dantzig,et al.  Decomposition Principle for Linear Programs , 1960 .

[16]  Jitka Dupacová,et al.  Multistage stochastic programs: The state-of-the-art and selected bibliography , 1995, Kybernetika.

[17]  M. Dempster On stochastic programming. II: Dynamic problems under risk , 1988 .

[18]  Robert J. Wittrock Dual nested decomposition of staircase linear programs , 1985 .

[19]  Stavros A. Zenios,et al.  A Scalable Parallel Interior Point Algorithm for Stochastic Linear Programming and Robust Optimization , 1997, Comput. Optim. Appl..

[20]  Michael A. H. Dempster,et al.  Dynamic Stochastic Programming for Asset-Liability Management , 1998 .

[21]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[22]  John J. H. Forrest,et al.  Vector processing in simplex and interior methods for linear programming , 1990 .