On the Rate of Convergence of Optimal Solutions of Monte Carlo Approximations of Stochastic Programs

In this paper we discuss Monte Carlo simulation based approximations of a stochastic programming problem. We show that if the corresponding random functions are convex piecewise linear and the distribution is discrete, then an optimal solution of the approximating problem provides an exact optimal solution of the true problem with probability one for sufficiently large sample size. Moreover, by using the theory of large deviations, we show that the probability of such an event approaches one exponentially fast with increase of the sample size. In particular, this happens in the case of linear two- (or multi-) stage stochastic programming with recourse if the corresponding distributions are discrete. The obtained results suggest that, in such cases, Monte Carlo simulation based methods could be very efficient. We present some numerical examples to illustrate the ideas involved.

[1]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[2]  F. Hiai Strong laws of large numbers for multivalued random variables , 1984 .

[3]  J. Dupacová,et al.  ASYMPTOTIC BEHAVIOR OF STATISTICAL ESTIMATORS AND OF OPTIMAL SOLUTIONS OF STOCHASTIC OPTIMIZATION PROBLEMS , 1988 .

[4]  George B. Dantzig,et al.  Parallel processors for planning under uncertainty , 1990 .

[5]  R. Wets,et al.  Epi‐consistency of convex stochastic programs , 1991 .

[6]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[7]  R. Tyrrell Rockafellar,et al.  Asymptotic Theory for Solutions in Statistical Estimation and Stochastic Programming , 1993, Math. Oper. Res..

[8]  M. Ferris,et al.  Weak sharp minima in mathematical programming , 1993 .

[9]  Alexander Shapiro,et al.  Asymptotic Behavior of Optimal Solutions in Stochastic Programming , 1993, Math. Oper. Res..

[10]  Julia L. Higle,et al.  Finite master programs in regularized stochastic decomposition , 1994, Math. Program..

[11]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[12]  Roger J.-B. Wets,et al.  Probabilistic bounds (via large deviations) for the solutions of stochastic programming problems , 1995, Ann. Oper. Res..

[13]  Stephen M. Robinson,et al.  Analysis of Sample-Path Optimization , 1996, Math. Oper. Res..

[14]  Werner Römisch,et al.  Lipschitz Stability for Stochastic Programs with Complete Recourse , 1996, SIAM J. Optim..

[15]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[16]  Alexander Shapiro,et al.  A simulation-based approach to two-stage stochastic programming with recourse , 1998, Math. Program..

[17]  Georg Ch. Pflug,et al.  Stochastic programs and statistical data , 1999, Ann. Oper. Res..

[18]  P. A. Jensen,et al.  Response surface analysis of two‐stage stochastic linear programming with recourse , 1999 .

[19]  J. Frédéric Bonnans,et al.  Perturbation Analysis of Optimization Problems , 2000, Springer Series in Operations Research.