Stochastic programming by Monte Carlo simulation methods

We consider in this paper stochastic programming problems which can be formulated as an optimization problem of an expected value function subject to deterministic constraints. We discuss a Monte Carlo simulation approach based on sample average approximations to a numerical solution of such problems. In particular, we give a survey of a statistical inference of the sample average estimators of the optimal value and optimal solutions of the true problem. We also discuss stopping rules and a validation analysis for such sample average approximation optimization procedures and give some illustration examples. ∗This work was supported, in part, by grant Grant DMI-9713878 from the National Science Foundation.

[1]  Julia L. Higle,et al.  Stochastic Decomposition: An Algorithm for Two-Stage Linear Programs with Recourse , 1991, Math. Oper. Res..

[2]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[3]  Alexander Shapiro,et al.  A simulation-based approach to two-stage stochastic programming with recourse , 1998, Math. Program..

[4]  Stephen M. Robinson,et al.  Sample-path optimization of convex stochastic performance functions , 1996, Math. Program..

[5]  Alexander Shapiro,et al.  On the Rate of Convergence of Optimal Solutions of Monte Carlo Approximations of Stochastic Programs , 2000, SIAM J. Optim..

[6]  Stephen M. Robinson,et al.  Analysis of Sample-Path Optimization , 1996, Math. Oper. Res..

[7]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[8]  A. Shapiro.  Asymptotic Properties of Statistical Estimators in Stochastic Programming , 1989 .

[9]  O. Mangasarian,et al.  The Fritz John Necessary Optimality Conditions in the Presence of Equality and Inequality Constraints , 1967 .

[10]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[11]  A. Shapiro.  Statistical Inference of Stochastic Optimization Problems , 2000 .

[12]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[13]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[14]  R. Tyrrell Rockafellar,et al.  Asymptotic Theory for Solutions in Statistical Estimation and Stochastic Programming , 1993, Math. Oper. Res..

[15]  E. Chong,et al.  Optimization of queues using an infinitesimal perturbation analysis-based stochastic algorithm with general update times , 1993 .

[16]  A. Shapiro.  Simulation-based optimization—convergence analysis and statistical inference , 1996 .

[17]  David P. Morton,et al.  Monte Carlo bounding techniques for determining solution quality in stochastic programs , 1999, Oper. Res. Lett..

[18]  P. J. Huber.  The behavior of maximum likelihood estimates under nonstandard conditions , 1967 .

[19]  R. Rubinstein,et al.  Optimization of static simulation models by the score function method , 1990 .

[20]  Charles Leake,et al.  Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method , 1994 .

[21]  R. Wets,et al.  Stochastic programming , 1989 .

[22]  N. L. Johnson,et al.  Linear Statistical Inference and Its Applications , 1966 .

[23]  G. Infanger,et al.  Planning under uncertainty solving large-scale stochastic linear programs , 1992 .

[24]  Jason H. Goodfriend,et al.  Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method , 1995 .

[25]  李幼升,et al.  Ph , 1989 .

[26]  A. Wald.  Note on the Consistency of the Maximum Likelihood Estimate , 1949 .

[27]  E. Beale.  ON MINIMIZING A CONVEX FUNCTION SUBJECT TO LINEAR INEQUALITIES , 1955 .

[28]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[29]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[30]  R. Muirhead.  Aspects of Multivariate Statistical Theory , 1982, Wiley Series in Probability and Statistics.

[31]  P. Glynn,et al.  Stochastic optimization by simulation: numerical experiments with the M / M /1 queue in steady-state , 1994 .

[32]  C. Geyer,et al.  Constrained Monte Carlo Maximum Likelihood for Dependent Data , 1992 .

[33]  Alexander Shapiro,et al.  Asymptotic Behavior of Optimal Solutions in Stochastic Programming , 1993, Math. Oper. Res..

[34]  Alexander Shapiro,et al.  Asymptotic analysis of stochastic programs , 1991, Ann. Oper. Res..

[35]  J. Dupacová,et al.  ASYMPTOTIC BEHAVIOR OF STATISTICAL ESTIMATORS AND OF OPTIMAL SOLUTIONS OF STOCHASTIC OPTIMIZATION PROBLEMS , 1988 .

[36]  Alan J. King,et al.  Generalized Delta Theorems for Multivalued Mappings and Measurable Selections , 1989, Math. Oper. Res..

[37]  H. Chernoff.  On the Distribution of the Likelihood Ratio , 1954 .

[38]  D. Aldous.  The Central Limit Theorem for Real and Banach Valued Random Variables , 1981 .

[39]  J. Frédéric Bonnans,et al.  Perturbation Analysis of Optimization Problems , 2000, Springer Series in Operations Research.