Some Large Deviations Results for Latin Hypercube Sampling

Large deviations theory is a well-studied area which has shown to have numerous applications. Broadly speaking, the theory deals with analytical approximations of probabilities of certain types of rare events. Moreover, the theory has recently proven instrumental in the study of complexity of methods that solve stochastic optimization problems by replacing expectations with sample averages (such an approach is called sample average approximation in the literature). The typical results, however, assume that the underlying random variables are either i.i.d. or exhibit some form of Markovian dependence. Our interest in this paper is to study the application of large deviations results in the context of estimators built with Latin Hypercube sampling, a well-known sampling technique for variance reduction. We show that a large deviation principle holds for Latin Hypercube sampling for functions in one dimension and for separable multi-dimensional functions. Moreover, the upper bound of the probability of a large deviation in these cases is no higher under Latin Hypercube sampling than it is under Monte Carlo sampling. We extend the latter property to functions that are monotone in each argument. Numerical experiments illustrate the theoretical results presented in the paper.

[1]  Stephen M. Robinson,et al.  Analysis of Sample-Path Optimization , 1996, Math. Oper. Res..

[2]  John R. Birge,et al.  Introduction to Stochastic Programming , 1997 .

[3]  Akimichi Takemura,et al.  On reduction of finite-sample variance by extended Latin hypercube sampling , 2000 .

[4]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[5]  Michael C. Fu,et al.  Probabilistic Error Bounds for Simulation Quantile Estimators , 2003, Manag. Sci..

[6]  R. Tyrrell Rockafellar,et al.  Asymptotic Theory for Solutions in Statistical Estimation and Stochastic Programming , 1993, Math. Oper. Res..

[7]  Alexander Shapiro,et al.  On complexity of multistage stochastic programs , 2006, Oper. Res. Lett..

[8]  Roger J.-B. Wets,et al.  Probabilistic bounds (via large deviations) for the solutions of stochastic programming problems , 1995, Ann. Oper. Res..

[9]  M. Stein Large sample properties of simulations using latin hypercube sampling , 1987 .

[10]  Alexander Shapiro,et al.  The Sample Average Approximation Method for Stochastic Discrete Optimization , 2002, SIAM J. Optim..

[11]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[12]  Alexander Shapiro,et al.  Conditioning of convex piecewise linear stochastic programs , 2002, Math. Program..

[13]  Alexander Shapiro,et al.  Asymptotic Behavior of Optimal Solutions in Stochastic Programming , 1993, Math. Oper. Res..

[14]  Alexander Shapiro,et al.  On Complexity of Stochastic Programming Problems , 2005 .

[15]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[16]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[17]  A. Shapiro,et al.  On rate of convergence of Monte Carlo approximations of stochastic programs , 1998 .

[18]  Chun-Hung Chen,et al.  Convergence Properties of Two-Stage Stochastic Programming , 2000 .

[19]  Alexander Shapiro,et al.  The empirical behavior of sampling methods for stochastic programming , 2006, Ann. Oper. Res..

[20]  Robert Bartle,et al.  The Elements of Real Analysis , 1977, The Mathematical Gazette.

[21]  William T. Ziemba,et al.  Applications of Stochastic Programming , 2005 .

[22]  Bruno Tuffin,et al.  A central limit theorem and improved error bounds for a hybrid-Monte Carlo sequence with applications in computational finance , 2006, J. Complex..

[23]  Alexander Shapiro,et al.  Asymptotic analysis of stochastic programs , 1991, Ann. Oper. Res..

[24]  A. Owen Monte Carlo Variance of Scrambled Net Quadrature , 1997 .

[25]  A. Owen A Central Limit Theorem for Latin Hypercube Sampling , 1992 .

[26]  Alexander Shapiro,et al.  On the Rate of Convergence of Optimal Solutions of Monte Carlo Approximations of Stochastic Programs , 2000, SIAM J. Optim..

[27]  Adam Shwartz,et al.  Large Deviations For Performance Analysis , 2019 .

[28]  Michel Mandjes,et al.  Large Deviations for Performance Analysis: Queues, Communications, and Computing , Adam Shwartz and Alan Weiss (New York: Chapman and Hall, 1995). , 1996, Probability in the Engineering and Informational Sciences.

[29]  Tito Homem-de-Mello On Rates of Convergence for Stochastic Optimization Problems Under Non-I.I.D. Sampling , 2006 .