Unbiased Monte Carlo for optimization and functions of expectations via multi-level randomization

We present general principles for the design and analysis of unbiased Monte Carlo estimators for quantities such as α = g(E (X)), where E (X) denotes the expectation of a (possibly multidimensional) random variable X, and g(·) is a given deterministic function. Our estimators possess finite work-normalized variance under mild regularity conditions such as local twice differentiability of g(·) and suitable growth and finite-moment assumptions. We apply our estimator to various settings of interest, such as optimal value estimation in the context of Sample Average Approximations, and unbiased steady-state simulation of regenerative processes. Other applications include unbiased estimators for particle filters and conditional expectations.

[1]  B. V. Bahr.  On the Convergence of Moments in the Central Limit Theorem , 1965 .

[2]  Sلأren Asmussen,et al.  Applied Probability and Queues , 1989 .

[3]  Ward Whitt,et al.  The Asymptotic Efficiency of Simulation Estimators , 1992, Oper. Res..

[4]  David P. Morton,et al.  Monte Carlo bounding techniques for determining solution quality in stochastic programs , 1999, Oper. Res. Lett..

[5]  Stefan Heinrich,et al.  Multilevel Monte Carlo Methods , 2001, LSSC.

[6]  Tim Hesterberg,et al.  Monte Carlo Strategies in Scientific Computing , 2002, Technometrics.

[7]  Alexander Shapiro,et al.  The Sample Average Approximation Method for Stochastic Discrete Optimization , 2002, SIAM J. Optim..

[8]  P. Moral.  Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[9]  Peter W. Glynn,et al.  Stochastic Simulation: Algorithms and Analysis , 2007 .

[10]  Michael B. Giles,et al.  Multilevel Monte Carlo Path Simulation , 2008, Oper. Res..

[11]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[12]  Don McLeish,et al.  A general method for debiasing a Monte Carlo estimator , 2010, Monte Carlo Methods Appl..

[13]  Peter W. Glynn,et al.  A new approach to unbiased estimation for SDE's , 2012, Proceedings Title: Proceedings of the 2012 Winter Simulation Conference (WSC).

[14]  C. Reisinger,et al.  Multilevel Simulation of Functionals of Bernoulli Random Variables with Application to Basket Credit Derivatives , 2012, 1211.0707.

[15]  R. Pasupathy,et al.  A Guide to Sample Average Approximation , 2015 .

[16]  Peter W. Glynn,et al.  Unbiased Estimation with Square Root Convergence for SDE Models , 2015, Oper. Res..

[17]  F. Al-Shamali,et al.  Author Biographies. , 2015, Journal of social work in disability & rehabilitation.

[18]  Nan Chen,et al.  Unbiased Monte Carlo computation of smooth functions of expectations via Taylor expansions , 2015, 2015 Winter Simulation Conference (WSC).