A bias-corrected Least-Squares Monte Carlo for solving multi-period utility models

The Least-Squares Monte Carlo (LSMC) method has gained popularity in recent years due to its ability to handle multi-dimensional stochastic control problems, including problems with state variables affected by control. However, when applied to the stochastic control problems in the multi-period expected utility models, such as finding optimal decisions in life-cycle expected utility models, the regression fit tends to contain errors which accumulate over time and typically blow up the numerical solution. In this paper we propose to transform the value function of the problems to improve the regression fit, and then using either the smearing estimate or smearing estimate with controlled heteroskedasticity to avoid the re-transformation bias in the estimates of the conditional expectations calculated in the LSMC algorithm. We also present and utilise recent improvements in the LSMC algorithms such as control randomisation with policy iteration to avoid accumulation of regression errors over time. Presented numerical examples demonstrate that transformation method leads to an accurate solution. In addition, in the forward simulation stage of the control randomisation algorithm, we propose a re-sampling of the state and control variables in their full domain at each time t and then simulating corresponding state variable at $$t+1$$ , to improve the exploration of the state space that also appears to be critical to obtain a stable and accurate solution for the expected utility models.

[1]  P. Glasserman,et al.  A Sotchastic Mesh Method for Pricing High-Dimensional American Options , 2004 .

[2]  Huyên Pham,et al.  A Probabilistic Numerical Method for Optimal Multiple Switching Problems in High Dimension , 2014, SIAM J. Financial Math..

[3]  Xiaolin Luo,et al.  A Unified Pricing of Variable Annuity Guarantees Under the Optimal Stochastic Control Framework , 2016, 1605.00339.

[4]  P. Shevchenko,et al.  Assessment of Policy Changes to Means-Tested Age Pension Using the Expected Utility Model: Implication for Decisions in Retirement , 2017 .

[5]  K. Hamza,et al.  Dynamic portfolio optimization with liquidity cost and market impact: a simulation-and-regression approach , 2016, Quantitative Finance.

[6]  Lifetime Investment and Consumption Using a Defined-Contribution Pension Scheme , 2012 .

[7]  Gordon K. Smyth,et al.  Generalized linear models with varying dispersion , 1989 .

[8]  Nicola Secomandi,et al.  Relationship between least squares Monte Carlo and approximate linear programming , 2017, Oper. Res. Lett..

[9]  A. Shiryaev,et al.  ON AN EFFECTIVE SOLUTION OF THE OPTIMAL STOPPING PROBLEM FOR RANDOM WALKS , 2004 .

[10]  H. Pham,et al.  A probabilistic numerical method for optimal multiple switching problem and application to investments in electricity generation , 2012, 1210.8175.

[11]  Lorenzo Garlappi,et al.  Solving Consumption and Portfolio Choice Problems: The State Variable Decomposition Method , 2010 .

[12]  A. Harvey Estimating Regression Models with Multiplicative Heteroscedasticity , 1976 .

[13]  Erick Delage,et al.  Dynamic portfolio choice: a simulation-and-regression approach , 2017 .

[14]  Ulrich Stadtmüller,et al.  Estimation of Heteroscedasticity in Regression Analysis , 1987 .

[15]  Lars Stentoft,et al.  A simulation-and-regression approach for stochastic dynamic programs with endogenous state variables , 2011, Comput. Oper. Res..

[16]  D. Ruppert,et al.  Transformation and Weighting in Regression , 1988 .

[17]  N. Duan Smearing Estimate: A Nonparametric Retransformation Method , 1983 .

[18]  John N. Tsitsiklis,et al.  Regression methods for pricing complex American-style options , 2001, IEEE Trans. Neural Networks.

[19]  H. Pham,et al.  Discrete time approximation of fully nonlinear HJB equations via BSDEs with nonpositive jumps , 2013, 1311.4505.

[20]  S. Ross,et al.  Option pricing: A simplified approach☆ , 1979 .

[21]  Paul Glasserman,et al.  Simulation for American Options: Regression Now or Regression Later? , 2004 .

[22]  David Blake,et al.  Age-Dependent Investing: Optimal Funding and Investment Strategies in Defined Contribution Pension Plans When Members are Rational Life Cycle Financial Planners , 2011 .

[23]  Huazhen Lin,et al.  Non‐parametric heteroscedastic transformation regression models for skewed data with an application to health care costs , 2008 .

[24]  Francis A. Longstaff,et al.  Valuing American Options by Simulation: A Simple Least-Squares Approach , 2001 .

[25]  Huyên Pham,et al.  A numerical algorithm for fully nonlinear HJB equations: An approach by control randomization , 2013, Monte Carlo Methods Appl..

[26]  Geoffrey H. Kingston,et al.  Annuitization and asset allocation with HARA utility , 2005, Journal of Pension Economics and Finance.

[27]  O. Ba Modeling Transformed Health Care Cost with Unknown Heteroskedasticity , 2007 .

[28]  Denis Belomestny,et al.  Regression Methods for Stochastic Control Problems and Their Convergence Analysis , 2009, SIAM J. Control. Optim..

[29]  Nicola Secomandi,et al.  Comparison of least squares Monte Carlo methods with applications to energy real options , 2017, Eur. J. Oper. Res..

[30]  A. Novikov,et al.  Optimal Consumption, Investment and Housing with Means-Tested Public Pension in Retirement , 2016, 1606.08984.

[31]  Denis Belomestny,et al.  Pricing Bermudan options using nonparametric regression: optimal rates of convergence for lower estimates , 2009, 0907.5599.

[32]  Frank J. Fabozzi,et al.  An improved least squares Monte Carlo valuation method based on heteroscedasticity , 2017, Eur. J. Oper. Res..

[33]  Pavel V. Shevchenko,et al.  A unified pricing of variable annuity guarantees under the optimal stochastic control framework , 2016 .

[34]  Peter D. Hoff,et al.  A Covariance Regression Model , 2011, 1102.5721.