Improved order 1/4 convergence for piecewise constant policy approximation of stochastic control problems

In N.V. Krylov, Approximating value functions for controlled degenerate diffusion processes by using piece-wise constant policies, Electron. J. Probab., 4(2), 1999, it is proved under standard assumptions that the value functions of controlled diffusion processes can be approximated with order 1/6 error by those with controls which are constant on uniform time intervals. In this note we refine the proof and show that the provable rate can be improved to 1/4, which is optimal in our setting. Moreover, we demonstrate the improvements this implies for error estimates derived by similar techniques for approximation schemes, bringing these in line with the best available results from the PDE literature.

[1]  Guy Barles,et al.  Error Bounds for Monotone Approximation Schemes for Hamilton-Jacobi-Bellman Equations , 2005, SIAM J. Numer. Anal..

[2]  Terry Lyons,et al.  Uncertain volatility and the risk-free synthesis of derivatives , 1995 .

[3]  Maurizio Falcone,et al.  An approximation scheme for the optimal control of diffusion processes , 1995 .

[4]  Formule de trotter et equations de Hamilton-Jacobi-Bellman , 1980 .

[5]  Kristian Debrabant,et al.  Semi-Lagrangian schemes for linear and fully non-linear diffusion equations , 2009, Math. Comput..

[6]  Christoph Reisinger,et al.  Approximation Schemes for Mixed Optimal Stopping and Control Problems with Nonlinear Expectations and Jumps , 2018, Applied Mathematics & Optimization.

[7]  Guy Barles,et al.  On the convergence rate of approximation schemes for Hamilton-Jacobi-Bellman equations , 2002 .

[8]  N. Krylov,et al.  Approximating Value Functions for Controlled Degenerate Diffusion Processes by Using Piece-Wise Constant Policies , 1999 .

[10]  Christoph Reisinger,et al.  Probabilistic error analysis for some approximation schemes to optimal control problems , 2020, Syst. Control. Lett..

[11]  Guy Barles,et al.  Error bounds for monotone approximation schemes for parabolic Hamilton-Jacobi-Bellman equations , 2007, Math. Comput..

[12]  N. Krylov On the rate of convergence of finite-difference approximations for Bellmans equations with variable coefficients , 2000 .

[13]  Christoph Reisinger,et al.  Piecewise constant policy approximations to Hamilton-Jacobi-Bellman equations , 2015, 1503.05864.