A penalty scheme and policy iteration for nonlocal HJB variational inequalities with monotone drivers

We propose a class of numerical schemes for nonlocal HJB variational inequalities (HJBVIs) with monotone drivers. The solution and free boundary of the HJBVI are constructed from a sequence of penalized equations, for which a continuous dependence result is derived and the penalization error is estimated. The penalized equation is then discretized by a class of semi-implicit monotone approximations. We present a novel analysis technique for the well-posedness of the discrete equation, and demonstrate the convergence of the scheme, which subsequently gives a constructive proof for the existence of a solution to the penalized equation and variational inequality. We further propose an efficient iterative algorithm with local superlinear convergence for solving the discrete equation. Numerical experiments are presented for an optimal investment problem under ambiguity and a recursive consumption-portfolio allocation problem.

[1]  Wang Hai-bing,et al.  High-order essentially non-oscillatory schemes for Hamilton-Jacobi equations , 2006 .

[2]  N. El Karoui,et al.  CASH SUBADDITIVE RISK MEASURES AND INTEREST RATE AMBIGUITY , 2007, 0710.4106.

[3]  Christoph Reisinger,et al.  Approximation Schemes for Mixed Optimal Stopping and Control Problems with Nonlinear Expectations and Jumps , 2018, Applied Mathematics & Optimization.

[4]  Christoph Reisinger,et al.  Boundary Treatment and Multigrid Preconditioning for Semi-Lagrangian Schemes Applied to Hamilton–Jacobi–Bellman Equations , 2017, J. Sci. Comput..

[5]  H. Kushner.  Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[6]  Larry G. Epstein.  Advances in Economic Theory: Behavior under risk: recent developments in theory and applications , 1993 .

[7]  Sam D. Howison,et al.  The Effect of Nonsmooth Payoffs on the Penalty Approximation of American Options , 2010, SIAM J. Financial Math..

[8]  K. Kunisch,et al.  Parabolic variational inequalities : The Lagrange multiplier approach , 2006 .

[9]  Qi S. Zhang,et al.  Dynamic Programming Principle for Stochastic Recursive Control Problem with Non-Lipschitz Aggregator and Associated Hamilton-Jacobi-Bellman Equation , 2015 .

[10]  Xiaojun Chen,et al.  Smoothing Methods and Semismooth Methods for Nondifferentiable Operator Equations , 2000, SIAM J. Numer. Anal..

[11]  M. Quenez,et al.  BSDEs with jumps, optimization and applications to dynamic risk measures , 2013 .

[12]  Kenneth H. Karlsen,et al.  Difference-Quadrature Schemes for Nonlinear Degenerate Parabolic Integro-PDE , 2009, SIAM J. Numer. Anal..

[13]  Indranil Chowdhury,et al.  On the Rate of Convergence for Monotone Numerical Schemes for Nonlocal Isaacs Equations , 2017, SIAM J. Numer. Anal..

[14]  Shuilian Xie,et al.  A semismooth Newton method for a kind of HJB equation , 2017, Comput. Math. Appl..

[15]  Kazufumi Ito,et al.  Lagrange Multiplier Approach with Optimized Finite Difference Stencils for Pricing American Options under Stochastic Volatility , 2009, SIAM J. Sci. Comput..

[16]  R. Varga.  On diagonal dominance arguments for bounding ‖A-1‖∞ , 1976 .

[17]  M. Royer.  Backward stochastic differential equations with jumps and related non-linear expectations , 2006 .

[18]  Hai-ping Shi.  Backward stochastic differential equations in finance , 2010 .

[19]  Kazufumi Ito,et al.  The Primal-Dual Active Set Strategy as a Semismooth Newton Method , 2002, SIAM J. Optim..

[20]  P. Lions,et al.  Two approximations of solutions of Hamilton-Jacobi equations , 1984 .

[21]  N. El Karoui,et al.  Numerical Methods in Finance: Reflected Backward SDEs and American Options , 1997 .

[22]  M. Quenez,et al.  Mixed generalized Dynkin game and stochastic control in a Markovian framework , 2015, 1508.02742.

[23]  Agnès Sulem,et al.  A Weak Dynamic Programming Principle for Combined Optimal Stopping/Stochastic Control with Ef-expectations , 2016, SIAM J. Control. Optim..

[24]  Espen R. Jakobsen,et al.  ON THE RATE OF CONVERGENCE OF APPROXIMATION SCHEMES FOR BELLMAN EQUATIONS ASSOCIATED WITH OPTIMAL STOPPING TIME PROBLEMS , 2003 .

[25]  Kristian Debrabant,et al.  Semi-Lagrangian schemes for linear and fully non-linear diffusion equations , 2009, Math. Comput..

[26]  Consumption-Portfolio Optimization with Recursive Utility in Incomplete Markets , 2011 .

[27]  Christoph Reisinger,et al.  A Penalty Method for the Numerical Solution of Hamilton-Jacobi-Bellman (HJB) Equations in Finance , 2011, SIAM J. Numer. Anal..

[28]  E. Jakobsen,et al.  CONTINUOUS DEPENDENCE ESTIMATES FOR VISCOSITY SOLUTIONS OF INTEGRO-PDES , 2005 .

[29]  Peter A. Forsyth,et al.  Analysis of a penalty method for pricing a guaranteed minimum withdrawal benefit (GMWB) , 2012 .

[30]  Hasnaa Zidani,et al.  Some Convergence Results for Howard's Algorithm , 2009, SIAM J. Numer. Anal..

[31]  G. Barles,et al.  Convergence of approximation schemes for fully nonlinear second order equations , 1990, 29th IEEE Conference on Decision and Control.