Weakly Chained Matrices, Policy Iteration, and Impulse Control

This work is motivated by numerical solutions to Hamilton--Jacobi--Bellman quasi-variational inequalities (HJBQVIs) associated with combined stochastic and impulse control problems. In particular, we consider (i) direct control, (ii) penalized, and (iii) semi-Lagrangian discretization schemes applied to the HJBQVI problem. Scheme (i) takes the form of a Bellman problem involving an operator which is not necessarily contractive. We consider the well-posedness of the Bellman problem and give sufficient conditions for convergence of the corresponding policy iteration. To do so, we use weakly chained diagonally dominant matrices, which give a graph-theoretic characterization of weakly diagonally dominant M-matrices. We compare schemes (i)--(iii) under the following examples: (a) optimal control of the exchange rate, (b) optimal consumption with fixed and proportional transaction costs, and (c) pricing guaranteed minimum withdrawal benefits in variable annuities. We find that one should abstain from using sche...

[1]  H. Kushner.  Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[2]  Huiling Le,et al.  A Finite Time Horizon Optimal Stopping Problem with Regime Switching , 2010, SIAM J. Control. Optim..

[3]  R. Plemmons.  M-matrix characterizations.I—nonsingular M-matrices , 1977 .

[4]  Peter A. Forsyth,et al.  The Existence of Optimal Bang-Bang Controls for GMxB Contracts , 2015, SIAM J. Financial Math..

[5]  B. Øksendal,et al.  Combined stochastic control and optimal stopping, and application to numerical approximation of combined stochastic and impulse control , 2000 .

[6]  Jean-Philippe Chancelier,et al.  A policy iteration algorithm for fixed point problems with nonexpansive operators , 2007, Math. Methods Oper. Res..

[7]  J. Bramble,et al.  On a Finite Difference Analogue of an Elliptic Boundary Problem which is Neither Diagonally Dominant Nor of Non‐negative Type , 1964 .

[8]  Alain Bensoussan,et al.  Impulse Control and Quasi-Variational Inequalities , 1984 .

[9]  Zhuliang Chen,et al.  A numerical scheme for the impulse control formulation for pricing variable annuities with a guaranteed minimum withdrawal benefit (GMWB) , 2008, Numerische Mathematik.

[10]  K. H. Chew,et al.  A sufficient condition for nonvanishing of determinants , 1974 .

[11]  Subramanian Ramamoorthy,et al.  Applied Stochastic Control of Jump Diffusions , 2011 .

[12]  George Labahn,et al.  A Comparison of Iterated Optimal Stopping and Local Policy Iteration for American Options Under Regime Switching , 2014, J. Sci. Comput..

[13]  G. Barles,et al.  Convergence of approximation schemes for fully nonlinear second order equations , 1990, 29th IEEE Conference on Decision and Control.

[14]  Rama Cont,et al.  A Finite Difference Scheme for Option Pricing in Jump Diffusion and Exponential Lévy Models , 2005, SIAM J. Numer. Anal..

[15]  Peter A. Forsyth,et al.  Hedging Costs for Variable Annuities Under Regime-Switching , 2014 .

[16]  George Labahn,et al.  Inexact arithmetic considerations for direct control and penalty methods: American options under jump diffusion , 2013 .

[17]  Jin Ma,et al.  Backward SDEs with constrained jumps and quasi-variational inequalities , 2008, 0805.4676.

[18]  Erhan Bayraktar,et al.  PRICING ASIAN OPTIONS FOR JUMP DIFFUSION , 2010 .

[19]  F. Zapatero,et al.  Optimal Central Bank Intervention in the Foreign Exchange Market , 1999 .

[20]  P. Forsyth,et al.  Numerical methods for controlled Hamilton-Jacobi-Bellman PDEs in finance , 2007 .

[21]  Bernt Øksendal,et al.  Optimal stochastic intervention control with application to the exchange rate , 1998 .

[22]  R. Seydel.  Existence and uniqueness of viscosity solutions for QVI associated with impulse control of jump-diffusions , 2009 .

[23]  Hasnaa Zidani,et al.  Some Convergence Results for Howard's Algorithm , 2009, SIAM J. Numer. Anal..

[24]  Adam M. Oberman,et al.  Convergent Difference Schemes for Degenerate Elliptic and Parabolic Equations: Hamilton-Jacobi Equations and Free Boundary Problems , 2006, SIAM J. Numer. Anal..

[25]  Thomas S. Salisbury,et al.  Financial valuation of guaranteed minimum withdrawal benefits , 2006 .

[26]  Min Dai,et al.  GUARANTEED MINIMUM WITHDRAWAL BENEFIT IN VARIABLE ANNUITIES , 2007 .

[27]  Christoph Reisinger,et al.  Penalty Methods for the Solution of Discrete HJB Equations - Continuous Control and Obstacle Problems , 2012, SIAM J. Numer. Anal..

[28]  H. -,et al.  Viscosity Solutions of Nonlinear Second Order Elliptic PDEs Associated with Impulse Control Problems II By , 2005 .