Discrete-Time Approximation of Risk-Averse Control Problems for Diffusion Processes

We consider optimal control problems for diffusion processes, where the objective functional is defined by a time-consistent dynamic risk measure. We focus on coherent risk measures defined by $g$-evaluations. For such problems, we construct a family of time and space perturbed systems with piecewise-constant control functions. We obtain a regularized optimal value function by a special mollification procedure. This allows us to establish a bound on the difference between the optimal value functions of the original problem and of the problem with piecewise-constant controls.

[1]  Roger J. A. Laeven,et al.  Robust Portfolio Choice and Indifference Valuation , 2014, Math. Oper. Res..

[2]  Marco Frittelli,et al.  Dynamic convex risk measures , 2004 .

[3]  Juan Li,et al.  Optimal Control Problems of Fully Coupled FBSDEs and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 2013, SIAM J. Control. Optim..

[4]  Andrzej Ruszczynski,et al.  Risk-averse dynamic programming for Markov decision processes , 2010, Math. Program..

[5]  Andrzej Ruszczynski,et al.  A Risk-Averse Analog of the Hamilton-Jacobi-Bellman Equation , 2015, SIAM Conf. on Control and its Applications.

[6]  N. El Karoui,et al.  Pricing, Hedging and Optimally Designing Derivatives via Minimization of Risk Measures , 2007, 0708.0948.

[7]  Alexander Schied,et al.  Convex measures of risk and trading constraints , 2002, Finance Stochastics.

[8]  Özlem Çavus,et al.  Risk-Averse Control of Undiscounted Transient Markov Models , 2012, SIAM J. Control. Optim..

[9]  M. Quenez,et al.  BSDEs with jumps, optimization and applications to dynamic risk measures , 2013 .

[10]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[11]  Huyen Pham,et al.  Continuous-time stochastic control and optimization with financial applications / Huyen Pham , 2009 .

[12]  S. Peng,et al.  Filtration-consistent nonlinear expectations and related g-expectations , 2002 .

[13]  Emanuela Rosazza Gianin,et al.  Risk measures via g-expectations , 2006 .

[14]  F. Antonelli,et al.  Backward-Forward Stochastic Differential Equations , 1993 .

[15]  N. Karoui,et al.  Optimal derivatives design under dynamic risk measures , 2004 .

[16]  Alexander Shapiro,et al.  Conditional Risk Mappings , 2005, Math. Oper. Res..

[17]  M. Stadje.  Extending dynamic convex risk measures from discrete time to continuous time: A convergence approach☆ , 2010 .

[18]  Patrick Cheridito,et al.  COMPOSITION OF TIME-CONSISTENT DYNAMIC MONETARY RISK MEASURES IN DISCRETE TIME , 2011 .

[19]  M. Frittelli,et al.  Putting order in risk measures , 2002 .

[20]  É. Pardoux,et al.  Forward-backward stochastic differential equations and quasilinear parabolic PDEs , 1999 .

[21]  S. Peng.  Nonlinear Expectations, Nonlinear Evaluations and Risk Measures , 2004 .

[22]  Bernt Øksendal,et al.  Forward–Backward Stochastic Differential Games and Stochastic Control under Model Uncertainty , 2014, J. Optim. Theory Appl..

[23]  Jocelyne Bion-Nadal,et al.  Dynamic risk measures: Time consistency and risk measures from BMO martingales , 2008, Finance Stochastics.

[24]  Bernt Øksendal,et al.  Maximum Principles for Optimal Control of Forward-Backward Stochastic Differential Equations with Jumps , 2009, SIAM J. Control. Optim..

[25]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[26]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[27]  W. Marsden.  I and J , 2012 .

[28]  S. Peng,et al.  Backward stochastic differential equations and quasilinear parabolic partial differential equations , 1992 .

[29]  J. Yong.  Finding adapted solutions of forward–backward stochastic differential equations: method of continuation , 1997 .

[30]  Giacomo Scandolo,et al.  Conditional and dynamic convex risk measures , 2005, Finance Stochastics.

[31]  Liu Qie-gen.  Adapted solutions of backward stochastic differential equations driven by general martingale under non-Lipschitz condition , 2013 .

[32]  Philippe Artzner,et al.  Coherent Measures of Risk , 1999 .

[33]  Freddy Delbaen,et al.  Representation of the penalty term of dynamic concave utilities , 2008, Finance Stochastics.

[34]  N. Krylov,et al.  Approximating Value Functions for Controlled Degenerate Diffusion Processes by Using Piece-Wise Constant Policies , 1999 .

[35]  Alexander Shapiro,et al.  Optimization of Convex Risk Functions , 2006, Math. Oper. Res..

[36]  H. Föllmer,et al.  Convex risk measures and the dynamics of their penalty functions , 2006 .

[37]  B. Delyon,et al.  On the robustness of backward stochastic differential equations , 2002 .

[38]  M. Kobylanski.  Backward stochastic differential equations and partial differential equations with quadratic growth , 2000 .

[39]  S. Peng,et al.  Fully Coupled Forward-Backward Stochastic Differential Equations and Applications to Optimal Control , 1999 .

[40]  M. Frittelli,et al.  RISK MEASURES AND CAPITAL REQUIREMENTS FOR PROCESSES , 2006 .

[41]  Frank Riedel,et al.  Dynamic Coherent Risk Measures , 2003 .

[42]  F. Delbaen,et al.  Dynamic Monetary Risk Measures for Bounded Discrete-Time Processes , 2004, math/0410453.

[43]  J. Ma,et al.  Forward-Backward Stochastic Differential Equations and their Applications , 2007 .

[44]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[45]  Andrzej Ruszczynski,et al.  Dynamic Risk Measures for Finite-State Partially Observable Markov Decision Problems , 2015, SIAM Conf. on Control and its Applications.

[46]  Terry J. Lyons,et al.  Stochastic finance. an introduction in discrete time , 2004 .