Time consistency and risk averse dynamic decision models: Definition, interpretation and practical consequences

This paper aims at resolving a major obstacle to practical usage of time-consistent risk-averse decision models. The recursive objective function, generally used to ensure time consistency, is complex and has no clear/direct interpretation. Practitioners rather choose a simpler and more intuitive formulation, even though it may lead to a time inconsistent policy. Based on rigorous mathematical foundations, we impel practical usage of time consistent models as we provide practitioners with an intuitive economic interpretation for the referred recursive objective function. We also discourage time-inconsistent models by arguing that the associated policies are sub-optimal. We developed a new methodology to compute the sub-optimality gap associated with a time-inconsistent policy, providing practitioners with an objective method to quantify practical consequences of time inconsistency. Our results hold for a quite general class of problems and we choose, without loss of generality, a CVaR-based portfolio selection application to illustrate the developed concepts.

[1]  Alexandre Street,et al.  On the Conditional Value-at-Risk probability-dependent utility function , 2010 .

[2]  Csaba I. Fábián,et al.  Algorithms for handling CVaR-constraints in dynamic stochastic programming models with applications to finance , 2008 .

[3]  Patrick Cheridito,et al.  Recursiveness of indifference prices and translation-invariant preferences , 2009 .

[4]  Werner Römisch,et al.  Sampling-Based Decomposition Methods for Multistage Stochastic Programs Based on Extended Polyhedral Risk Measures , 2012, SIAM J. Optim..

[5]  Philippe Artzner,et al.  Coherent Measures of Risk , 1999 .

[6]  Berend Roorda,et al.  Time Consistency Conditions for Acceptability Measures, with an Application to Tail Value at Risk , 2007 .

[7]  P. Krokhmal,et al.  Portfolio optimization with conditional value-at-risk objective and constraints , 2001 .

[8]  Maria Grazia Speranza,et al.  Conditional value at risk and related linear programming models for portfolio optimization , 2007, Ann. Oper. Res..

[9]  Alexander Shapiro,et al.  Risk neutral and risk averse Stochastic Dual Dynamic Programming method , 2013, Eur. J. Oper. Res..

[10]  Alexander Shapiro,et al.  On a time consistency concept in risk averse multistage stochastic programming , 2009, Oper. Res. Lett..

[11]  Bartosz Sawik Bi-Criteria Portfolio Optimization Models with Percentile and Symmetric Risk Measures by Mathematical Programming , 2012 .

[12]  Hua He,et al.  Optimal Dynamic Trading Strategies with Risk Limits , 2001, Oper. Res..

[13]  Frank Riedel,et al.  Dynamic Coherent Risk Measures , 2003 .

[14]  Alexander Shapiro,et al.  Analysis of stochastic dual dynamic programming method , 2011, Eur. J. Oper. Res..

[15]  Nicole Bäuerle,et al.  Dynamic mean-risk optimization in a binomial model , 2009, Math. Methods Oper. Res..

[16]  Jocelyne Bion-Nadal,et al.  Dynamic risk measures: Time consistency and risk measures from BMO martingales , 2008, Finance Stochastics.

[17]  Alexander Shapiro,et al.  Solving multistage asset investment problems by the sample average approximation method , 2006, Math. Program..

[18]  Andrzej Ruszczynski,et al.  Risk-averse dynamic programming for Markov decision processes , 2010, Math. Program..

[19]  Alexander Shapiro,et al.  Conditional Risk Mappings , 2005, Math. Oper. Res..

[20]  R. Tyrrell Rockafellar,et al.  Scenarios and Policy Aggregation in Optimization Under Uncertainty , 1991, Math. Oper. Res..

[21]  Raimund M. Kovacevic Time consistency and information monotonicity of multiperiod acceptability functionals , 2009 .

[22]  R. Rockafellar,et al.  Optimization of conditional value-at risk , 2000 .

[23]  Werner Römisch,et al.  SDDP for multistage stochastic linear programs based on spectral risk measures , 2012, Oper. Res. Lett..

[24]  Vitor L. de Matos,et al.  Dynamic sampling algorithms for multi-stage stochastic programs with risk aversion , 2012, Eur. J. Oper. Res..

[25]  M. V. F. Pereira,et al.  Multi-stage stochastic optimization applied to energy planning , 1991, Math. Program..

[26]  Erlon Cristian Finardi,et al.  On Solving Multistage Stochastic Programs with Coherent Risk Measures , 2013, Oper. Res..

[27]  Giacomo Scandolo,et al.  Conditional and dynamic convex risk measures , 2005, Finance Stochastics.

[28]  Jerzy A. Filar,et al.  Time Consistent Dynamic Risk Measures , 2006, Math. Methods Oper. Res..

[29]  F. Delbaen,et al.  Dynamic Monetary Risk Measures for Bounded Discrete-Time Processes , 2004, math/0410453.