Long-run risk sensitive dyadic impulse control

In this paper long-run risk sensitive optimisation problem is studied with dyadic impulse control applied to continuous-time Feller-Markov process. In contrast to the existing literature, focus is put on unbounded and non-uniformly ergodic case by adapting the weight norm approach. In particular, it is shown how to combine geometric drift with local minorisation property in order to extend local span-contraction approach when the process as well as the linked reward/cost functions are unbounded. For any predefined risk-aversion parameter, the existence of solution to suitable Bellman equation is shown and linked to the underlying stochastic control problem. For completeness, examples of uncontrolled processes that satisfy the geometric drift assumption are provided.

[1]  U. Rieder,et al.  Markov Decision Processes with Applications to Finance , 2011 .

[2]  L. Stettner,et al.  On Risk-Sensitive Ergodic Impulsive Control of Markov Processes , 2002 .

[3]  Daniel Hernández-Hernández,et al.  Successive approximations in partially observable controlled Markov chains with risk-sensitive average criterion , 2005 .

[4]  W. Fleming,et al.  Risk-Sensitive Control on an Infinite Time Horizon , 1995 .

[5]  M. Robin,et al.  Contrôle impulsionnel des processus de Markov , 1978 .

[6]  Mark H. A. Davis.  Piecewise‐Deterministic Markov Processes: A General Class of Non‐Diffusion Stochastic Models , 1984 .

[7]  M. Robin.  Long-term average cost control problems for continuous time Markov processes: A survey , 1983 .

[8]  Ibtissam Hdhiri,et al.  Risk sensitive impulse control of non-Markovian processes , 2011, Math. Methods Oper. Res..

[9]  Hans U. Gerber,et al.  An introduction to mathematical risk theory , 1982 .

[10]  A Remark on Impulse Control Problems with Risk-sensitive Criteria , 2007 .

[11]  M. Robin.  On Some Impulse Control Problems with Long Run Average Cost , 1981 .

[12]  Łukasz Stettner,et al.  On impulsive control with long run average cost criterion , 1983 .

[13]  Klaus Obermayer,et al.  A Unified Framework for Risk-sensitive Markov Decision Processes with Finite State and Action Spaces , 2011, ArXiv.

[14]  Lukasz Stettner,et al.  Risk sensitive portfolio optimization , 1999, Math. Methods Oper. Res..

[15]  Wolfgang J. Runggaldier,et al.  Connections between stochastic control and dynamic games , 1996, Math. Control. Signals Syst..

[16]  Lukasz Stettner,et al.  Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon , 1999, SIAM J. Control. Optim..

[17]  D. Hernández-Hernández,et al.  Vanishing discount approximations in controlled Markov chains with risk-sensitive average criterion , 2017, Advances in Applied Probability.

[18]  Patrick Cheridito,et al.  RISK MEASURES ON ORLICZ HEARTS , 2009 .

[19]  Lukasz Stettner,et al.  Impulse Control Maximizing Average Cost per Unit Time: A Nonuniformly Ergodic Case , 2016, SIAM J. Control. Optim..

[20]  U. Rieder,et al.  Zero-sum Risk-Sensitive Stochastic Games , 2016, 1604.01896.

[21]  Marcin Pitera,et al.  Long run risk sensitive portfolio with general factors , 2015, Math. Methods Oper. Res..

[22]  Jonathan C. Mattingly,et al.  Yet Another Look at Harris’ Ergodic Theorem for Markov Chains , 2008, 0810.2777.

[23]  N. Bäuerle,et al.  Stochastic Orders and Risk Measures: Consistency and Bounds , 2006 .

[24]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .