Impulse Control Maximizing Average Cost per Unit Time: A Nonuniformly Ergodic Case

This paper studies maximisation of an average-cost-per-unit-time ergodic functional over impulse strategies controlling a Feller-Markov process. The uncontrolled process is assumed to be ergodic but, unlike the extant literature, the convergence to invariant measure does not have to be uniformly geometric in total variation norm; in particular, we allow for non-uniform geometric or polynomial convergence. Cost of an impulse may be unbounded, e.g., proportional to the distance the process is shifted. We show that the optimal value does not depend on the initial state and provide optimal or $\ve$-optimal strategies.

[1]  Kai Liu.  Stochastic Stability of Differential Equations in Abstract Spaces , 2022 .

[2]  Dariusz Gatarek,et al.  On the compactness method in general ergodic impulsive control of markov processes , 1990 .

[3]  Pierre-Louis Lions,et al.  Quasi-variational inequalities and ergodic impulse control , 1986 .

[4]  Growth Optimal Portfolio Selection Under Proportional Transaction Costs with Obligatory Diversification , 2008, CDC 2008.

[5]  Łukasz Stettner,et al.  On impulsive control with long run average cost criterion , 1983 .

[6]  D. Applebaum.  Lévy Processes and Stochastic Calculus: Preface , 2009 .

[7]  B. Perthame.  Vanishing impulse cost in the quasi-variational inequality for ergodic impulse control , 1988 .

[8]  L. Stettner,et al.  Undiscounted optimal stopping with unbounded rewards , 2016, 1607.06018.

[9]  Lukasz Stettner,et al.  Finite Horizon Optimal Stopping of Time-Discontinuous Functionals with Applications to Impulse Control with Delay , 2010, SIAM J. Control. Optim..

[10]  Alain Bensoussan,et al.  Impulse Control and Quasi-Variational Inequalities , 1984 .

[11]  M. Robin,et al.  Contrôle impulsionnel des processus de Markov , 1978 .

[12]  M. Robin.  Long-term average cost control problems for continuous time Markov processes: A survey , 1983 .

[13]  M. Robin.  On Some Impulse Control Problems with Long Run Average Cost , 1981 .

[14]  L. Stettner,et al.  Infinite horizon stopping problems with (nearly) total reward criteria , 2014, 1401.6905.

[15]  J. Azema,et al.  Mesure invariante sur les classes récurrentes des processus de Markov , 1967 .

[16]  Vivek S. Borkar,et al.  Ergodic Control of Diffusion Processes: Preface , 2011 .

[17]  Mihail Zervos,et al.  Impulse Control of One-Dimensional Ito Diffusions with an Expected and a Pathwise Ergodic Criterion , 2006 .

[18]  On ergodic impulsive control problems , 1986 .

[19]  E. Thorp,et al.  The Kelly Capital Growth Investment Criterion: Theory and Practice , 2011 .

[20]  John J. H. Miller.  On the Stability of Differential Equations , 1972 .