Stability of piecewise-deterministic Markov processes

We study a form of stability for a general family of non-diffusion Markov processes, known in the literature as piecewise-deterministic Markov process (PDMP). By stability here we mean the existence of an invariant probability measure for the PDMP. It is shown that the existence of such invariant probability measure is equivalent to the existence of a /spl sigma/-finite invariant measure for a Markov kernel G linked to the resolvent operator U of the PDMP, satisfying a boundedness condition or, equivalently, a Radon-Nikodym derivative. Here we generalize existing results of the literature since we do not require any additional assumptions to establish this equivalence. Moreover, we give sufficient conditions to ensure the existence of such /spl sigma/-finite measure satisfying the boundedness condition. They are mainly based on a modified Foster-Lyapunov criteria for the case in which the Markov chain generated by G is either recurrent or weak Feller. To emphasize the relevance of our results, three examples are studied in Dufour and Costa (1999) and in particular, we are able to generalize the results obtained by Costa (1990) and Davis (1993) on the capacity expansion model.

[1]  Oswaldo Luiz do Valle Costa.  Stationary distributions for piecewise-deterministic Markov processes , 1990 .

[2]  Mark H. A. Davis.  Piecewise‐Deterministic Markov Processes: A General Class of Non‐Diffusion Stochastic Models , 1984 .

[3]  M. Dempster,et al.  Optimal capacity expansion under uncertainty , 1987, Advances in Applied Probability.

[4]  E. Nummelin.  General irreducible Markov chains and non-negative operators: Notes and comments , 1984 .

[5]  Existence and Uniqueness of Fixed Points for Markov Operators and Markov Processes , 1998 .

[6]  E. Nummelin.  General irreducible Markov chains and non-negative operators: List of symbols and notation , 1984 .

[7]  Michael Lin.  Conservative markov processes on a topological space , 1970 .

[8]  Jean B. Lasserre,et al.  Invariant probabilities for Markov chains on a metric space , 1997 .

[9]  Oswaldo Luiz do Valle Costa,et al.  Stability of Piecewise-Deterministic Markov Processes , 1999 .

[10]  Sean P. Meyn,et al.  Asymptotic behavior of stochastic systems possessing Markovian realizations , 1991 .

[11]  S. Meyn.  Ergodic theorems for discrete time stochastic systems using a stochastic lyapunov function , 1989 .

[12]  S. Meyn,et al.  Stability of Markovian processes II: continuous-time processes and sampled chains , 1993, Advances in Applied Probability.

[13]  S. Meyn,et al.  Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes , 1993, Advances in Applied Probability.

[14]  S. Foguel.  The ergodic theory of positive operators on continuous functions , 1973 .

[15]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[16]  J. Azema,et al.  Mesure invariante sur les classes récurrentes des processus de Markov , 1967 .

[17]  J. Dieudonné,et al.  Éléments d'analyse , 1972 .

[18]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.