Generalized Resolvents and Harris Recurrence of Markov Processes

In this paper we consider a φ-irreducible continuous parameter Markov process Φ whose state space is a general topological space. The recurrence and Harris recurrence structure of Φ is developed in terms of generalized forms of resolvent chains, where we allow statemodulated resolvents and embedded chains with arbitrary sampling distributions. We show that the recurrence behavior of such generalized resolvents classifies the behavior of the continuous time process; from this we prove that hitting times on the small sets of a generalized resolvent chain provide criteria for, successively, (i) Harris recurrence of Φ (ii) the existence of an invariant probability measure π (or positive Harris recurrence of Φ) and (iii) the finiteness of π(f) for arbitrary f .

[1]  R. Khas'minskii.  Ergodic Properties of Recurrent Diffusion Processes and Stabilization of the Solution to the Cauchy Problem for Parabolic Equations , 1960 .

[2]  J. Azema,et al.  Mesure invariante sur les classes récurrentes des processus de Markov , 1967 .

[3]  J. Azema,et al.  Propriétés relatives des processus de Markov récurrents , 1969 .

[4]  J. Bony.  Principe du maximum, inégalité de Harnack et unicité du problème de Cauchy pour les opérateurs elliptiques dégénérés , 1969 .

[5]  B. Roynette,et al.  Processus de diffusion associé à un opérateur elliptique dégénéré , 1971 .

[6]  S. Orey.  Lecture Notes on Limit Theorems for Markov Chain Transition Probabilities , 1971 .

[7]  J. Neveu.  Potentiel markovien récurrent des chaînes de Harris , 1972 .

[8]  M. Brancovan.  Quelques propriétés des résolvantes récurrentes au sens de Harris , 1973 .

[9]  R. Tweedie.  Criteria for classifying general Markov chains , 1976, Advances in Applied Probability.

[10]  The recurrence structure of general Markov processes , 1979, Advances in Applied Probability.

[11]  R. Tweedie,et al.  The recurrence structure of general Markov processes , 1979, Advances in Applied Probability.

[12]  R. Getoor.  Transience and recurrence of Markov processes , 1980 .

[13]  E. Nummelin.  General irreducible Markov chains and non-negative operators: Preface , 1984 .

[14]  W. Kliemann.  Recurrence and invariant measures for degenerate diffusions , 1987 .

[15]  国田 寛.  Stochastic flows and stochastic differential equations , 1990 .

[16]  Joanna Mitro.  General theory of markov processes , 1991 .

[17]  S. Meyn,et al.  Stability of Markovian processes I: criteria for discrete-time Chains , 1992, Advances in Applied Probability.

[18]  S. Meyn,et al.  Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes , 1993, Advances in Applied Probability.

[19]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[20]  S. Meyn,et al.  Stability of Markovian processes II: continuous-time processes and sampled chains , 1993, Advances in Applied Probability.

[21]  Avishai Mandelbaum,et al.  On Harris Recurrence in Continuous Time , 1994, Math. Oper. Res..

[22]  Sean P. Meyn,et al.  Stability of Generalized Jackson Networks , 1994 .