Periodicity in Markov renewal theory

In an irreducible Markov renewal process either all states are periodic or none are. In the former case they all have the same period. Periodicity and the period can be determined by direct inspection from the semi-Markov kernel defining the process. The periodicity considerably increases the complexity of the limits in Markov renewal theory especially for transient initial states. Two Markov renewal limit theorems will be given with particular attention to the roles of periodicity and transient states. The results are applied to semi-Markov and semi-regenerative processes.

[1]  Walter L. Smith,et al.  Regenerative stochastic processes , 1955, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[2]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[3]  E. Çinlar.  Markov renewal theory , 1969, Advances in Applied Probability.

[4]  Ronald Pyke,et al.  Limit Theorems for Markov Renewal Processes , 1964 .

[5]  E. Çinlar.  On semi-Markov processes on arbitrary spaces , 1969, Mathematical Proceedings of the Cambridge Philosophical Society.

[6]  J. Yackel.  Limit theorems for semi-Markov processes , 1966 .

[7]  M. Schal,et al.  Markov Renewal Processes with Auxiliary Paths , 1970 .

[8]  J. Neveu,et al.  Mathematical foundations of the calculus of probability , 1965 .