An alternative approach to the analysis of finite semi-markov and related processes

Let J(t) be a finite semi-Markov process associated with the age process X(t) and the reward process Z(t). Bystudying the probabilistic flow of the trivariate process in its state space, new transform results are obtained. Some known results are then derived directly from these transform results, thereby providing an alternative approach for analysis of semi-Markov and related processes. Some new results are also obtained regarding the reward process Z(t) and its first passage times.

[1]  U. Sumita,et al.  Dynamic Performance Evaluation of Communication/Computer Systems with Highly Reliable Components , 1988, Probability in the Engineering and Informational Sciences.

[2]  Ushio Sumita,et al.  Analysis of fault tolerant computer systems , 1987 .

[3]  The bivariate Laguerre transform and its applications: numerical exploration of bivariate processes , 1985, Advances in Applied Probability.

[4]  Ushio Sumita,et al.  The matrix Laguerre transform , 1984 .

[5]  Tony E. Smith,et al.  A solution condition for complementarity problems: with an application to spatial price equilibrium , 1984 .

[6]  M. D. Beaudry,et al.  Performance-Related Reliability Measures for Computing Systems , 1978, IEEE Transactions on Computers.

[7]  M. Neuts.  Some explicit formulas for the steady-state behavior of the queue with semi-Markovian service times , 1977, Advances in Applied Probability.

[8]  Jozef L. Teugels,et al.  A bibliography on semi-Markov processes , 1976 .

[9]  E. Çinlar.  Exceptional Paper---Markov Renewal Theory: A Survey , 1975 .

[10]  Erhan Çinlar,et al.  Introduction to stochastic processes , 1974 .

[11]  J. Keilson,et al.  A PROCESS WITH CHAIN DEPENDENT GROWTH RATE. PART II: THE RUIN AND ERGODIC PROBLEMS , 1971 .

[12]  J. Keilson,et al.  A process with chain dependent growth rate , 1970, Journal of Applied Probability.

[13]  J. Keilson,et al.  On the Matrix Renewal Function for Markov Renewal Processes , 1969 .

[14]  E. Çinlar.  Markov renewal theory , 1969, Advances in Applied Probability.

[15]  J. Hunter.  On the moments of Markov renewal processes , 1969, Advances in Applied Probability.

[16]  Ronald Pyke,et al.  Estimation of the transition distributions of a Markov renewal process , 1968 .

[17]  J. Teugels.  Exponential ergodicity in Markov renewal processes , 1968, Journal of Applied Probability.

[18]  W. Jewell.  Fluctuations of a renewal-reward process , 1967 .

[19]  M. Neuts,et al.  The Integral of a Step Function Defined on a Semi-Markov Process , 1967 .

[20]  R. Pyke,et al.  The Existence and Uniqueness of Stationary Measures for Markov Renewal Processes , 1966 .

[21]  Ronald Pyke,et al.  Limit Theorems for Markov Renewal Processes , 1964 .

[22]  W. Jewell.  LIMITING COVARIANCE IN MARKOV-RENEWAL PROCESSES , 1964 .

[23]  J. Keilson,et al.  A central limit theorem for processes defined on a finite Markov chain , 1964, Mathematical Proceedings of the Cambridge Philosophical Society.

[24]  William S. Jewell,et al.  Markov-Renewal Programming. I: Formulation, Finite Return Models , 1963 .

[25]  R. Pyke.  Markov renewal processes: Definitions and preliminary properties , 1961 .

[26]  R. Pyke.  Markov Renewal Processes with Finitely Many States , 1961 .

[27]  Walter L. Smith,et al.  Regenerative stochastic processes , 1955, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.