Event coupling and performance sensitivity analysis of generalized semi-Markov processes

We study a fundamental feature of the generalized semi-Markov processes (GSMPs), called event coupling. The event coupling reflects the logical behavior of a GSMP that specifies which events can be affected by any given event. Based on the event-coupling property, GSMPs can be classified into three classes: the strongly coupled, the hierarchically coupled, and the decomposable GSMPs. The event-coupling property on a sample path of a GSMP can be represented by the event-coupling trees. With the event-coupling tree, we can quantify the effect of a single perturbation on a performance measure by using realization factors. A set of equations that specifies the realization factors is derived. We show that the sensitivity of steady-state performance with respect to a parameter of an event lifetime distribution can be obtained by a simple formula based on realization factors and that the sample-path performance sensitivity converges to the sensitivity of the steady-state performance with probability one as the length of the sample path goes to infinity. This generalizes the existing results of perturbation analysis of queueing networks to GSMPs.

[1]  P. Taylor,et al.  Tight bounds on the sensitivity of generalised semi-Markov processes with a single generally distributed lifetime , 1992, Journal of Applied Probability.

[2]  Xi-Ren Cao,et al.  A new method of performance sensitivity analysis for non-Markovian queueing networks , 1992, Queueing Syst. Theory Appl..

[3]  Xi-Ren Cao,et al.  Perturbation analysis of discrete event dynamic systems , 1991 .

[4]  Paul Glasserman,et al.  Gradient Estimation Via Perturbation Analysis , 1990 .

[5]  Xi-Ren Cao Realization factors and sensitivity analysis of queueing networks with state-dependent service rates , 1990, Advances in Applied Probability.

[6]  P. Glasserman The limiting value of derivative estimators based on perturbation analysis , 1990 .

[7]  K. Sigman NOTES ON THE STABILITY OF CLOSED QUEUEING NETWORKS , 1989 .

[8]  Xi-Ren Cao The static property of a perturbed multiclass closed queueing network and decomposition , 1989 .

[9]  P. Glynn A GSMP formalism for discrete event systems , 1989, Proc. IEEE.

[10]  Xi-Ren Cao,et al.  A Sample Performance Function of Closed Jackson Queueing Networks , 1988, Oper. Res..

[11]  Rajan Suri,et al.  Infinitesimal perturbation analysis for general discrete event systems , 1987, JACM.

[12]  P. Haas,et al.  Regenerative generalized semi-markov processes , 1987 .

[13]  Xi-Ren Cao Convergence of parameter sensitivity estimates in a stochastic experiment , 1984, The 23rd IEEE Conference on Decision and Control.

[14]  Ward Whitt,et al.  Continuity of Generalized Semi-Markov Processes , 1980, Math. Oper. Res..

[15]  P. Billingsley,et al.  Probability and Measure , 1980 .

[16]  A. Borovkov Ergodicity and Stability Theorems for a Class of Stochastic Equations and Their Applications , 1979 .

[17]  R. Schassberger Insensitivity of Steady-state Distributions of Generalized Semi-Markov Processes. Part II , 1977 .

[18]  Rolf Schassberger,et al.  On the Equilibrium Distribution of a Class of Finite-State Generalized Semi-Markov Processes , 1976, Math. Oper. Res..

[19]  Aleksandr Alekseevich Borovkov,et al.  Stochastic processes in queueing theory , 1976 .

[20]  Erhan Çinlar,et al.  Introduction to stochastic processes , 1974 .