A gradient-estimation procedure for a general class of stochastic discrete-event systems is developed. In contrast to most previous work, the authors focus on performance measures whose realizations are inherently discontinuous (in fact, piecewise constant) functions of the parameter of differentiation. Two broad classes of finite-horizon discontinuous performance measures arising naturally in applications are considered. Because of their discontinuity, these important classes of performance measures are not susceptible to infinitesimal perturbation analysis (IPA). Instead, the authors apply smoothed perturbation analysis, formalizing it and generalizing it in the process. Smoothed perturbation analysis uses conditional expectations to smooth jumps. The resulting gradient estimator involves two factors: the conditional rate at which jumps occur, and the expected effect of a jump. Among the types of performance measures to which the methods can be applied are transient state probabilities, finite-horizon throughputs, distributions on arrival, and expected terminal cost. >
[1]
Ward Whitt,et al.
Continuity of Generalized Semi-Markov Processes
,
1980,
Math. Oper. Res..
[2]
Xi-Ren Cao,et al.
Perturbation analysis and optimization of queueing networks
,
1983
.
[3]
Y. Ho,et al.
Smoothed (conditional) perturbation analysis of discrete event dynamical systems
,
1987
.
[4]
Xi-Ren Cao,et al.
A Sample Performance Function of Closed Jackson Queueing Networks
,
1988,
Oper. Res..
[5]
P. Glasserman,et al.
Derivative estimates from discontinuous realizations: smoothing techniques
,
1989,
WSC '89.
[6]
R. Suri,et al.
Perturbation analysis: the state of the art and research issues explained via the GI/G/1 queue
,
1989,
Proc. IEEE.
[7]
M. Zazanis.
Compensators and derivative estimation for queueing systems
,
1990,
29th IEEE Conference on Decision and Control.
[8]
Paul Glasserman,et al.
Structural conditions for perturbation analysis of queueing systems
,
1991,
JACM.