Online IPA Gradient Estimators in Stochastic Continuous Fluid Models

This paper applies infinitesimal perturbation analysis (IPA) to loss-related and workload-related metrics in a class of stochastic flow models (SFM). It derives closed-form formulas for the gradient estimators of these metrics with respect to various parameters of interest, such as buffer size, service rate, and inflow rate. The IPA estimators derived are simple and fast to compute, and are further shown to be unbiased and nonparametric, in the sense that they can be computed directly from the observed data without any knowledge of the underlying probability law. These properties hold out the promise of utilizing IPA gradient estimates as ingredients of online management and control of telecommunications networks. While this paper considers single-node SFMs, the analysis method developed is amenable to extensions to networks of SFM nodes with more general topologies.

[1]  D. Mitra,et al.  Stochastic theory of a data-handling system with multiple sources , 1982, The Bell System Technical Journal.

[2]  Xi-Ren Cao,et al.  Perturbation analysis of discrete event dynamic systems , 1991 .

[3]  Yorai Wardi.  IPA gradient estimation for loss measures in networks of continuous flow models , 1994, Fifth IEEE International Workshop on Computer-Aided Modeling, Analysis, and Design of Communication Links and Networks.

[4]  Edwin K. P. Chong,et al.  Discrete event systems: Modeling and performance analysis , 1994, Discret. Event Dyn. Syst..

[5]  Charles Leake,et al.  Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method , 1994 .

[6]  Jason H. Goodfriend,et al.  Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method , 1995 .

[7]  Gustavo de Veciana,et al.  Conservation laws and reflection mappings with an application to multiclass mean value analysis for stochastic fluid queues , 1996 .

[8]  George Kesidis,et al.  Feasibility of fluid event-driven simulation for ATM networks , 1996, Proceedings of GLOBECOM'96. 1996 IEEE Global Telecommunications Conference.

[9]  Donald F. Towsley,et al.  Fluid Simulation of Large Scale Networks: Issues and Tradeoffs , 1999, PDPTA.

[10]  Wei-Bo Gong,et al.  Time-driven fluid simulation for high-speed networks , 1999, IEEE Trans. Inf. Theory.

[11]  Yorai Wardi,et al.  Continuous flow models: modeling, simulation and continuity properties , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[12]  Takis Konstantopoulos,et al.  On the dynamics and performance of stochastic fluid systems , 2000, Journal of Applied Probability.

[13]  Yorai Wardi,et al.  Variational Bounds and Sensitivity Analysis of Traffic Processes in Continuous Flow Models , 2001, Discret. Event Dyn. Syst..

[14]  Debasis Mitra,et al.  Performance and fluid simulations of a novel shared buffer management system , 2001, TOMC.

[15]  Christos G. Cassandras,et al.  Stochastic fluid models for control and optimization of systems with quality of service requirements , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[16]  Christos G. Cassandras,et al.  Perturbation analysis for online control and optimization of stochastic fluid models , 2002, IEEE Trans. Autom. Control..