Using infinitesimal perturbation analysis of stochastic flow models to recover performance sensitivity estimates of discrete event systems

Abstract Stochastic Flow Models (SFMs) form a class of hybrid systems used as abstractions of complex Discrete Event Systems (DES) for the purpose of deriving performance sensitivity estimates through Infinitesimal Perturbation Analysis (IPA) techniques when these cannot be applied to the original DES. In this paper, we establish explicit connections between gradient estimators obtained through a SFM and those obtained in the underlying DES, thus providing analytical evidence for the effectiveness of these estimators which has so far been limited to empirical observations. We consider DES for which analytical expressions of IPA (or finite difference) estimators are available, specifically G / G /1 and G / G /1/ K queueing systems. We show that, when evaluated on the same sample path of the underlying DES, the IPA gradient estimators of states, event times, and various performance metrics derived through SFMs are, under certain conditions, the same as those of the associated DES or their expected values are asymptotically the same under large traffic rates.

[1]  David D. Yao,et al.  Scheduling semiconductor lines using a fluid network model , 1994, IEEE Trans. Robotics Autom..

[2]  Christos G. Cassandras,et al.  Perturbation analysis for online control and optimization of stochastic fluid models , 2002, IEEE Trans. Autom. Control..

[3]  Christos G. Cassandras,et al.  Perturbation Analysis and Optimization of Multiclass Multiobjective Stochastic Flow Models , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[4]  Yorai Wardi,et al.  Variational Bounds and Sensitivity Analysis of Traffic Processes in Continuous Flow Models , 2001, Discret. Event Dyn. Syst..

[5]  Geir E. Dullerud,et al.  Distributed control of heterogeneous systems , 2004, IEEE Transactions on Automatic Control.

[6]  Christos G. Cassandras,et al.  Stochastic Flow Systems: Modeling and Sensitivity Analysis , 2006 .

[7]  Christos G. Cassandras,et al.  Perturbation Analysis and Optimization of Stochastic Hybrid Systems , 2010, Eur. J. Control.

[8]  Yorai Wardi,et al.  A Unified Approach to Infinitesimal Perturbation Analysis in Stochastic Flow Models: The Single-Stage Case , 2010, IEEE Transactions on Automatic Control.

[9]  Christos G. Cassandras,et al.  Perturbation analysis and optimization of stochastic flow networks , 2004, IEEE Transactions on Automatic Control.

[10]  Christos G. Cassandras,et al.  Perturbation analysis of feedback-controlled stochastic flow systems , 2004, IEEE Transactions on Automatic Control.

[11]  Christos G. Cassandras,et al.  Perturbation Analysis of Multiclass Stochastic Fluid Models , 2004, Discret. Event Dyn. Syst..

[12]  D. Mitra,et al.  Stochastic theory of a data-handling system with multiple sources , 1982, The Bell System Technical Journal.

[13]  Donald F. Towsley,et al.  Fluid Simulation of Large Scale Networks: Issues and Tradeoffs , 1999, PDPTA.