ASYMPTOTIC FLUID OPTIMALITY AND EFFICIENCY OF THE TRACKING POLICY FOR BANDWIDTH-SHARING NETWORKS

Optimal control of stochastic bandwidth-sharing networks is typically difficult. In order to facilitate the analysis, deterministic analogues of stochastic bandwidth-sharing networks, the so-called fluid models, are often taken for analysis, as their optimal control can be found more easily. The tracking policy translates the fluid optimal control policy back to a control policy for the stochastic model, so that the fluid optimality can be achieved asymptotically when the stochastic model is scaled properly. In this work we study the efficiency of the tracking policy, that is, how fast the fluid optimality can be achieved in the stochastic model with respect to the scaling parameter. In particular, our result shows that, under certain conditions, the tracking policy can be as efficient as feedback policies.

[1]  Arie Hordijk,et al.  Fluid approximation of a controlled multiclass tandem network , 2000, Queueing Syst. Theory Appl..

[2]  Laurent Massoulié,et al.  Bandwidth sharing and admission control for elastic traffic , 2000, Telecommun. Syst..

[3]  M. Yor,et al.  Continuous martingales and Brownian motion , 1990 .

[4]  Hong Chen.  Rate of convergence of the fluid approximation for generalized Jackson networks , 1996 .

[5]  Alexei B. Piunovskiy,et al.  Accuracy of fluid approximations to controlled birth-and-death processes: absorbing case , 2011, Math. Methods Oper. Res..

[6]  C. Maglaras.  Discrete-review policies for scheduling stochastic networks: trajectory tracking and fluid-scale asymptotic optimality , 2000 .

[7]  M. Pullan.  Forms of Optimal Solutions for Separated Continuous Linear Programs , 1995 .

[8]  Ad Ridder.  Large-deviations analysis of the fluid approximation for a controllable tandem queue , 2003 .

[9]  Pierce E. Cantrell.  Computation of the Transient M/M/1 Queue cdf, pdf, and Mean with Generalized Q-Functions , 1986, IEEE Trans. Commun..

[10]  A. M. K. Tarabia,et al.  A SIMPLE TRANSIENT ANALYSIS OF AN M/M/1/N QUEUE , 2000 .

[11]  M. V. Day,et al.  Fluid Limits of Optimally Controlled Queueing Networks , 2007 .

[12]  Hong Chen,et al.  Hierarchical Modeling of Stochastic Networks, Part II: Strong Approximations , 1994 .

[13]  O. Hernández-Lerma,et al.  Existence and Regularity of a Nonhomogeneous Transition Matrix under Measurability Conditions , 2008, 0804.4441.

[14]  R. Núñez Queija,et al.  Assessing the efficiency of resource allocations in bandwidth-sharing networks , 2009, Perform. Evaluation.

[15]  J. Dai.  On Positive Harris Recurrence of Multiclass Queueing Networks: A Unified Approach Via Fluid Limit Models , 1995 .

[16]  Winfried Gleiβner.  The spread of epidemics , 1988 .

[17]  Ji Zhang,et al.  The transient solution of time-dependent M/M/1 queues , 1991, IEEE Trans. Inf. Theory.

[18]  Alexey Piunovskiy,et al.  Controlled jump Markov processes with local transitions and their fluid approximation , 2009 .

[19]  N. Bäuerle.  Asymptotic optimality of tracking policies in stochastic networks , 2001 .

[20]  Hong Chen,et al.  Hierarchical Modeling of Stochastic Networks, Part I: Fluid Models , 1994 .

[21]  Alexei B. Piunovskiy.  Random walk, birth-and-death process and their fluid approximations: absorbing case , 2009, Math. Methods Oper. Res..

[22]  A. Mandelbaum,et al.  State-dependent queues: approximations and applications , 1995 .

[23]  Hong Chen,et al.  Discrete Flow Networks: Bottleneck Analysis and Fluid Approximations , 1991, Math. Oper. Res..

[24]  Xianping Guo,et al.  Continuous-Time Markov Decision Processes: Theory and Applications , 2009 .

[25]  W. J. Anderson.  Continuous-Time Markov Chains , 1991 .

[26]  Alexei B. Piunovskiy,et al.  On the Accuracy of Fluid Approximations to a Class of Inventory-Level-Dependent EOQ and EPQ Models , 2011, Adv. Oper. Res..

[27]  A. Piunovskiy,et al.  An explicit optimal intervention policy for a deterministic epidemic model , 2008 .

[28]  IM Maaike Verloop,et al.  Scheduling in Stochastic Resource-Sharing Systems , 2009 .

[29]  Philippe Robert.  Stochastic Networks and Queues , 2003 .