Accuracy of fluid approximations to controlled birth-and-death processes: absorbing case

We consider the fluid model of a controlled birth-and-death process with an absorbing state. Instead of analyzing the trajectories, we investigate the performance functionals of the underlying process by considering algebraic equations of the dynamic programming type. We provide the accuracy of such fluid approximations and give illustrative examples.

[1]  Konstantin Avrachenkov,et al.  Convergence of trajectories and optimal buffer sizing for AIMD congestion control , 2010, Perform. Evaluation.

[2]  Nicole Bäuerle,et al.  Optimal control of queueing networks: an approach via fluid models , 2002, Advances in Applied Probability.

[3]  Xi-Ren Cao,et al.  A survey of recent results on continuous-time Markov decision processes , 2006 .

[4]  Yi Zhang,et al.  Fluid Model of An Internet Router Under the Mimd Control Scheme , 2008 .

[5]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[6]  Alexey Piunovskiy,et al.  Controlled jump Markov processes with local transitions and their fluid approximation , 2009 .

[7]  Hong Chen,et al.  Hierarchical Modeling of Stochastic Networks, Part I: Fluid Models , 1994 .

[8]  Avishai Mandelbaum,et al.  Strong approximations for Markovian service networks , 1998, Queueing Syst. Theory Appl..

[9]  A. Piunovskiy,et al.  An explicit optimal intervention policy for a deterministic epidemic model , 2008 .

[10]  Alexei B. Piunovskiy,et al.  An explicit optimal isolation policy for a deterministic epidemic model , 2005, Appl. Math. Comput..

[11]  S. Fotopoulos.  Stochastic modeling and analysis of manufacturing systems , 1996 .

[12]  N. Bäuerle.  Asymptotic optimality of tracking policies in stochastic networks , 2001 .

[13]  M. Y. Kitayev.  Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion , 1986 .

[14]  Hong Chen.  Fluid Approximations and Stability of Multiclass Queueing Networks: Work-Conserving Disciplines , 1995 .

[15]  IM Maaike Verloop,et al.  Scheduling in Stochastic Resource-Sharing Systems , 2009 .

[16]  A. B. Piunovskii.  A Controlled Jump Discounted Model with Constraints , 1998 .

[17]  A. Mandelbaum,et al.  State-dependent queues: approximations and applications , 1995 .

[18]  M. V. Day,et al.  Fluid Limits of Optimally Controlled Queueing Networks , 2007 .

[19]  Hong Chen.  Rate of convergence of the fluid approximation for generalized Jackson networks , 1996 .

[20]  Alexei B. Piunovskiy,et al.  On the Accuracy of Fluid Approximations to a Class of Inventory-Level-Dependent EOQ and EPQ Models , 2011, Adv. Oper. Res..

[21]  Ramandeep S. Randhawa,et al.  On the Accuracy of Fluid Models for Capacity Sizing in Queueing Systems with Impatient Customers , 2010, Oper. Res..

[22]  Alexei B. Piunovskiy.  Random walk, birth-and-death process and their fluid approximations: absorbing case , 2009, Math. Methods Oper. Res..

[23]  Bruce L. Golden,et al.  Telecommunications modeling, policy, and technology , 2008 .

[24]  V. Rykov,et al.  Controlled Queueing Systems , 1995 .

[25]  Dimitri P. Bertsekas,et al.  Stochastic optimal control : the discrete time case , 2007 .

[26]  Ad Ridder.  Large-deviations analysis of the fluid approximation for a controllable tandem queue , 2003 .

[27]  Hong Chen,et al.  Discrete Flow Networks: Bottleneck Analysis and Fluid Approximations , 1991, Math. Oper. Res..

[28]  Arie Hordijk,et al.  On the structure of the optimal server control for fluid networks , 2005, Math. Methods Oper. Res..

[29]  Serguei Foss,et al.  A stability criterion via fluid limits and its application to a polling system , 1999, Queueing Syst. Theory Appl..

[30]  P. Rousseeuw,et al.  Wiley Series in Probability and Mathematical Statistics , 2005 .

[31]  Alexei B. Piunovskiy,et al.  Multicriteria impulsive control of jump Markov processes , 2004, Math. Methods Oper. Res..

[32]  J. Dai.  On Positive Harris Recurrence of Multiclass Queueing Networks: A Unified Approach Via Fluid Limit Models , 1995 .

[33]  Yi Zhang,et al.  ASYMPTOTIC FLUID OPTIMALITY AND EFFICIENCY OF THE TRACKING POLICY FOR BANDWIDTH-SHARING NETWORKS , 2011 .