Uniform stability of a class of large-scale parallel server networks.

In this paper we show that a large class of parallel server networks, with $\sqrt{n}$ safety staffing, and no abandonment, in the Halfin-Whitt regime are exponentially ergodic and their invariant probability distributions are tight, uniformly over all stationary Markov controls. This class consists of all networks of tree topology with a single non-leaf server pool, such as the 'N' and 'M' models, as well as networks of any tree topology with class-dependent service rates. We first define a parameter which characterizes the spare capacity (safety staffing) of the network. If the spare capacity parameter is negative, we show that the controlled diffusion is transient under any stationary Markov control, and that it cannot be positive recurrent when this parameter is zero. Then we show that the limiting diffusion is uniformly exponentially ergodic over all stationary Markov controls if this parameter is positive. As well known, joint work conservation, that is, keeping all servers busy unless all queues are empty, cannot be always enforced in multiclass multi-pool networks, and as a result the diffusion limit and the prelimit do not "match" on the entire state space. For this reason, we introduce the concept of "system-wide work conserving policies," which are defined as policies that minimize the number of idle servers at all times. We show that, provided the spare capacity parameter is positive, the diffusion-scaled processes are geometrically ergodic and the invariant distributions are tight, uniformly over all system-wide work conserving policies. In addition, when the spare capacity is negative we show that the diffusion-scaled processes are transient under any stationary Markov control, and when it is zero, they cannot be positive recurrent. We use a unified approach in which the same Lyapunov function is used in the study of the prelimit and diffusion limit.

[1]  Sem C. Borst,et al.  Scalable load balancing in networked systems: A survey of recent advances , 2018, SIAM Rev..

[2]  Ward Whitt,et al.  Heavy-Traffic Limits for Queues with Many Exponential Servers , 1981, Oper. Res..

[3]  Guodong Pang,et al.  Ergodicity of a Lévy-driven SDE arising from multiclass many-server queues , 2019, The Annals of Applied Probability.

[4]  Guodong Pang,et al.  Ergodic Diffusion Control of Multiclass Multi-Pool Networks in the Halfin-Whitt Regime , 2015, 1505.04307.

[5]  Guodong Pang,et al.  Ergodic Control of Multi-Class M/M/N+M Queues in the Halfin-Whitt Regime , 2014, ArXiv.

[6]  Masakiyo Miyazawa,et al.  Heavy traffic approximation for the stationary distribution of a generalized Jackson network: The BAR approach , 2015, 1510.01249.

[7]  Alexander L. Stolyar,et al.  Multiclass multiserver queueing system in the Halfin–Whitt heavy traffic regime: asymptotics of the stationary distribution , 2012, Queueing Syst. Theory Appl..

[8]  Alexander Stolyar Diffusion-Scale Tightness of Invariant Distributions of a Large-Scale Flexible Service System , 2015, Advances in Applied Probability.

[9]  Alexander L. Stolyar,et al.  Systems with large flexible server pools: Instability of “natural” load balancing , 2010, 1012.4140.

[10]  Alexander L. Stolyar Tightness of Stationary Distributions of a Flexible-Server System in the Halfin-Whitt Asymptotic Regime , 2014 .

[11]  Avishai Mandelbaum,et al.  ON PATIENT FLOW IN HOSPITALS: A DATA-BASED QUEUEING-SCIENCE PERSPECTIVE , 2015 .

[12]  I. Gyöngy,et al.  Existence of strong solutions for Itô's stochastic equations via approximations , 1996, Stochastics and Partial Differential Equations: Analysis and Computations.

[13]  Y. Kamarianakis Ergodic control of diffusion processes , 2013 .

[14]  Avishai Mandelbaum,et al.  Telephone Call Centers: Tutorial, Review, and Research Prospects , 2003, Manuf. Serv. Oper. Manag..

[15]  Elena Yudovina,et al.  Tightness of Invariant Distributions of a Large-scale Flexible Service System Under a Priority Discipline , 2012 .

[16]  Avishai Mandelbaum,et al.  Statistical Analysis of a Telephone Call Center , 2005 .

[17]  Bert Zwart,et al.  Economies-of-scale in resource sharing systems: tutorial and partial review of the QED heavy-traffic regime , 2017, 1706.05397.

[18]  David D. Yao,et al.  Justifying diffusion approximations for multiclass queueing networks under a moment condition , 2018, The Annals of Applied Probability.

[19]  Avishai Mandelbaum,et al.  Designing a Call Center with Impatient Customers , 2002, Manuf. Serv. Oper. Manag..

[20]  D. Gamarnik,et al.  Validity of heavy traffic steady-state approximations in generalized Jackson networks , 2004, math/0410066.

[21]  Guodong Pang,et al.  On uniform exponential ergodicity of Markovian multiclass many-server queues in the Halfin-Whitt regime , 2018, Math. Oper. Res..

[22]  Sem C. Borst,et al.  Dimensioning Large Call Centers , 2000, Oper. Res..

[23]  Zeynep Akşin,et al.  The Modern Call Center: A Multi‐Disciplinary Perspective on Operations Management Research , 2007 .

[24]  Guodong Pang,et al.  Infinite-Horizon Average Optimality of the N-Network in the Halfin-Whitt Regime , 2018, Math. Oper. Res..

[25]  Amarjit Budhiraja,et al.  Stationary Distribution Convergence for Generalized Jackson Networks in Heavy Traffic , 2009, Math. Oper. Res..

[26]  Vivek S. Borkar,et al.  Ergodic Control of Diffusion Processes , 2012 .

[27]  Ding Ding,et al.  Models and Insights for Hospital Inpatient Operations: Time-Dependent ED Boarding Time , 2015, Manag. Sci..

[28]  David D. Yao,et al.  Diffusion Limit of Fair Resource Control - Stationarity and Interchange of Limits , 2016, Math. Oper. Res..

[29]  R. Atar A diffusion model of scheduling control in queueing systems with many servers , 2005, math/0503518.

[30]  Guodong Pang,et al.  Infinite horizon asymptotic average optimality for large-scale parallel server networks , 2017, Stochastic Processes and their Applications.

[31]  Ward Whitt,et al.  Understanding the Efficiency of Multi-Server Service Systems , 1992 .

[32]  Itay Gurvich,et al.  Validity of Heavy-Traffic Steady-State Approximations in Multiclass Queueing Networks: The Case of Queue-Ratio Disciplines , 2014, Math. Oper. Res..

[33]  R. Atar Scheduling control for queueing systems with many servers: asymptotic optimality in heavy traffic , 2005, math/0602526.

[34]  Xuefeng Gao,et al.  Positive recurrence of piecewise Ornstein–Uhlenbeck processes and common quadratic Lyapunov functions , 2011, 1107.2873.