Dynamic fluid-based scheduling in a multi-class abandonment queue

We investigate how to share a common resource among multiple classes of customers in the presence of abandonments. We consider two different models: (1) customers can abandon both while waiting in the queue and while being served, (2) only customers that are in the queue can abandon. Given the complexity of the stochastic optimization problem we propose a fluid model as a deterministic approximation. For the overload case we directly obtain that the c@?@m/@q rule is optimal. For the underload case we use Pontryagin's Maximum Principle to obtain the optimal solution for two classes of customers; there exists a switching curve that splits the two-dimensional state-space into two regions such that when the number of customers in both classes is sufficiently small the optimal policy follows the c@?@m-rule and when the number of customers is sufficiently large the optimal policy follows the c@?@m/@q-rule. The same structure is observed in the optimal policy of the stochastic model for an arbitrary number of classes. Based on this we develop a heuristic and by numerical experiments we evaluate its performance and compare it to several index policies. We observe that the suboptimality gap of our solution is small.

[1]  Nam Kyoo Boots,et al.  A Multiserver Queueing System with Impatient Customers , 1999 .

[2]  N. Shimkin,et al.  The c / Rule for Many-Server Queues with Abandonment , 2009 .

[3]  J. Dai On Positive Harris Recurrence of Multiclass Queueing Networks: A Unified Approach Via Fluid Limit Models , 1995 .

[4]  Rhonda Righter,et al.  SCHEDULING IMPATIENT JOBS IN A CLEARING SYSTEM WITH INSIGHTS ON PATIENT TRIAGE IN MASS CASUALTY INCIDENTS , 2008, Probability in the Engineering and Informational Sciences.

[5]  Arie Hordijk,et al.  Fluid approximation of a controlled multiclass tandem network , 2000, Queueing Syst. Theory Appl..

[6]  Mustafa H. Tongarlak,et al.  On scheduling a multiclass queue with abandonments under general delay costs , 2013, Queueing Syst. Theory Appl..

[7]  N. Bäuerle Asymptotic optimality of tracking policies in stochastic networks , 2001 .

[8]  Jean Walrand,et al.  The c# rule revisited , 1985 .

[9]  Onno Boxma,et al.  Multiserver queues with impatient customers , 1993 .

[10]  Nicole Bäuerle,et al.  Optimal control of single-server fluid networks , 2000, Queueing Syst. Theory Appl..

[11]  C. Maglaras Discrete-review policies for scheduling stochastic networks: trajectory tracking and fluid-scale asymptotic optimality , 2000 .

[12]  Nahum Shimkin,et al.  The cµ/theta Rule for Many-Server Queues with Abandonment , 2010, Oper. Res..

[13]  R. Núñez Queija,et al.  Asymptotically optimal parallel resource assignment with interference , 2010, Queueing Syst. Theory Appl..

[14]  Sean P. Meyn Stability and optimization of queueing networks and their fluid models , 2003 .

[15]  Philippe Robert Stochastic Networks and Queues , 2003 .

[16]  Philippe Robert,et al.  Fluid Limits for Processor-Sharing Queues with Impatience , 2008, Math. Oper. Res..

[17]  P. H. Brill,et al.  Level Crossings in Point Processes Applied to Queues: Single-Server Case , 1977, Oper. Res..

[18]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[19]  Urtzi Ayesta,et al.  A nearly-optimal index rule for scheduling of users with abandonment , 2011, 2011 Proceedings IEEE INFOCOM.

[20]  Benoît Chachuat,et al.  Nonlinear and Dynamic Optimization: From Theory to Practice , 2007 .

[21]  Avishai Mandelbaum,et al.  Designing a Call Center with Impatient Customers , 2002, Manuf. Serv. Oper. Manag..

[22]  R. R. Lumley,et al.  On the optimal allocation of service to impatient tasks , 2004, Journal of Applied Probability.

[23]  Jim Dai,et al.  Many-server queues with customer abandonment: A survey of diffusion and fluid approximations , 2012, Journal of Systems Science and Systems Engineering.

[24]  Andreas Brandt,et al.  On the Two-Class M/M/1 System under Preemptive Resume and Impatience of the Prioritized Customers , 2004, Queueing Syst. Theory Appl..

[25]  Baris Balcioglu,et al.  On priority queues with impatient customers , 2008, Queueing Syst. Theory Appl..

[26]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[27]  J. Michael Harrison,et al.  Dynamic Scheduling of a Multiclass Queue in the Halfin-Whitt Heavy Traffic Regime , 2004, Oper. Res..

[28]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Vol. II , 1976 .

[29]  Ger Koole,et al.  Dynamic control of a single-server system with abandonments , 2011, Queueing Syst. Theory Appl..

[30]  J. Walrand,et al.  The cμ rule revisited , 1985, Advances in Applied Probability.

[31]  Nahum Shimkin,et al.  On the asymptotic optimality of the cμ/θ rule under ergodic cost , 2011, Queueing Syst. Theory Appl..

[32]  F. Baccelli,et al.  Single-server queues with impatient customers , 1984, Advances in Applied Probability.

[33]  Rami Atar,et al.  Scheduling a multi class queue with many exponential servers: asymptotic optimality in heavy traffic , 2004, math/0407058.

[34]  Ward Whitt,et al.  Efficiency-Driven Heavy-Traffic Approximations for Many-Server Queues with Abandonments , 2004, Manag. Sci..

[35]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[36]  P. Whittle Restless Bandits: Activity Allocation in a Changing World , 1988 .

[38]  Elena Yudovina,et al.  Stochastic networks , 1995, Physics Subject Headings (PhySH).