K competing queues with customer abandonment: optimality of a generalised $$c \mu $$cμ-rule by the Smoothed Rate Truncation method

We consider a K-competing queues system with the additional feature of customer abandonment. Without abandonment, it is optimal to allocate the server to a queue according to the $$c \mu $$cμ-rule. To derive a similar rule for the system with abandonment, we model the system as a continuous-time Markov decision process. Due to impatience, the Markov decision process has unbounded jump rates as a function of the state. Hence it is not uniformisable, and so far there has been no systematic direct way to analyse this. The Smoothed Rate Truncation principle is a technique designed to make an unbounded rate process uniformisable, while preserving the properties of interest. Together with theory securing continuity in the limit, this provides a framework to analyse unbounded rate Markov decision processes. With this approach, we have been able to find close-fitting conditions guaranteeing optimality of a strict priority rule.

[1]  Urtzi Ayesta,et al.  Asymptotically optimal index policies for an abandonment queue with convex holding cost , 2015, Queueing Syst. Theory Appl..

[2]  Sandjai Bhulai,et al.  On structural properties of the value function for an unbounded jump Markov process with an application to a processor sharing retrial queue , 2014, Queueing Syst. Theory Appl..

[3]  Urtzi Ayesta,et al.  Dynamic fluid-based scheduling in a multi-class abandonment queue , 2013, Perform. Evaluation.

[4]  Armand M. Makowski,et al.  K competing queues with geometric service requirements and linear costs: The μc-rule is always optimal☆ , 1985 .

[5]  Jean Walrand,et al.  The c# rule revisited , 1985 .

[6]  J. Wessels Markov programming by successive approximations by respect to weighted supremum norms , 1976, Advances in Applied Probability.

[7]  Ger Koole,et al.  Dynamic control of a single-server system with abandonments , 2011, Queueing Syst. Theory Appl..

[8]  Nahum Shimkin,et al.  The cµ/theta Rule for Many-Server Queues with Abandonment , 2010, Oper. Res..

[9]  Jean-Philippe Gayon,et al.  Optimal static priority rules for stochastic scheduling with impatience , 2012, Oper. Res. Lett..

[10]  R. Serfozo An Equivalence between Continuous and Discrete Time Markov Decision Processes. , 1976 .

[11]  Urtzi Ayesta,et al.  A nearly-optimal index rule for scheduling of users with abandonment , 2011, 2011 Proceedings IEEE INFOCOM.

[12]  Richard F. Serfozo,et al.  Technical Note - An Equivalence Between Continuous and Discrete Time Markov Decision Processes , 1979, Oper. Res..

[13]  R. Strauch Negative Dynamic Programming , 1966 .

[14]  F. Spieksma,et al.  Countable state Markov decision processes with unbounded jump rates and discounted cost: optimality equation and approximations , 2015, Advances in Applied Probability.

[15]  J. Walrand,et al.  The cμ rule revisited , 1985, Advances in Applied Probability.