Optimal threshold control of a retrial queueing system with finite buffer

In this paper, we analyze the optimal control of a retrial queueing system with finite buffer K . At any decision epoch, if the buffer is full, the controller have to make two decisions: one is for the new arrivals, to decide whether they are allowed to join the orbit or not (admission control); the other one is for the repeated customers, to decide whether they are allowed to get back to the orbit or not (retrial control). The problems are constructed as a Markov decision process. We show that the optimal policy has a threshold-type structure and the thresholds are monotonic in operating parameters and various cost parameters. Furthermore, based on the structure of the optimal policy, we construct a performance evaluation model for computing efficiently the thresholds. The expression of the expected cost is given by solving the quasi-birth-and-death (QBD) process. Finally, we provide some numerical results to illustrate the impact of different parameters on the optimal policy and average cost.

[1]  Daniel P. Heyman,et al.  Optimal Operating Policies for M/G/1 Queuing Systems , 1968, Oper. Res..

[2]  B. Hajek.  Optimal control of two interacting service stations , 1982, 1982 21st IEEE Conference on Decision and Control.

[3]  P. Jacobs,et al.  Finite birth-and-death models in randomly changing environments , 1984, Advances in Applied Probability.

[4]  K. Waldmann,et al.  Optimal control of arrivals to multiserver queues in a random environment , 1984 .

[5]  Rolando Cavazos-Cadena,et al.  Comparing recent assumptions for the existence of average optimal stationary policies , 1992, Oper. Res. Lett..

[6]  Shaler Stidham,et al.  A survey of Markov decision models for control of networks of queues , 1993, Queueing Syst. Theory Appl..

[7]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[8]  W. D. Ray,et al.  Stochastic Models: An Algorithmic Approach , 1995 .

[9]  Awi Federgruen,et al.  The value iteration method for countable state Markov decision processes , 1999, Oper. Res. Lett..

[10]  Mark E. Lewis,et al.  OPTIMAL CONTROL OF A TWO-STAGE TANDEM QUEUING SYSTEM WITH FLEXIBLE SERVERS , 2002 .

[11]  Mark E. Lewis,et al.  Optimal Pricing and Admission Control in a Queueing System with Periodically Varying Parameters , 2004, Queueing Syst. Theory Appl..

[12]  Attahiru Sule Alfa,et al.  An M/PH/k retrial queue with finite number of sources , 2004, Comput. Oper. Res..

[13]  Ger Koole,et al.  Monotonicity in Markov Reward and Decision Chains: Theory and Applications , 2007, Found. Trends Stoch. Syst..

[14]  Dmitry Efrosinin,et al.  Threshold policies for controlled retrial queues with heterogeneous servers , 2006, Ann. Oper. Res..

[15]  B. Krishna Kumar,et al.  On multiserver feedback retrial queues with balking and control retrial rate , 2006, Ann. Oper. Res..

[16]  Jae-Dong Son.  Optimal admission and pricing control problem with deterministic service times and sideline profit , 2008, Queueing Syst. Theory Appl..

[17]  B. Krishna Kumar,et al.  On multiserver feedback retrial queue with finite buffer , 2009 .

[18]  Fikri Karaesmen,et al.  Effects of system parameters on the optimal policy structure in a class of queueing control problems , 2009, Queueing Syst. Theory Appl..

[19]  Tien Van Do,et al.  An efficient computation algorithm for a multiserver feedback retrial queue with a large queueing capacity , 2010 .

[20]  Jesus R. Artalejo,et al.  Accessible bibliography on retrial queues: Progress in 2000-2009 , 2010, Math. Comput. Model..

[21]  Jean-Philippe Gayon,et al.  Optimal control of a production-inventory system with customer impatience , 2010, Oper. Res. Lett..

[22]  Fikri Karaesmen,et al.  Dynamic pricing and scheduling in a multi-class single-server queueing system , 2011, Queueing Syst. Theory Appl..

[23]  Jianxin Wang,et al.  A discrete-time Geo/G/1 retrial queue with preferred and impatient customers , 2013 .

[24]  Jinbiao Wu,et al.  Analysis of the M1,M2/G/1 G-queueing system with retrial customers , 2013 .

[25]  Jean-Philippe Gayon,et al.  On the optimal control of manufacturing and remanufacturing activities with a single shared server , 2014, Eur. J. Oper. Res..

[26]  Tien Van Do,et al.  Threshold properties of the M/M/1 queue under T-policy with applications , 2015, Appl. Math. Comput..