Optimal admission and price control in a retrial queueing system

In this paper, we analyze the optimal control policy to minimize the average costs in a retrial queueing system. At any decision epoch, the manager uses admission probabilities a's to control the arriving customers and determines a cancellation price c for the unsuccessful retrial customer, which will lead to him out of system with the probability of G(c) otherwise back to the orbit. We cast the problem as a Markov decision process and derive that the optimal policy has a pure threshold form. We also show that the two thresholds are monotonic in system parameters. Furthermore, based on the structure of the optimal policy, we construct a performance evaluation model for computing efficiently the optimal thresholds. The expression of the average cost is given by solving the quasi-birth-death (QBD) process. Finally, some numerical experiments are presented to illustrate the effect of the system parameters on the optimal policy.

[1]  Jesus R. Artalejo,et al.  Accessible bibliography on retrial queues: Progress in 2000-2009 , 2010, Math. Comput. Model..

[2]  Siew-Lee Hew,et al.  Optimal Integrated Call Admission Control and Dynamic Pricing with Handoffs and Price-Affected Arrivals , 2005, 2005 Asia-Pacific Conference on Communications.

[3]  Jae-Dong Son Optimal admission and pricing control problem with deterministic service times and sideline profit , 2008, Queueing Syst. Theory Appl..

[4]  Fikri Karaesmen,et al.  Effects of system parameters on the optimal policy structure in a class of queueing control problems , 2009, Queueing Syst. Theory Appl..

[5]  Jean-Philippe Gayon,et al.  Optimal control of a production-inventory system with customer impatience , 2010, Oper. Res. Lett..

[6]  L. Sennott Stochastic Dynamic Programming and the Control of Queueing Systems , 1998 .

[7]  Paul J. Schweitzer,et al.  Stochastic Models, an Algorithmic Approach , by Henk C. Tijms (Chichester: Wiley, 1994), 375 pages, paperback. , 1996, Probability in the Engineering and Informational Sciences.

[8]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[9]  Gennadi Falin,et al.  A survey of retrial queues , 1990, Queueing Syst. Theory Appl..

[10]  Shaler Stidham,et al.  A survey of Markov decision models for control of networks of queues , 1993, Queueing Syst. Theory Appl..

[11]  David W. Low,et al.  Optimal Dynamic Pricing Policies for an M/M/s Queue , 1974, Oper. Res..

[12]  Jean-Philippe Gayon,et al.  DYNAMIC PRICING AND REPLENISHMENT IN A PRODUCTION-INVENTORY SYSTEM WITH MARKOV-MODULATED DEMAND Submitted to Naval Research Logistics , September 2004 , 2004 .

[13]  Li Xia,et al.  Event-based optimization of admission control in open queueing networks , 2014, Discret. Event Dyn. Syst..

[14]  Lode Li,et al.  A Stochastic Theory of the Firm , 2015, Math. Oper. Res..

[15]  Dmitry Efrosinin,et al.  Threshold policies for controlled retrial queues with heterogeneous servers , 2006, Ann. Oper. Res..

[16]  Daniel P. Heyman,et al.  Optimal Operating Policies for M/G/1 Queuing Systems , 1968, Oper. Res..

[17]  Mark E. Lewis,et al.  Optimal Pricing and Admission Control in a Queueing System with Periodically Varying Parameters , 2004, Queueing Syst. Theory Appl..

[18]  Feng Zhang,et al.  Strategic joining in M/M/1 retrial queues , 2013, Eur. J. Oper. Res..

[19]  Awi Federgruen,et al.  The value iteration method for countable state Markov decision processes , 1999, Oper. Res. Lett..

[20]  Ger Koole,et al.  Monotonicity in Markov Reward and Decision Chains: Theory and Applications , 2007, Found. Trends Stoch. Syst..

[21]  B. Krishna Kumar,et al.  On multiserver feedback retrial queue with finite buffer , 2009 .

[22]  Rolando Cavazos-Cadena,et al.  Comparing recent assumptions for the existence of average optimal stationary policies , 1992, Oper. Res. Lett..

[23]  B. Sivakumar,et al.  A perishable inventory system with service facilities and retrial customers , 2008, Comput. Ind. Eng..