Optimal control of admission to a multi-server queue with two arrival streams

The problem of finding an optimal admission policy to an M/M/c queue with one controlled and one uncontrolled arrival stream is addressed There are two streams of customers that are generated according to independent Poisson processes with constant arrival rates. The service time probability distribution is exponential and does not depend on the class of the customers. Upon arrival a class 1 customer may be admitted or rejected, while incoming class 2 customers are always admitted. A state-dependent reward is earned each time a new class 1 customer enters the system. When the discount factor is small, there exists a stationary admission policy of a threshold type that maximizes the expected total discounted reward over an infinite horizon. A similar result is also obtained when considering the long-run average reward criterion. The proof relies on a new device that consists of a partial construction of the solution of the dynamic programming equation. Applications arising from teletraffic analysis are proposed. >

[1]  Richard F Serfozo Optimal Control of Random Walks. , 1977 .

[2]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[3]  Daniel P. Heyman,et al.  Stochastic models in operations research , 1982 .

[4]  Zvi Rosberg,et al.  Optimal control of service in tandem queues , 1982 .

[5]  Aurel A. Lazar Optimal Flow Control of an M/M/m Queue , 1984, JACM.

[6]  Richard E. Barlow,et al.  Statistical Theory of Reliability and Life Testing: Probability Models , 1976 .

[7]  Kai Lai Chung,et al.  Markov Chains with Stationary Transition Probabilities , 1961 .

[8]  J.P.C. Blanc,et al.  A New Device for the Synthesis Problem of Optimal Control of Admission to an M/M/c Queue , 1990 .

[9]  Jr. Shaler Stidham Optimal control of admission to a queueing system , 1985 .

[10]  Anthony Ephremides,et al.  A simple dynamic routing problem , 1980 .

[11]  R. Serfozo Optimal control of random walks, birth and death processes, and queues , 1981, Advances in Applied Probability.

[12]  Steven A. Lippman,et al.  Applying a New Device in the Optimization of Exponential Queuing Systems , 1975, Oper. Res..

[13]  E. C. Titchmarsh,et al.  The Laplace Transform , 1991, Heat Transfer 1.

[14]  Dye-jyun Ma,et al.  Optimality results for a simple flow control problem , 1987, 26th IEEE Conference on Decision and Control.

[15]  S. Lippman On Dynamic Programming with Unbounded Rewards , 1975 .

[16]  P. R. Kumar,et al.  Optimal control of a queueing system with two heterogeneous servers , 1984 .

[17]  Søren Glud Johansen,et al.  Control of arrivals to a stochastic input–output system , 1980 .

[18]  Peter R. de Waal Performance Analysis and Optimal Control of an M/M/1/k Queueing System with Impatient Customers , 1987, MMB.

[19]  B. Hajek Optimal control of two interacting service stations , 1982, 1982 21st IEEE Conference on Decision and Control.

[20]  Keith W. Ross,et al.  Optimal scheduling of interactive and noninteractive traffic in telecommunication systems , 1988 .

[21]  Petrus Rosalia de Waal Overload control of telephone exchanges , 1990 .

[22]  A. Hordijk,et al.  Constrained admission control to a queueing system , 1989, Advances in Applied Probability.