Optimal control of service rates in networks of queues

We prove a monotonicity result for the problem of optimal service rate control in certain queueing networks. Consider, as an illustrative example, a number of ·/M/1 queues which are arranged in a cycle with some number of customers moving around the cycle. A holding cost hi (xi ) is charged for each unit of time that queue i contains xi customers, with hi being convex. As a function of the queue lengths the service rate at each queue i is to be chosen in the interval , where cost ci (μ) is charged for each unit of time that the service rate μis in effect at queue i. It is shown that the policy which minimizes the expected total discounted cost has a monotone structure: namely, that by moving one customer from queue i to the following queue, the optimal service rate in queue i is not increased and the optimal service rates elsewhere are not decreased. We prove a similar result for problems of optimal arrival rate and service rate control in general queueing networks. The results are extended to an average-cost measure, and an example is included to show that in general the assumption of convex holding costs may not be relaxed. A further example shows that the optimal policy may not be monotone unless the choice of possible service rates at each queue includes 0.

[1]  T. B. Crabill Optimal Control of a Service Facility with Variable Exponential Service Times and Constant Arrival Rate , 1972 .

[2]  Matthew J. Sobel Optimal Operation of Queues , 1974 .

[3]  Shaler Stidham,et al.  Optimal Control of Queueing Systems , 1974 .

[4]  Steven A. Lippman,et al.  Applying a New Device in the Optimization of Exponential Queuing Systems , 1975, Oper. Res..

[5]  Shaler Stidham,et al.  Individual versus Social Optimization in Exponential Congestion Systems , 1977, Oper. Res..

[6]  Michael J. Magazine,et al.  A Classified Bibliography of Research on Optimal Design and Control of Queues , 1977, Oper. Res..

[7]  Donald M. Topkis,et al.  Minimizing a Submodular Function on a Lattice , 1978, Oper. Res..

[8]  C.C. White,et al.  Dynamic programming and stochastic control , 1978, Proceedings of the IEEE.

[9]  R. Weber On the optimal assignment of customers to parallel servers , 1978, Journal of Applied Probability.

[10]  Richard F. Serfozo,et al.  Technical Note - An Equivalence Between Continuous and Discrete Time Markov Decision Processes , 1979, Oper. Res..

[11]  Anthony Ephremides,et al.  A simple dynamic routing problem , 1980 .

[12]  Søren Glud Johansen,et al.  Control of arrivals to a stochastic input–output system , 1980 .

[13]  R. Serfozo Optimal control of random walks, birth and death processes, and queues , 1981, Advances in Applied Probability.

[14]  Zvi Rosberg,et al.  Optimal control of service in tandem queues , 1982 .

[15]  B. Hajek Optimal control of two interacting service stations , 1982, 1982 21st IEEE Conference on Decision and Control.

[16]  B. Hajek Optimal control of two interacting service stations , 1982, CDC 1982.

[17]  Peter Whittle,et al.  Optimization Over Time , 1982 .

[18]  A. Hordijk,et al.  Average optimal policies in Markov decision drift processes with applications to a queueing and a replacement model , 1983, Advances in Applied Probability.

[19]  Kyung Y. Jo,et al.  Optimal service-rate control of M/G/1 queueing systems using phase methods , 1983, Advances in Applied Probability.

[20]  Richard F. Serfozo,et al.  M/M/1 Queueing Decision Processes with Monotone Hysteretic Optimal Policies , 1984, Oper. Res..

[21]  Tapani Lehtonen,et al.  On the optimality of the shortest line discipline , 1984 .

[22]  Jr. Shaler Stidham Optimal control of admission to a queueing system , 1985 .

[23]  Shaler Stidham,et al.  Monotonic and Insensitive Optimal Policies for Control of Queues with Undiscounted Costs , 1989, Oper. Res..