Queues with switchover - A review and critique

In many important applications, a situation is encountered where the service capacity of a server must be switched between various competing classes of customers. In most situations, this switchover is not costless. A penalty must be paid either in terms of lost service capacity during the switching period or in terms of a cost to carry out the switching or both. Although queues with switchover abound in applications, generally applicable results are not widely available. In this paper, we review and analyze optimal control policies for queues with switchover. We point out that ideas from several diverse areas can be applied to these models.

[1]  Micha Hofri,et al.  On the Optimal Control of Two Queues with Server Setup Times and its Analysis , 1987, SIAM J. Comput..

[2]  J. A. Buzacott,et al.  Models of flexible manufacturing systems with limited local buffers , 1986 .

[3]  M. Yadin,et al.  Queueing Systems with a Removable Service Station , 1963 .

[4]  Shaler Stidham,et al.  On the Optimality of Single-Server Queuing Systems , 1970, Oper. Res..

[5]  James T. Lin,et al.  Picking strategies to the two‐carousel‐single‐server system in an automated warehouse , 1993 .

[6]  S. Lippman.  Semi-Markov Decision Processes with Unbounded Rewards , 1973 .

[7]  Colin E. Bell,et al.  Characterization and Computation of Optimal Policies for Operating an M/G/1 Queuing System with Removable Server , 1971, Oper. Res..

[8]  El-Kébir Boukas,et al.  Manufacturing flow control and preventing maintenance: a stochastic control approach , 1988 .

[9]  Jack S. Sykes,et al.  Simplified Analysis of an Alternating-Priority Queuing Model with Setup Times , 1970, Oper. Res..

[10]  J. Michael Harrison,et al.  A Priority Queue with Discounted Linear Costs , 1975, Oper. Res..

[11]  Erhan Çinlar,et al.  Introduction to stochastic processes , 1974 .

[12]  B. Hajek.  Optimal control of two interacting service stations , 1982, 1982 21st IEEE Conference on Decision and Control.

[13]  J. Baras,et al.  Two competing queues with linear costs and geometric service requirements: the μc-rule is often optimal , 1985, Advances in Applied Probability.

[14]  Offer Kella.  The threshold policy in the M/G/1 queue with server vacations , 1989 .

[15]  K. R. Balachandran.  Parametric Priority Rules: An Approach to Optimization in Priority Queues , 1970, Oper. Res..

[16]  Jean Walrand,et al.  The c# rule revisited , 1985 .

[17]  Shaler Stidham,et al.  Monotonic and Insensitive Optimal Policies for Control of Queues with Undiscounted Costs , 1989, Oper. Res..

[18]  Paul J. Schweitzer,et al.  Iterative Aggregation-Disaggregation Procedures for Discounted Semi-Markov Reward Processes , 1985, Oper. Res..

[19]  Eldon A. Gunn,et al.  Some models of queueing control with switchover , 1991 .

[20]  Steven A. Lippman,et al.  An M/M/1 Dynamic Priority Queue with Optional Promotion , 1981, Oper. Res..

[21]  Abraham Seidmann,et al.  On-line scheduling of a robotic manufacturing cell with stochastic sequence-dependent processing rates , 1987 .

[22]  Richard F. Serfozo,et al.  M/M/1 Queueing Decision Processes with Monotone Hysteretic Optimal Policies , 1984, Oper. Res..

[23]  P. Schweitzer.  Iterative solution of the functional equations of undiscounted Markov renewal programming , 1971 .

[24]  Anthony Ephremides,et al.  Control and optimization methods in communication network problems , 1989 .

[25]  J. George Shanthikumar,et al.  Optimal Dynamic Assignment of Customers to Heterogeneous Servers in Parallel , 1992, Oper. Res..

[26]  Fabien Chauny,et al.  Dynamic programming solution to the stochastic multiple lot dispatching in an FMS , 1988, [Proceedings] 1988 International Conference on Computer Integrated Manufacturing.

[27]  Steven A. Lippman,et al.  Applying a New Device in the Optimization of Exponential Queuing Systems , 1975, Oper. Res..

[28]  P. R. Kumar,et al.  Optimal control of a queueing system with two heterogeneous servers , 1984 .

[29]  David D. Yao,et al.  Optimal scheduling control of a flexible machine , 1990, IEEE Trans. Robotics Autom..

[30]  Shaler Stidham,et al.  Optimal Control of Queueing Systems , 1974 .

[31]  Sahney Vk.  Scheduling data transmission under an {si; o} policy , 1972 .

[32]  Paul J. Schweitzer,et al.  Solving Markovian decision processes by successive elimination of variables , 1988 .

[33]  R. Deb.  Optimal Dispatching of a Finite Capacity Shuttle. , 1978 .

[34]  J. George Shanthikumar.  On Stochastic Decomposition in M/G/1 Type Queues with Generalized Server Vacations , 1988, Oper. Res..

[35]  Ulrich D. Holzbaur,et al.  Decision Processes with Monotone Hysteretic Policies , 1988, Oper. Res..

[36]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[37]  P. L’Ecuyer,et al.  Approximation and bounds in discrete event dynamic programming , 1986 .

[38]  Mandyam M. Srinivasan,et al.  Control policies for the M X /g/ 1 queueing system , 1989 .

[39]  Jr. Shaler Stidham.  Optimal control of admission to a queueing system , 1985 .

[40]  C. E. Agnew,et al.  Dynamic Modeling and Control of Congestion-Prone Systems , 1976, Oper. Res..

[41]  E. Mansfield.  The Diffusion of Flexible Manufacturing Systems in Japan, Europe and the United States , 1993 .

[42]  J. Michael Harrison,et al.  Dynamic Scheduling of a Multiclass Queue: Discount Optimality , 1975, Oper. Res..

[43]  George Liberopoulos,et al.  Perturbation Analysis for the Design of Flexible Manufacturing System Flow Controllers , 1992, Oper. Res..

[44]  Stanley B. Gershwin,et al.  Hierarchical flow control: a framework for scheduling and planning discrete events in manufacturing systems , 1989, Proc. IEEE.

[45]  Colin E. Bell.  Efficient Operation of Optional-Priority Queuing Systems , 1973, Oper. Res..

[46]  Donald M. Topkis,et al.  Minimizing a Submodular Function on a Lattice , 1978, Oper. Res..

[47]  J. Keilson,et al.  Dynamics of the M/G/1 Vacation Model , 1987, Oper. Res..

[48]  D. S. Szarkowicz,et al.  Optimal Control of an M/M/S Queueing System , 1985, Oper. Res..

[49]  Matthew J. Sobel.  Optimal Operation of Queues , 1974 .

[50]  William G. Marchal,et al.  State Dependence in M/G/1 Server-Vacation Models , 1988, Oper. Res..

[51]  Michael J. Magazine,et al.  A Classified Bibliography of Research on Optimal Design and Control of Queues , 1977, Oper. Res..

[52]  Lajos Takács.  Two Queues Attended by a Single Server , 1968, Oper. Res..

[53]  Jean Walrand,et al.  A note on optimal control of a queuing system with two heterogeneous servers , 1984 .

[54]  Awi Federgruen,et al.  Characterization and Optimization of Achievable Performance in General Queueing Systems , 1988, Oper. Res..

[55]  P. Schweitzer,et al.  Part selection policy for a flexible manufacturing cell feeding several production lines , 1984 .

[56]  John A. Buzacott,et al.  Stochastic models of manufacturing systems , 1993 .

[57]  T. B. Crabill.  Optimal Control of a Service Facility with Variable Exponential Service Times and Constant Arrival Rate , 1972 .

[58]  R. Bellman.  Dynamic programming. , 1957, Science.

[59]  Derek Robinson.  Optimization of Priority Queues---A Semi-Markov Decision Chain Approach , 1978 .

[60]  Martin Eisenberg.  Two Queues with Changeover Times , 1971, Oper. Res..

[61]  R. Serfozo.  Optimal control of random walks, birth and death processes, and queues , 1981, Advances in Applied Probability.

[62]  J. Gittins.  Bandit processes and dynamic allocation indices , 1979 .

[63]  Kashi R. Balachandran.  Queue Length Dependent Priority Queues , 1971 .

[64]  J. A. Buzacott,et al.  Models for Understanding Flexible Manufacturing Systems , 1980 .