Sequencing and Routing in Multiclass Queueing Networks Part I: Feedback Regulation

This paper establishes new criteria for stability and for instability of multiclass network models under a given stationary policy. It also extends previous results on the approximation of the solution to the average cost optimality equations through an associated fluid model: It is shown that an optimized network possesses a fluid limit model which is itself optimal with respect to a total cost criterion. A general framework for constructing control algorithms for multiclass queueing networks is proposed based on these general results. Network sequencing and routing problems are considered as special cases. The following aspects of the resulting feedback regulation policies are developed in the paper: The policies are stabilizing and are, in fact, geometrically ergodic for a Markovian model. Numerical examples are given. In each case it is shown that the feedback regulation policy closely resembles the average-cost optimal policy. A method is proposed for reducing variance in simulation for a network controlled using a feedback regulation policy.

[1]  Steven A. Lippman,et al.  Applying a New Device in the Optimization of Exponential Queuing Systems , 1975, Oper. Res..

[2]  B. Doshi.  Optimal control of the service rate in an M/G/1 queueing system , 1978, Advances in Applied Probability.

[3]  B. Hajek.  Optimal control of two interacting service stations , 1982, 1982 21st IEEE Conference on Decision and Control.

[4]  B. Hajek.  Optimal control of two interacting service stations , 1982, CDC 1982.

[5]  Stephen S. Lavenberg,et al.  Computer Performance Modeling Handbook , 1983, Int. CMG Conference.

[6]  P. R. Kumar,et al.  Optimal control of a queueing system with two heterogeneous servers , 1984 .

[7]  Lawrence M. Wein,et al.  Scheduling networks of queues: Heavy traffic analysis of a simple open network , 1989, Queueing Syst. Theory Appl..

[8]  D. Yao,et al.  Stochastic monotonicity in general queueing networks , 1989, Journal of Applied Probability.

[9]  W. Whitt.  Planning queueing simulations , 1989 .

[10]  P. R. Kumar,et al.  Dynamic instabilities and stabilization methods in distributed real-time scheduling of manufacturing systems , 1990 .

[11]  Hong Chen,et al.  Discrete Flow Networks: Bottleneck Analysis and Fluid Approximations , 1991, Math. Oper. Res..

[12]  Rene L. Cruz,et al.  A calculus for network delay, Part I: Network elements in isolation , 1991, IEEE Trans. Inf. Theory.

[13]  John N. Tsitsiklis,et al.  Optimization of multiclass queuing networks: polyhedral and nonlinear characterizations of achievable performance , 1994 .

[14]  Søren Asmussen,et al.  Queueing Simulation in Heavy Traffic , 1992, Math. Oper. Res..

[15]  J. Ou,et al.  Performance Bounds for Scheduling Queueing Networks , 1992 .

[16]  QUTdN QeO,et al.  Random early detection gateways for congestion avoidance , 1993, TNET.

[17]  F. P. Kelly,et al.  Dynamic routing in open queueing networks: Brownian models, cut constraints and resource pooling , 1993, Queueing Syst. Theory Appl..

[18]  Stanley B. Gershwin,et al.  Manufacturing Systems Engineering , 1993 .

[19]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[20]  Hong Chen,et al.  Dynamic Scheduling of a Multiclass Fluid Network , 1993, Oper. Res..

[21]  S. Sushanth Kumar,et al.  Performance bounds for queueing networks and scheduling policies , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[22]  V. Jacobson,et al.  Random early detection gateways for congestion avoidance , 1993, TNET.

[23]  Ruth J. Williams,et al.  Lyapunov Functions for Semimartingale Reflecting Brownian Motions , 1994 .

[24]  M. Bramson.  Instability of FIFO Queueing Networks with Quick Service Times , 1994 .

[25]  Sean P. Meyn,et al.  Stability of Generalized Jackson Networks , 1994 .

[26]  M. Bramson.  Instability of FIFO Queueing Networks , 1994 .

[27]  David D. Yao,et al.  Scheduling semiconductor lines using a fluid network model , 1994, IEEE Trans. Robotics Autom..

[28]  Gideon Weiss,et al.  On optimal draining of re-entrant fluid lines , 1995 .

[29]  Alan Weiss,et al.  Large Deviations For Performance Analysis: Queues, Communication and Computing , 1995 .

[30]  J. R. Perkins,et al.  Optimal control of pull manufacturing systems , 1995 .

[31]  M. Pullan.  Forms of Optimal Solutions for Separated Continuous Linear Programs , 1995 .

[32]  J. Dai.  On Positive Harris Recurrence of Multiclass Queueing Networks: A Unified Approach Via Fluid Limit Models , 1995 .

[33]  Sean P. Meyn,et al.  Stability and convergence of moments for multiclass queueing networks via fluid limit models , 1995, IEEE Trans. Autom. Control..

[34]  Sunil Kumar,et al.  Fluctuation smoothing policies are stable for stochastic re-entrant lines , 1996, Discret. Event Dyn. Syst..

[35]  Gideon Weiss,et al.  Stability and Instability of Fluid Models for Reentrant Lines , 1996, Math. Oper. Res..

[36]  Sean P. Meyn,et al.  Duality and linear programs for stability and performance analysis of queuing networks and scheduling policies , 1996, IEEE Trans. Autom. Control..

[37]  Sean P. Meyn,et al.  Fluid Network Models: Linear Programs for Control and Performance Bounds , 1996 .

[38]  Sean P. Meyn.  The Policy Improvement Algorithm for Markov Decision Processes , 1997 .

[39]  Costis Maglaras.  Design of dynamic control policies for stochastic processing networks via fluid models , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[40]  Sean P. Meyn.  The policy iteration algorithm for average reward Markov decision processes with general state space , 1997, IEEE Trans. Autom. Control..

[41]  Panganamala Ramana Kumar,et al.  The Delay of Open Markovian Queueing Networks: Uniform Functional Bounds, Heavy Traffic Pole Multiplicities, and Stability , 1997, Math. Oper. Res..

[42]  R. Agrawal,et al.  Performance Bounds for Flow Control Protocols 1 , 1998 .

[43]  Sean P. Meyn,et al.  Value iteration and optimization of multiclass queueing networks , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[44]  D. Bertsimas,et al.  A New Algorithm for State-Constrained Separated Continuous Linear Programs , 1999 .

[45]  J. Michael Harrison,et al.  Heavy traffic resource pooling in parallel‐server systems , 1999, Queueing Syst. Theory Appl..

[46]  Ann Appl,et al.  On the Positive Harris Recurrence for Multiclass Queueing Networks: a Uniied Approach via Uid Limit Models , 1999 .

[47]  Dynamic Scheduling of a System with Two Parallel Servers: Asymptotic Optimality of a Continuous Review Threshold Policy in Heavy Traffic , 1999 .

[48]  Sean P. Meyn,et al.  Variance Reduction for Simulation in Multiclass Queueing Networks , 1999 .

[49]  Kavita Ramanan,et al.  A Multiclass Feedback Queueing Network with a Regular Skorokhod Problem , 2000, Queueing Syst. Theory Appl..

[50]  S. Meyn,et al.  Multiplicative ergodicity and large deviations for an irreducible Markov chain , 2000 .

[51]  J. Harrison.  Brownian models of open processing networks: canonical representation of workload , 2000 .

[52]  Sunil Kumar,et al.  A numerical method for solving singular Brownian control problems , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[53]  N. Bäuerle.  Asymptotic optimality of tracking policies in stochastic networks , 2001 .

[54]  S. Meyn,et al.  Spectral theory and limit theorems for geometrically ergodic Markov processes , 2002, math/0209200.

[55]  Gideon Weiss,et al.  A Fluid Heuristic for Minimizing Makespan in Job Shops , 2002, Oper. Res..

[56]  Sean P. Meyn.  Stability and optimization of queueing networks and their fluid models , 2003 .

[57]  Sean P. Meyn.  Sequencing and Routing in Multiclass Queueing Networks Part II: Workload Relaxations , 2003, SIAM J. Control. Optim..