Fluid analysis of arrival routing

In Hajek's arrival routing problem (1984), customers are routed to one of n queues to minimize average holding cost. Interarrival and service times are exponentially distributed. We solve the associated fluid model. The optimal fluid policy tells us the asymptotic slopes of the switching surfaces in the original problem when the queues are large. If these slopes are nonzero, then numerical tests indicate that the fluid policy performs well in the original stochastic network. The fluid policy also indicates the approximate path that will be taken to recover from large queues: Routing only switches to queues with larger holding cost and once a large queue empties it will remain approximately empty.

[1]  B. Hajek Optimal control of two interacting service stations , 1982, 1982 21st IEEE Conference on Decision and Control.

[2]  Hong Chen,et al.  Discrete Flow Networks: Bottleneck Analysis and Fluid Approximations , 1991, Math. Oper. Res..

[3]  Hong Chen,et al.  On the asymptote of the optimal routing policy for two service stations , 1993, IEEE Trans. Autom. Control..

[4]  Gideon Weiss,et al.  On optimal draining of re-entrant fluid lines , 1995 .

[5]  Florin Avram,et al.  Fluid models of sequencing problems in open queueing networks; an optimal control approach , 1995 .

[6]  Sean P. Meyn,et al.  Stability and convergence of moments for multiclass queueing networks via fluid limit models , 1995, IEEE Trans. Autom. Control..

[7]  Sean P. Meyn The Policy Improvement Algorithm for Markov Decision Processes , 1997 .

[8]  Sean P. Meyn The policy iteration algorithm for average reward Markov decision processes with general state space , 1997, IEEE Trans. Autom. Control..

[9]  D. Bertsimas,et al.  A New Algorithm for State-Constrained Separated Continuous Linear Programs , 1999 .

[10]  Sean P. Meyn Feedback regulation for sequencing and routing in multiclass queueing networks , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[11]  C. Maglaras Discrete-review policies for scheduling stochastic networks: trajectory tracking and fluid-scale asymptotic optimality , 2000 .

[12]  Sean P. Meyn Sequencing and Routing in Multiclass Queueing Networks Part I: Feedback Regulation , 2001, SIAM J. Control. Optim..