Admission and routing control with partial information and limited buffers

Problems of admission and routing control for loss systems comprised of a controller and C down-stream servers are studied. We focus on problems in which control actions have to be taken with either delayed or with no information on the state of the down-stream servers. We first consider a problem of routing into C servers and compare the performance of two policies: a static round-robin policy, which does not wait for the delayed information at a risk of losing customers at the busy servers, and a Wait policy, that avoids losses at the servers but risks losses at the controller buffer. We identify regions in which each of the policies performs better. We then study the problem with no information on down-stream servers and propose a timer mechanism to decide when to dispatch an arriving customer. We optimize the value of the timer's parameter. Our study is accompanied with numerical investigations.

[1]  Eitan Altman,et al.  Optimality of monotonic policies for two-action Markovian decision processes, with applications to control of queues with delayed information , 1995, Queueing Syst. Theory Appl..

[2]  Anurag Kumar,et al.  Optimal control of arrivals to queues with delayed queue length information , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[3]  Jessy W. Grizzle,et al.  DECENTRALIZED CONTROL STRATEGY FOR MULTIACCESS BROADCAST NETWORKS. , 1982 .

[4]  Frits C. Schoute Decentralized control in packet switched satellite communication , 1978 .

[5]  E. Altman,et al.  Control of a random walk with noisy delayed information , 1995 .

[6]  Uri Yechiali,et al.  Routing in Queues with Delayed Information , 2003, Queueing Syst. Theory Appl..

[7]  David D. Yao,et al.  Monotonicity properties for the stochastic knapsack , 1990, IEEE Trans. Inf. Theory.

[8]  Anurag Kumar,et al.  On the optimal control of arrivals to a single queue with arbitrary feedback delay , 1997, Queueing Syst. Theory Appl..

[9]  Eitan Altman,et al.  Closed-loop control with delayed information , 1992, SIGMETRICS '92/PERFORMANCE '92.

[10]  Eitan Altman,et al.  Discrete time queues with delayed information , 1995, Queueing Syst. Theory Appl..

[11]  Andreas D. Bovopoulos,et al.  The effect of delayed feedback information on network performance , 1992, Ann. Oper. Res..

[12]  Eitan Altman,et al.  Congestion control as a stochastic control problem with action delays , 1999, Autom..