Optimal control of arrivals to multiserver queues in a random environment

We study the problem of optimal customer admission to multiserver queues. These queues are assumed to live in an extraneous environment which changes in a semi-Markovian way. Arrivals, service mechanism and random reward/cost structure may all depend on these surroundings. Included as special cases are SM/M/c queues, in particular G/M/c queues, in a random environment. By a direct inductive approach we establish optimality of a generalized control-limit rule depending on the actual environment. Particular emphasis is laid on different applications that show the versatility of the proposed setup.

[1]  E. Çinlar.  QUEUES WITH SEMI-MARKOVIAN ARRIVALS , 1967 .

[2]  K. Hinderer,et al.  Foundations of Non-stationary Dynamic Programming with Discrete Time Parameter , 1970 .

[3]  Shaler Stidham,et al.  Optimal Control of Queueing Systems , 1974 .

[4]  U. Rieder.  Bayesian dynamic programming , 1975, Advances in Applied Probability.

[5]  Steven A. Lippman,et al.  Applying a New Device in the Optimization of Exponential Queuing Systems , 1975, Oper. Res..

[6]  Manfred SchÄl,et al.  Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal , 1975 .

[7]  B. Kirstein.  Monotonicity and comparability of time-homogeneous markov processes with discrete state space , 1976 .

[8]  Dietrich Stoyan,et al.  Qualitative Eigenschaften und Abschätzungen stochastischer Modelle , 1977 .

[9]  Shaler Stidham,et al.  Socially and Individually Optimal Control of Arrivals to a GI/M/1 Queue , 1978 .

[10]  K. M. vanHee,et al.  Bayesian control of Markov chains , 1978 .

[11]  M. Neuts.  A Versatile Markovian Point Process , 1979 .

[12]  H. Schellhaas.  Markov renewal decision processes with finite horizon , 1980 .

[13]  S. Stidham,et al.  Control of arrivals to a stochastic input–output system , 1980, Advances in Applied Probability.

[14]  Hans-Joachim Langen,et al.  Convergence of Dynamic Programming Models , 1981, Math. Oper. Res..

[15]  Marcel F. Neuts,et al.  Matrix-Geometric Solutions in Stochastic Models , 1981 .

[16]  Hans-Joachim Langen.  Applying the method of phases in the optimization of queuing systems , 1982, Advances in Applied Probability.