Control of Polling in Presence of Vacations in Heavy Traffic with Applications to Satellite and Mobile Radio Systems

Consider a queueing system with many queues, each with its own input stream, but with only one server. The server must allocate its time among the queues to minimize or nearly minimize some cost criterion. The allocation of time among the queues is often called polling and is the subject of a large literature. Usually, it is assumed that the queues are always available, and the server can allocate at will. We consider the case where the queues are not always available due to disruption of the connection between them and the server. Such occurrences are common in wireless communications, where any of the mobile sources might become unavailable to the server from time to time due to obstacles, atmospheric or other effects. The possibility of such ``vacations'' complicates the polling problem enormously. Due to the complexity of the basic problem we analyze it in the heavy traffic regime where the server has little idle time over the average requirements. It is shown that the suitable scaled total workloads converge to a controlled limit diffusion process with jumps. The jumps are due to the effects of the vacations. The control enters the dynamics only via its value just before a vacation begins; hence it is only via the jump value that the control affects the dynamics. This type of model has not received much attention. The individual queued workloads and job numbers can be recovered (asymptotically) from the limit scaled workload. This state space collapse is critical for the effective numerical and analytical work, since the limit process is one dimensional. It is also shown, under appropriate conditions, that the arrival process during a vacation can be approximated by the scaled "fluid" process. With a suitable nonlinear discounted cost rate, it is shown that the optimal costs for the physical problems converge to that for the limit problem as the traffic intensity approaches its heavy traffic limit. Explicit solutions are obtained in some simple but important cases, and the $c\mu$-rule is asymptotically optimal if there are no vacations. The stability of the queues is analyzed via a perturbed Liapunov function method, under quite general conditions on the data. Finally, we extend the results to unreliable channels where the data might be received with errors and need to be retransmitted.

[1]  Jean Walrand An introduction to queuing networks , 1988 .

[2]  Leandros Tassiulas,et al.  Dynamic server allocation to parallel queues with randomly varying connectivity , 1993, IEEE Trans. Inf. Theory.

[3]  Adam Shwartz,et al.  Optimal priority assignment: a time sharing approach , 1989 .

[4]  H. Kunita,et al.  On Square Integrable Martingales , 1967, Nagoya Mathematical Journal.

[5]  M. Reiman A multiclass feedback queue in heavy traffic , 1988 .

[6]  G. Papanicolaou,et al.  Stability and Control of Stochastic Systems with Wide-band Noise Disturbances. I , 1978 .

[7]  J. V. Mieghem Dynamic Scheduling with Convex Delay Costs: The Generalized CU Rule , 1995 .

[8]  G. Papanicolaou,et al.  Stability and control of stochastic systems with wide-band noise disturbances , 1977 .

[9]  Leandros Tassiulas,et al.  Optimal anticipative scheduling with asynchronous transmission opportunities , 1995 .

[10]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[11]  Bruce R. Elbert,et al.  The Satellite Communication Applications Handbook (Artech House Space Applications Series) , 2003 .

[12]  Ruth J. Williams,et al.  Diffusion approximations for open multiclass queueing networks: sufficient conditions involving state space collapse , 1998, Queueing Syst. Theory Appl..

[13]  H. Kushner Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[14]  P. Dupuis,et al.  On Lipschitz continuity of the solution mapping to the Skorokhod problem , 1991 .

[15]  H. Kushner Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems , 1990 .

[16]  Kai Liu Stochastic Stability of Differential Equations in Abstract Spaces , 2022 .

[17]  H. Kushner,et al.  Optimal and approximately optimal control policies for queues in heavy traffic , 1989 .

[18]  Bruce Hajek,et al.  Scheduling with asynchronous service opportunities with applications to multiple satellite systems , 1993, IEEE Trans. Autom. Control..

[19]  Armand M. Makowski,et al.  K competing queues with geometric service requirements and linear costs: The μc-rule is always optimal☆ , 1985 .

[20]  Maury Bramson,et al.  State space collapse with application to heavy traffic limits for multiclass queueing networks , 1998, Queueing Syst. Theory Appl..

[21]  Harold J. Kushner,et al.  Stochastic Approximation Algorithms and Applications , 1997, Applications of Mathematics.

[22]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[23]  Martin I. Reiman,et al.  Some diffusion approximations with state space collapse , 1984 .

[24]  B. Elbert The satellite communication applications handbook , 2004 .

[25]  W. Grassman Approximation and Weak Convergence Methods for Random Processes with Applications to Stochastic Systems Theory (Harold J. Kushner) , 1986 .

[26]  J. Sztrik An introduction to queuing networks , 1990 .

[27]  Harold J. Kushner,et al.  Controlled and optimally controlled multiplexing systems: A numerical exploration , 1995, Queueing Syst. Theory Appl..

[28]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[29]  H. Kushner,et al.  Admission Control for Combined Guaranteed Performance and Best Effort Communications Systems Under Heavy Traffic , 1999 .

[30]  Eitan Altman,et al.  Discrete time queues with delayed information , 1995, Queueing Syst. Theory Appl..