Control Problems in Telecommunications: The Heavy Traffic Approach

The goal of this chapter is to demonstrate the usefulness of analytical and numerical methods of stochastic control theory in the design, analysis and control of telecommunication networks. The emphasis will be concentrated on the heavy traffic approach for queueing type systems in which there is little idle time and the queue length processes can be approximated by reflected diffusion processes under suitable scaling. Three principal problems are considered: the multiplexer system, controlled admission in multiserver systems such as ISDN, and the polling or scheduling problem.

[1]  A. Borovkov.  Some Limit Theorems in the Theory of Mass Service , 1964 .

[2]  A. Borovkov.  Some Limit Theorems in the Theory of Mass Service, II Multiple Channels Systems , 1965 .

[3]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[4]  D. Iglehart,et al.  Multiple channel queues in heavy traffic. II: sequences, networks, and batches , 1970, Advances in Applied Probability.

[5]  W. Whitt.  Multiple channel queues in heavy traffic. III: random server selection , 1970, Advances in Applied Probability.

[6]  D. Iglehart,et al.  Multiple channel queues in heavy traffic. I , 1970, Advances in Applied Probability.

[7]  S. Varadhan,et al.  Diffusion processes with boundary conditions , 1971 .

[8]  H. Kunzi,et al.  Lectu re Notes in Economics and Mathematical Systems , 1975 .

[9]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[10]  A. Lemoine.  State of the Art---Networks of Queues: A Survey of Weak Convergence Results , 1978 .

[11]  H. Kushner.  Optimality Conditions for the Average Cost per Unit Time Problem with a Diffusion Model , 1978 .

[12]  G. J. Foschini,et al.  A Basic Dynamic Routing Problem and Diffusion , 1978, IEEE Trans. Commun..

[13]  D. W. Stroock,et al.  Multidimensional Diffusion Processes , 1979 .

[14]  P. Brémaud.  Point Processes and Queues , 1981 .

[15]  J. Harrison,et al.  Reflected Brownian Motion on an Orthant , 1981 .

[16]  Robert J. Elliott,et al.  Stochastic calculus and applications , 1984, IEEE Transactions on Automatic Control.

[17]  Gerard J. Foschini.  Equilibria for diffusion models of pairs of communicating computers - Symmetric case , 1982, IEEE Trans. Inf. Theory.

[18]  D. Mitra,et al.  Stochastic theory of a data-handling system with multiple sources , 1982, The Bell System Technical Journal.

[19]  Ruth J. Williams.  Brownian motion in a wedge with oblique reflection at the boundary , 1985 .

[20]  Martin I. Reiman,et al.  Open Queueing Networks in Heavy Traffic , 1984, Math. Oper. Res..

[21]  Harold J. Kushner,et al.  Approximation and Weak Convergence Methods for Random Processes , 1984 .

[22]  Michael I. Taksar,et al.  Average Optimal Singular Control and a Related Stopping Problem , 1985, Math. Oper. Res..

[23]  A. Borovkov,et al.  Asymptotic Methods in Queueing Theory. , 1986 .

[24]  S. Shreve,et al.  Absolutely continuous and singular stochastic control , 1986 .

[25]  A. Shiryaev,et al.  Limit Theorems for Stochastic Processes , 1987 .

[26]  T. Kurtz.  Approximation of Population Processes , 1987 .

[27]  D. Mitra.  Stochastic theory of a fluid model of producers and consumers coupled by a buffer , 1988, Advances in Applied Probability.

[28]  J. Michael Harrison,et al.  Brownian Models of Queueing Networks with Heterogeneous Customer Populations , 1988 .

[29]  Lawrence M. Wein,et al.  Scheduling networks of queues: Heavy traffic analysis of a simple open network , 1989, Queueing Syst. Theory Appl..

[30]  M. Reiman.  Asymptotically optimal trunk reservation for large trunk groups , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[31]  H. Kushner,et al.  Optimal and approximately optimal control policies for queues in heavy traffic , 1989 .

[32]  Anthony Ephremides,et al.  Control and optimization methods in communication network problems , 1989 .

[33]  Moshe Sidi,et al.  Polling systems: applications, modeling, and optimization , 1990, IEEE Trans. Commun..

[34]  P. Dupuis,et al.  On oblique derivative problems for fully nonlinear second-order elliptic partial differential equations on nonsmooth domains , 1990 .

[35]  J. Sztrik.  An introduction to queuing networks , 1990 .

[36]  Lawrence M. Wein,et al.  Optimal Control of a Two-Station Brownian Network , 2015, Math. Oper. Res..

[37]  H. Kushner.  Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems , 1990 .

[38]  J. Michael Harrison,et al.  The QNET method for two-moment analysis of open queueing networks , 1990, Queueing Syst. Theory Appl..

[39]  L. F. Martins,et al.  Routing and singular control for queueing networks in heavy traffic , 1990 .

[40]  J. Harrison,et al.  Steady-State Analysis of RBM in a Rectangle: Numerical Methods and A Queueing Application , 1991 .

[41]  C. Knessl,et al.  Heavy-traffic analysis of a data-handling system with many sources , 1991 .

[42]  C. Knessl.  On the diffusion approximation to two parallel queues with processor sharing , 1991 .

[43]  L. F. Martins,et al.  Numerical Methods for Stochastic Singular Control Problems , 1991 .

[44]  P. Dupuis,et al.  On Lipschitz continuity of the solution mapping to the Skorokhod problem , 1991 .

[45]  J. Dai.  Steady-state analysis of reflected Brownian motions: characterization, numerical methods and queueing applications , 1991 .

[46]  C. Laws.  Resource pooling in queueing networks with dynamic routing , 1992, Advances in Applied Probability.

[47]  J. Harrison,et al.  Reflected Brownian Motion in an Orthant: Numerical Methods for Steady-State Analysis , 1992 .

[48]  Anwar Elwalid,et al.  Fluid models for the analysis and design of statistical multiplexing with loss priorities on multiple classes of bursty traffic , 1992, [Proceedings] IEEE INFOCOM '92: The Conference on Computer Communications.

[49]  F. P. Kelly,et al.  Dynamic routing in open queueing networks: Brownian models, cut constraints and resource pooling , 1993, Queueing Syst. Theory Appl..

[50]  Harold J. Kushner,et al.  Heavy Traffic Analysis of a Data Transmission System with Many Independent Sources , 1993, SIAM J. Appl. Math..

[51]  J. Harrison,et al.  The QNET Method for Two-Moment Analysis of Closed Manufacturing Systems , 1993 .

[52]  Harold J. Kushner,et al.  Numerical methods for controlled and uncontrolled multiplexing and queueing systems , 1994, Queueing Syst. Theory Appl..

[53]  Harold J. Kushner,et al.  A Numerical Method for Controlled Routing in Large Trunk Line Networks via Stochastic Control Theory , 1994, INFORMS J. Comput..

[54]  Harold J. Kushner,et al.  Controlled and optimally controlled multiplexing systems: A numerical exploration , 1995, Queueing Syst. Theory Appl..

[55]  H. Kushner,et al.  An effective numerical method for controlled routing in large trunk line networks , 1995 .

[56]  J. V. Mieghem.  Dynamic Scheduling with Convex Delay Costs: The Generalized CU Rule , 1995 .

[57]  H. Kushner.  Control of Trunk Line Systems in Heavy Traffic , 1995 .

[58]  F. Kelly,et al.  Stochastic networks : theory and applications , 1996 .

[59]  L. F. Martins,et al.  Heavy Traffic Convergence of a Controlled, Multiclass Queueing System , 1996 .

[60]  L. F. Martins,et al.  Heavy Traffic Analysis of a Controlled Multiclass Queueing Network via Weak Convergence Methods , 1996 .

[61]  C. Zhou,et al.  The QNET Method for Re-Entrant Queueing Networks with Priority Disciplines , 1997, Oper. Res..

[62]  Jan A. Van Mieghem,et al.  Dynamic Control of Brownian Networks: State Space Collapse and Equivalent Workload Formulations , 1997 .

[63]  A. Mandelbaum,et al.  State-dependent stochastic networks. Part I. Approximations and applications with continuous diffusion limits , 1998 .

[64]  Lawrence M. Wein,et al.  Dynamic Scheduling of a Two-Class Queue with Setups , 2011, Oper. Res..

[65]  Ruth J. Williams,et al.  Diffusion approximations for open multiclass queueing networks: sufficient conditions involving state space collapse , 1998, Queueing Syst. Theory Appl..

[66]  Maury Bramson,et al.  State space collapse with application to heavy traffic limits for multiclass queueing networks , 1998, Queueing Syst. Theory Appl..

[67]  J. Harrison.  Heavy traffic analysis of a system with parallel servers: asymptotic optimality of discrete-review policies , 1998 .

[68]  Rayadurgam Srikant,et al.  Diffusion approximations for models of congestion control in high-speed networks , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[69]  J. Michael Harrison,et al.  Heavy traffic resource pooling in parallel‐server systems , 1999, Queueing Syst. Theory Appl..

[70]  H. Kushner,et al.  Admission Control for Combined Guaranteed Performance and Best Effort Communications Systems Under Heavy Traffic , 1999 .

[71]  H. Kushner,et al.  Optimal control of assignment of jobs to processors under heavy traffic , 2000 .

[72]  H. Kushner.  Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[73]  Lawrence M. Wein,et al.  The Stochastic Economic Lot Scheduling Problem: Heavy Traffic Analysis of Dynamic Cyclic Policies , 2000, Oper. Res..

[74]  Tariq Samad.  Perspectives in Control Engineering Technologies, Applications, and New Directions , 2000 .

[75]  Tariq Samad.  Control of Communication Networks , 2001 .

[76]  H. Kushner.  Heavy Traffic Analysis of Controlled Queueing and Communication Networks , 2001 .

[77]  Eitan Altman,et al.  Control of Polling in Presence of Vacations in Heavy Traffic with Applications to Satellite and Mobile Radio Systems , 2002, SIAM J. Control. Optim..