Congestion control of TCP flows in Internet routers by means of index policy

In this paper we address the problem of fast and fair transmission of flows in a router, which is a fundamental issue in networks like the Internet. We model the interaction between a source using the Transmission Control Protocol (TCP) and a bottleneck router with the objective of designing optimal packet admission controls in the router queue. We focus on the relaxed version of the problem obtained by relaxing the fixed buffer capacity constraint that must be satisfied at all time epoch. The relaxation allows us to reduce the multi-flow problem into a family of single-flow problems, for which we can analyze both theoretically and numerically the existence of optimal control policies of special structure. In particular, we show that for a variety of parameters, TCP flows can be optimally controlled in routers by so-called index policies, but not always by threshold policies. We have also implemented the index policy in Network Simulator-3 and tested in a simple topology their applicability in real networks. The simulation results show that the index policy achieves a wide range of desirable properties with respect to fairness between different TCP versions, across users with different round-trip-time and minimum buffer required to achieve full utility of the queue.

[1]  Frank Kelly,et al.  Charging and rate control for elastic traffic , 1997, Eur. Trans. Telecommun..

[2]  FloydSally,et al.  Simulation-based comparisons of Tahoe, Reno and SACK TCP , 1996 .

[3]  A. Kortebi,et al.  Cross-protect: implicit service differentiation and admission control , 2004, 2004 Workshop on High Performance Switching and Routing, 2004. HPSR..

[4]  José Niño-Mora,et al.  Dynamic priority allocation via restless bandit marginal productivity indices , 2007, 2304.06115.

[5]  Vinton G. Cerf,et al.  A protocol for packet network intercommunication , 1974, CCRV.

[6]  Van Jacobson,et al.  Congestion avoidance and control , 1988, SIGCOMM '88.

[7]  Raj Jain,et al.  A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems , 1998, ArXiv.

[8]  Rade Stanojevic,et al.  A critique of recently proposed buffer-sizing strategies , 2007, CCRV.

[9]  R. Weber,et al.  On an index policy for restless bandits , 1990, Journal of Applied Probability.

[10]  Jun Luo,et al.  On the Performance of Primal/Dual Schemes for Congestion Control in Networks with Dynamic Flows , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[11]  Qian Zhang,et al.  A Compound TCP Approach for High-Speed and Long Distance Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[12]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[13]  Nick McKeown,et al.  Processor Sharing Flows in the Internet , 2005, IWQoS.

[14]  Konstantin Avrachenkov,et al.  Optimal congestion control of TCP flows for internet routers , 2012, PERV.

[15]  J. Bather,et al.  Multi‐Armed Bandit Allocation Indices , 1990 .

[16]  David L. Black,et al.  The Addition of Explicit Congestion Notification (ECN) to IP , 2001, RFC.

[17]  Andreas Pitsillides,et al.  Congestion Control in Computer Networks , 2007 .

[18]  Brunilde Sansò,et al.  Optimal anticipative congestion control of flows with time-varying input stream , 2012, Perform. Evaluation.

[19]  P. Whittle Restless bandits: activity allocation in a changing world , 1988, Journal of Applied Probability.

[20]  Vern Paxson,et al.  TCP Congestion Control , 1999, RFC.

[21]  Robert Shorten,et al.  Experimental Evaluation of TCP Protocols for High-Speed Networks , 2007, IEEE/ACM Transactions on Networking.

[22]  Sally Floyd,et al.  Simulation-based comparisons of Tahoe, Reno and SACK TCP , 1996, CCRV.

[23]  Peter Jacko Adaptive Greedy Rules for Dynamic and Stochastic Resource Capacity Allocation Problems , 2010 .

[24]  R. Srikant,et al.  Network Optimization and Control , 2008, Found. Trends Netw..

[25]  Jean C. Walrand,et al.  Fair end-to-end window-based congestion control , 2000, TNET.

[26]  Injong Rhee,et al.  CUBIC: a new TCP-friendly high-speed TCP variant , 2008, OPSR.

[27]  Cheng Jin,et al.  FAST TCP: Motivation, Architecture, Algorithms, Performance , 2006, IEEE/ACM Transactions on Networking.

[28]  P. Whittle Restless Bandits: Activity Allocation in a Changing World , 1988 .

[29]  Mark Handley,et al.  Congestion control for high bandwidth-delay product networks , 2002, SIGCOMM '02.

[30]  Eitan Altman,et al.  Generalized α-fair resource allocation in wireless networks , 2008, 2008 47th IEEE Conference on Decision and Control.

[31]  Christian M. Ernst,et al.  Multi-armed Bandit Allocation Indices , 1989 .

[32]  QUTdN QeO,et al.  Random early detection gateways for congestion avoidance , 1993, TNET.