Stable and scalable congestion control for high-speed heterogeneous networks

For any congestion control mechanisms, the most fundamental design objectives are stability and scalability. However, achieving both properties are very challenging in such a heterogeneous environment as the Internet. From the end-users' perspective, heterogeneity is due to the fact that different flows have different routing paths and therefore different communication delays, which can significantly affect stability of the entire system. In this work, we successfully address this problem by first proving a sufficient and necessary condition for a system to be stable under arbitrary delay. Utilizing this result, we design a series of practical congestion control protocols (MKC and JetMax) that achieve stability regardless of delay as well as many additional appealing properties. From the routers' perspective, the system is heterogeneous because the incoming traffic is a mixture of short- and long-lived, TCP and non-TCP flows. This imposes a severe challenge on traditional buffer sizing mechanisms, which are derived using the simplistic model of a single or multiple synchronized long-lived TCP flows. To overcome this problem, we take a control-theoretic approach and design a new intelligent buffer sizing scheme called Adaptive Buffer Sizing (ABS), which based on the current incoming traffic, dynamically sets the optimal buffer size under the target performance constraints. Our extensive simulation results demonstrate that ABS exhibits quick responses to changes of traffic load, scalability to a large number of incoming flows, and robustness to generic Internet traffic.

[1]  Leandros Tassiulas,et al.  A Simple Rate Control Algorithm for Maximizing Total User Utility. , 2001, INFOCOM 2001.

[2]  Nicolas D. Georganas,et al.  Analysis of an ATM buffer with self-similar ("fractal") input traffic , 1995, Proceedings of INFOCOM'95.

[3]  Frank Kelly,et al.  Charging and rate control for elastic traffic , 1997, Eur. Trans. Telecommun..

[4]  Yang Richard Yang,et al.  General AIMD congestion control , 2000, Proceedings 2000 International Conference on Network Protocols.

[5]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[6]  R. Srikant,et al.  End-to-end congestion control schemes: utility functions, random losses and ECN marks , 2003, TNET.

[7]  Mark Handley,et al.  Equation-based congestion control for unicast applications , 2000, SIGCOMM.

[8]  Dmitri Loguinov,et al.  Emulating AQM from end hosts , 2007, SIGCOMM.

[9]  Donald F. Towsley,et al.  On designing improved controllers for AQM routers supporting TCP flows , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[10]  Srisankar S. Kunniyur,et al.  AntiECN marking: a marking scheme for high bandwidth delay connections , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[11]  Iven M. Y. Mareels,et al.  MaxNet: Faster Flow Control Convergence , 2004, NETWORKING.

[12]  E. Kaszkurewicz,et al.  Matrix diagonal stability in systems and computation , 1999 .

[13]  Richard Bronson,et al.  Schaum's Outline of Theory and Problems of Matrix Operations , 1988 .

[14]  Walter Willinger,et al.  An SLA perspective on the router buffer sizing problem , 2008, PERV.

[15]  Cheng Jin,et al.  FAST TCP: Motivation, Architecture, Algorithms, Performance , 2006, IEEE/ACM Transactions on Networking.

[16]  Cheng-Ching Yu,et al.  Autotuning of PID Controllers: Relay Feedback Approach , 1999 .

[17]  R. Srikant,et al.  Stable, scalable, fair congestion control and AQM schemes that achieve high utilization in the Internet , 2003, IEEE Trans. Autom. Control..

[18]  Carolyn L. Beck,et al.  Impact of File Arrivals and Departures on Buffer Sizing in Core Routers , 2008, INFOCOM 2008.

[19]  Damon Wischik,et al.  Buffer requirements for high-speed routers , 2005 .

[20]  Y. Zhang,et al.  An implementation and experimental study of the explicit control protocol (XCP) , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[21]  kc claffy,et al.  Longitudinal study of Internet traffic in 1998-2003 , 2004 .

[22]  Steven H. Low,et al.  Modelling and stability of FAST TCP , 2005, INFOCOM 2005.

[23]  James Aweya,et al.  A simple, scalable and provably stable explicit rate computation scheme for flow control in communication networks , 2001, Int. J. Commun. Syst..

[24]  Igor Bisio,et al.  Analytical expression and performance evaluation of TCP packet loss probability over geostationary satellite , 2004, IEEE Communications Letters.

[25]  Fernando Paganini,et al.  FAST TCP: from theory to experiments , 2005, IEEE Network.

[26]  Tobias Harks,et al.  Utility Max-Min Fair Congestion Control with Time-Varying Delays , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[27]  Guido Appenzeller,et al.  Sizing router buffers , 2004, SIGCOMM '04.

[28]  Injong Rhee,et al.  CUBIC: a new TCP-friendly high-speed TCP variant , 2008, OPSR.

[29]  Raj Jain,et al.  Analysis of the Increase and Decrease Algorithms for Congestion Avoidance in Computer Networks , 1989, Comput. Networks.

[30]  Steven H. Low,et al.  A duality model of TCP and queue management algorithms , 2003, TNET.

[31]  A. Bhaya,et al.  A delay-independent robust stability condition for linear discrete-time systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[32]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[33]  Seong-Ryong Kang,et al.  Delayed stability and performance of distributed congestion control , 2004, SIGCOMM 2004.

[34]  R. Srikant,et al.  Rate-based versus queue-based models of congestion control , 2004, IEEE Transactions on Automatic Control.

[35]  Hao Jiang,et al.  Buffer sizing for congested Internet links , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[36]  Franco Blanchini,et al.  Robust rate control for integrated services packet networks , 2002, TNET.

[37]  Michael K. Wong,et al.  Novel explicit rate congestion control algorithm , 1998, Other Conferences.

[38]  Soracha Nananukul,et al.  Rational Interpolation for Rare Event Probabilities , 1996 .

[39]  Donald F. Towsley,et al.  Modeling TCP throughput: a simple model and its empirical validation , 1998, SIGCOMM '98.

[40]  Glenn Vinnicombe,et al.  On the stability of end-to-end congestion control for the internet , 2001 .

[41]  Kang G. Shin,et al.  On the modeling and optimization of discontinuous network congestion control systems , 2004, IEEE INFOCOM 2004.

[42]  V. Jacobson,et al.  Congestion avoidance and control , 1988, CCRV.

[43]  N. McKeown,et al.  Buffer sizing in all-optical packet switches , 2006, 2006 Optical Fiber Communication Conference and the National Fiber Optic Engineers Conference.

[44]  Matthew Mathis,et al.  The macroscopic behavior of the TCP congestion avoidance algorithm , 1997, CCRV.

[45]  Hayder Radha,et al.  End-to-end rate-based congestion control: convergence properties and scalability analysis , 2003, TNET.

[46]  Robert Shorten,et al.  On queue provisioning, network efficiency and the transmission control protocol , 2007, IEEE/ACM Trans. Netw..

[47]  Fernando Paganini,et al.  Dynamics of TCP/RED and a scalable control , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[48]  Sally Floyd,et al.  The NewReno Modification to TCP's Fast Recovery Algorithm , 2004, RFC.

[49]  Lachlan L. H. Andrew,et al.  Understanding XCP: Equilibrium and Fairness , 2005, IEEE/ACM Transactions on Networking.

[50]  Glenn Vinnicombe,et al.  ON THE STABILITY OF NETWORKS OPERATING TCP-LIKE CONGESTION CONTROL , 2002 .

[51]  QUTdN QeO,et al.  Random early detection gateways for congestion avoidance , 1993, TNET.

[52]  David L. Black,et al.  The Addition of Explicit Congestion Notification (ECN) to IP , 2001, RFC.

[53]  A. Peterson,et al.  Difference Equations: An Introduction with Applications , 2000 .

[54]  Marina Thottan,et al.  Router buffer sizing revisited: the role of the output/input capacity ratio , 2007, CoNEXT '07.

[55]  Steven H. Low,et al.  REM: active queue management , 2001, IEEE Network.

[56]  Jonathan S. Turner,et al.  Simulation Perspectives on Link Buffer Sizing , 2007, Simul..

[57]  D. Siljak,et al.  On the convergence of parallel asynchronous block-iterative computations , 1990 .

[58]  San-qi Li,et al.  An ABR feedback control scheme with tracking , 1997, Proceedings of INFOCOM '97.

[59]  Tetsuya Takine,et al.  Loss probability in a finite discrete-time queue in terms of the steady state distribution of an infinite queue , 1999, Queueing Syst. Theory Appl..

[60]  Donald F. Towsley,et al.  Part II: control theory for buffer sizing , 2005, CCRV.

[61]  Sally Floyd,et al.  HighSpeed TCP for Large Congestion Windows , 2003, RFC.

[62]  Eddie Kohler,et al.  Internet research needs better models , 2003, CCRV.

[63]  Injong Rhee,et al.  Binary increase congestion control (BIC) for fast long-distance networks , 2004, IEEE INFOCOM 2004.

[64]  Tom Kelly,et al.  Scalable TCP: improving performance in highspeed wide area networks , 2003, CCRV.

[65]  Pei Cao,et al.  NS-2 TCP-Linux: an NS-2 TCP implementation with congestion control algorithms from Linux , 2006 .

[66]  Laurent Massoulié,et al.  Stability of distributed congestion control with heterogeneous feedback delays , 2002, IEEE Trans. Autom. Control..

[67]  Vern Paxson,et al.  TCP Congestion Control , 1999, RFC.

[68]  V. Prasolov Problems and theorems in linear algebra , 1994 .

[69]  R. Srikant,et al.  Pitfalls in the fluid modeling of RTT variations in window-based congestion control , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[70]  Dmitri Loguinov,et al.  JetMax: Scalable Max-Min Congestion Control for High-Speed Heterogeneous Networks , 2006, INFOCOM.

[71]  Nick McKeown,et al.  Update on buffer sizing in internet routers , 2006, CCRV.

[72]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[73]  Vern Paxson,et al.  Empirically derived analytic models of wide-area TCP connections , 1994, TNET.

[74]  Tim Roughgarden,et al.  Routers with Very Small Buffers , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[75]  Xinbing Wang,et al.  Performance analysis of TCP/AQM with generalized AIMD under intermediate buffer sizes , 2007, Comput. Networks.

[76]  K. Avrachenkov,et al.  Optimal choice of the buffer size in the Internet routers , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[77]  Larry Peterson,et al.  TCP Vegas: new techniques for congestion detection and avoidance , 1994, SIGCOMM 1994.

[78]  Jan A Snyman,et al.  Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms , 2005 .

[79]  Cheng Song,et al.  High performance TCP in ANSNET , 1994, CCRV.

[80]  Ren Wang,et al.  TCP Westwood: congestion window control using bandwidth estimation , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[81]  F. Bonomi,et al.  A novel explicit rate congestion control algorithm , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[82]  Hosam El-Ocla,et al.  TCP congestion avoidance model with congestive loss , 2004, Proceedings. 2004 12th IEEE International Conference on Networks (ICON 2004) (IEEE Cat. No.04EX955).

[83]  Geir E. Dullerud,et al.  Global stability of Internet congestion controllers with heterogeneous delays , 2006, IEEE/ACM Transactions on Networking.

[84]  Manish Jain,et al.  On the Effectiveness of Delay-Based Congestion Avoidance , 2004 .

[85]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[86]  Eugenius Kaszkurewicz,et al.  Further results on stability of asynchronous discrete-time linear systems , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[87]  Josef Stoer,et al.  Numerische Mathematik 1 , 1989 .

[88]  F. L. Bauer,et al.  Absolute and monotonic norms , 1961 .

[89]  Mark Handley,et al.  Congestion control for high bandwidth-delay product networks , 2002, SIGCOMM '02.

[90]  David Ott,et al.  Tuning RED for Web traffic , 2001, TNET.

[91]  R. Srikant,et al.  Global stability of congestion controllers for the Internet , 2003, IEEE Trans. Autom. Control..

[92]  Moshe Zukerman,et al.  MaxNet: a congestion control architecture , 2002, IEEE Communications Letters.

[93]  Ramesh Johari,et al.  End-to-end congestion control for the internet: delays and stability , 2001, TNET.

[94]  R. Srikant,et al.  Analysis and design of an adaptive virtual queue (AVQ) algorithm for active queue management , 2001, SIGCOMM '01.

[95]  Donald F. Towsley,et al.  Analysis and design of controllers for AQM routers supporting TCP flows , 2002, IEEE Trans. Autom. Control..

[96]  Dmitri Loguinov,et al.  Analysis of rate-distortion functions and congestion control in scalable internet video streaming , 2003, NOSSDAV '03.

[97]  A. C. Tsoi,et al.  A new approach to adaptive fuzzy control: the controller output error method , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[98]  P. Glendinning Stability, Instability and Chaos: An Introduction to the Theory of Nonlinear Differential Equations , 1994 .

[99]  R. Srikant,et al.  A time-scale decomposition approach to adaptive explicit congestion notification (ECN) marking , 2002, IEEE Trans. Autom. Control..

[100]  Steven H. Low,et al.  Optimization flow control—I: basic algorithm and convergence , 1999, TNET.

[101]  Glenn Vinnicombe,et al.  Robust congestion control for the Internet , 2002 .

[102]  A. L. Narasimha Reddy,et al.  LTCP: improving the performance of TCP in highspeed networks , 2006, CCRV.

[103]  Jin Cao,et al.  Internet Traffic Tends Toward Poisson and Independent as the Load Increases , 2003 .

[104]  T. Mori,et al.  Delay-independent stability criteria for discrete-delay systems , 1982 .

[105]  Nick McKeown,et al.  Processor Sharing Flows in the Internet , 2005, IWQoS.

[106]  Aleksandar Kuzmanovic,et al.  TCP-LP: a distributed algorithm for low priority data transfer , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[107]  C.M. Kellett,et al.  Sizing Internet Router Buffers, Active Queue Management, and the Lur'e Problem , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[108]  Aaron Falk,et al.  Specification for the Explicit Control Protocol (XCP) , 2007 .

[109]  Dmitri Loguinov,et al.  JetMax: Scalable Max-Min Congestion Control for High-Speed Heterogeneous Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[110]  Jonathan S. Turner,et al.  Link buffer sizing: a new look at the old problem , 2005, 10th IEEE Symposium on Computers and Communications (ISCC'05).

[111]  Fernando Paganini,et al.  A Control Theoretical Look at Internet Congestion Control , 2003 .

[112]  Nick McKeown,et al.  Part I: buffer sizes for core routers , 2005, CCRV.

[113]  R. Decarlo,et al.  Perspectives and results on the stability and stabilizability of hybrid systems , 2000, Proceedings of the IEEE.