TCP Rapid: From theory to practice

Delay and rate-based alternatives to TCP congestion-control have been around for nearly three decades and have seen a recent surge in interest. However, such designs have faced significant resistance in being deployed on a wide-scale across the Internet — this has been mostly due to serious concerns about noise in delay measurements, pacing inter-packet gaps, and/or required changes to the standard TCP stack/headers. With the advent of high-speed networking, some of these concerns become even more significant. In this paper, we consider Rapid, a recent proposal for ultra-high speed congestion control, which perhaps stretches each of these challenges to the greatest extent. Rapid adopts a framework of continuous fine-scale bandwidth probing, which requires a potentially different and finely-controlled gap for every packet, high-precision timestamping of received packets, and reliance on fine-scale changes in inter-packet gaps. While simulation-based evaluations of Rapid show that it has outstanding performance gains along several important dimensions, these will not translate to the real-world unless the above challenges are addressed. We design a Linux implementation of Rapid after carefully considering each of these challenges. Our evaluations on a 10Gbps testbed confirm that the implementation can indeed achieve the claimed performance gains, and that it would not have been possible unless each of the above challenges was addressed.

[1]  Michele C. Weigle,et al.  Delay-based early congestion detection and adaptation in TCP: impact on web performance , 2005, Comput. Commun..

[2]  Jasleen Kaur,et al.  Impact of cross traffic burstiness on the packet-scale paradigm , 2011, 2011 18th IEEE Workshop on Local & Metropolitan Area Networks (LANMAN).

[3]  Hao Jiang,et al.  Why is the internet traffic bursty in short time scales? , 2005, SIGMETRICS '05.

[4]  K. K. Ramakrishnan,et al.  NF-TCP: A Network Friendly TCP Variant for Background Delay-Insensitive Applications , 2011, Networking.

[5]  Amin Vahdat,et al.  TIMELY: RTT-based Congestion Control for the Datacenter , 2015, Comput. Commun. Rev..

[6]  Amit Aggarwal,et al.  Understanding the performance of TCP pacing , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[7]  Arun Venkataramani,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tcp Nice: a Mechanism for Background Transfers , 2022 .

[8]  Nitin H. Vaidya,et al.  Is the round-trip time correlated with the number of packets in flight? , 2003, IMC '03.

[9]  Vern Paxson,et al.  Outside the Closed World: On Using Machine Learning for Network Intrusion Detection , 2010, 2010 IEEE Symposium on Security and Privacy.

[10]  Cheng Jin,et al.  FAST TCP: Motivation, Architecture, Algorithms, Performance , 2006, IEEE/ACM Transactions on Networking.

[11]  Andreas Kirstädter,et al.  Chirping for Congestion Control-Implementation Feasibility ∗ , 2010 .

[12]  Zhao Wen-tao,et al.  Efficient available bandwidth estimation for network paths , 2008 .

[13]  Andrea Baiocchi,et al.  YeAH-TCP: Yet Another Highspeed TCP , 2006 .

[14]  Injong Rhee,et al.  Binary increase congestion control (BIC) for fast long-distance networks , 2004, IEEE INFOCOM 2004.

[15]  Tom Kelly,et al.  Scalable TCP: improving performance in highspeed wide area networks , 2003, CCRV.

[16]  Steven H. Low,et al.  TCP Pacing Revisited , 2022 .

[17]  Richard Hughes-Jones,et al.  Evaluation of Advanced TCP Stacks on Fast Long-Distance Production Networks , 2003, Journal of Grid Computing.

[18]  Ryousei Takano,et al.  Design and Evaluation of Precise Software Pacing Mechanisms for Fast Long-Distance Networks , 2005 .

[19]  Hari Balakrishnan,et al.  An experimental study of the learnability of congestion control , 2014, SIGCOMM.

[20]  Jasleen Kaur,et al.  Can Machine Learning Benefit Bandwidth Estimation at Ultra-high Speeds? , 2016, PAM.

[21]  Tianrong Zhang,et al.  Packet-Scale Congestion Control Paradigm , 2017, IEEE/ACM Transactions on Networking.

[22]  Larry L. Peterson,et al.  TCP Vegas: End to End Congestion Avoidance on a Global Internet , 1995, IEEE J. Sel. Areas Commun..

[23]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[24]  Swathi Nibhanupudi SIGNAL DENOISING USING WAVELETS , 2003 .

[25]  Dmitri Loguinov,et al.  IMR-Pathload: Robust Available Bandwidth Estimation Under End-Host Interrupt Delay , 2008, PAM.

[26]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[27]  Soung Chang Liew,et al.  TCP Veno: TCP enhancement for transmission over wireless access networks , 2003, IEEE J. Sel. Areas Commun..

[28]  Jason Lee,et al.  Microscopic examination of TCP flows over transatlantic links , 2003, Future Gener. Comput. Syst..

[29]  Jun Zhang,et al.  TCP-FIT: An improved TCP congestion control algorithm and its performance , 2011, 2011 Proceedings IEEE INFOCOM.

[30]  Alok Shriram,et al.  Empirical Evaluation of Techniques for Measuring Available Bandwidth , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[31]  Justine Sherry,et al.  Silo: Predictable Message Latency in the Cloud , 2015, Comput. Commun. Rev..

[32]  Paul Barford,et al.  A Machine Learning Approach to TCP Throughput Prediction , 2007, IEEE/ACM Transactions on Networking.

[33]  Thomas E. Anderson,et al.  PCP: Efficient Endpoint Congestion Control , 2006, NSDI.

[34]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[35]  Jasleen Kaur,et al.  RAPID: Shrinking the Congestion-Control Timescale , 2009, IEEE INFOCOM 2009.

[36]  Qian Zhang,et al.  A Compound TCP Approach for High-Speed and Long Distance Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[37]  Richard G. Baraniuk,et al.  TCP-Africa: an adaptive and fair rapid increase rule for scalable TCP , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[38]  Kang Li,et al.  New Methods for Passive Estimation of TCP Round-Trip Times , 2005, PAM.

[39]  Hakim Weatherspoon,et al.  SoNIC: Precise Realtime Software Access and Control of Wired Networks , 2013, NSDI.

[40]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[41]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[42]  Carlo Caini,et al.  TCP Hybla: a TCP enhancement for heterogeneous networks , 2004, Int. J. Satell. Commun. Netw..

[43]  Yuetsu Kodama,et al.  High-Resolution Timer-Based Packet Pacing Mechanism on the Linux Operating System , 2011, IEICE Trans. Commun..

[44]  Manish Jain,et al.  Pathload: A Measurement Tool for End-to-End Available Bandwidth , 2002 .

[45]  Manish Jain,et al.  On the Effectiveness of Delay-Based Congestion Avoidance , 2004 .

[46]  Han-Chiang Chen,et al.  Design and Implementation of TCP/IP Offload Engine System over Gigabit Ethernet , 2006, Proceedings of 15th International Conference on Computer Communications and Networks.

[47]  Sally Floyd,et al.  HighSpeed TCP for Large Congestion Windows , 2003, RFC.

[48]  Manish Jain,et al.  Ten fallacies and pitfalls on end-to-end available bandwidth estimation , 2004, IMC '04.

[49]  Ren Wang,et al.  TCP westwood: Bandwidth estimation for enhanced transport over wireless links , 2001, MobiCom '01.

[50]  Injong Rhee,et al.  Impact of background traffic on performance of high-speed TCP variant protocols , 2007, Comput. Networks.

[51]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[52]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[53]  M. Frans Kaashoek,et al.  A measurement study of available bandwidth estimation tools , 2003, IMC '03.

[54]  Farnam Jahanian,et al.  Internet inter-domain traffic , 2010, SIGCOMM '10.

[55]  Robert L. Grossman,et al.  UDT: UDP-based data transfer for high-speed wide area networks , 2007, Comput. Networks.

[56]  Hari Balakrishnan,et al.  Stochastic Forecasts Achieve High Throughput and Low Delay over Cellular Networks , 2013, NSDI.

[57]  Brighten Godfrey,et al.  Finishing flows quickly with preemptive scheduling , 2012, CCRV.

[58]  Abraham J. Wyner,et al.  On Boosting and the Exponential Loss , 2003, AISTATS.

[59]  Janardhan R. Iyengar,et al.  Low Extra Delay Background Transport (LEDBAT) , 2012, RFC.

[60]  Richard G. Baraniuk,et al.  pathChirp: Efficient available bandwidth estimation for network paths , 2003 .

[61]  Nick McKeown,et al.  Update on buffer sizing in internet routers , 2006, CCRV.

[62]  Shouyang Wang,et al.  Forecasting stock market movement direction with support vector machine , 2005, Comput. Oper. Res..

[63]  Pierre Geurts,et al.  A machine learning approach to improve congestion control over wireless computer networks , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[64]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[65]  Zhi-Li Zhang,et al.  Small-time scaling behaviors of Internet backbone traffic: an empirical study , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[66]  Peter Steenkiste,et al.  Evaluation and characterization of available bandwidth probing techniques , 2003, IEEE J. Sel. Areas Commun..

[67]  Dmitri Loguinov,et al.  Characterizing tight-link bandwidth of multi-hop paths using probing response curves , 2010, 2010 IEEE 18th International Workshop on Quality of Service (IWQoS).

[68]  Brian Tierney,et al.  System capability effects on algorithms for network bandwidth measurement , 2003, IMC '03.

[69]  Kei Hiraki,et al.  Inter-Layer Coordination for Parallel TCP Streams on Long Fat Pipe Networks , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[70]  Thomas G. Dietterich An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization , 2000, Machine Learning.

[71]  Kimberly C. Claffy,et al.  Comparison of Public End-to-End Bandwidth Estimation Tools on High-Speed Links , 2005, PAM.

[72]  Douglas J. Leith,et al.  H-TCP : TCP for high-speed and long-distance networks , 2004 .

[73]  P. Swarnalatha,et al.  TCP-LP: low-priority service via end-point congestion control , 2010, ICC 2010.

[74]  Aleksandar Kuzmanovic,et al.  TCP-LP: a distributed algorithm for low priority data transfer , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[75]  E.W. Knightly,et al.  TCP-LP: low-priority service via end-point congestion control , 2006, IEEE/ACM Transactions on Networking.

[76]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[77]  Sally Floyd,et al.  The NewReno Modification to TCP's Fast Recovery Algorithm , 2004, RFC.

[78]  Injong Rhee,et al.  CUBIC: a new TCP-friendly high-speed TCP variant , 2008, OPSR.

[79]  Tomoki,et al.  TCP-Fusion : A Hybrid Congestion Control Algorithm for High-speed Networks T , 2008 .

[80]  Di Chen,et al.  Non-stationary and Small-time Scaling Behavior of Internet Traffic , 2006, 2006 International Conference on Communications, Circuits and Systems.

[81]  F. Donelson Smith,et al.  Can Bandwidth Estimation Tackle Noise at Ultra-high Speeds? , 2014, 2014 IEEE 22nd International Conference on Network Protocols.

[82]  Paul Barford,et al.  Generating representative Web workloads for network and server performance evaluation , 1998, SIGMETRICS '98/PERFORMANCE '98.

[83]  Grenville J. Armitage,et al.  A survey of techniques for internet traffic classification using machine learning , 2008, IEEE Communications Surveys & Tutorials.

[84]  R. Srikant,et al.  TCP-Illinois: a loss and delay-based congestion control algorithm for high-speed networks , 2006, valuetools '06.

[85]  Injong Rhee,et al.  Delay-based congestion avoidance for TCP , 2003, TNET.

[86]  Qian Zhang,et al.  Compound TCP: A scalable and TCP-friendly congestion control for high-speed networks , 2006 .

[87]  Walmir M. Caminhas,et al.  A review of machine learning approaches to Spam filtering , 2009, Expert Syst. Appl..