On the effective evaluation of TCP

Understanding the performance of the Internet's Transmission Control Protocol (TCP) is important because it is the dominant protocol used in the Internet today. Various testing methods exist to evaluate TCP performance, however all have pitfalls that need to be understood prior to obtaining useful results. Simulating TCP is difficult because of the wide range of variables, environments, and implementations available. Testing TCP modifications in the global Internet may not be the answer either: testing new protocols on real networks endangers other people's traffic and, if not done correctly, may also yield inaccurate or misleading results. In order for TCP research to be independently evaluated in the Internet research community there is a set of questions that researchers should try to answer. This paper attempts to list some of those questions and make recommendations as to how TCP testing can be structured to provide useful answers.

[1]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[2]  Vern Paxson,et al.  An architecture for large-scale Internet measurement , 1998, IEEE Commun. Mag..

[3]  Matthew Mathis,et al.  The macroscopic behavior of the TCP congestion avoidance algorithm , 1997, CCRV.

[4]  Srinivasan Keshav,et al.  REAL: A Network Simulator , 1988 .

[5]  John Nagle,et al.  Congestion control in IP/TCP internetworks , 1995, CCRV.

[6]  Larry L. Peterson,et al.  Experiences with network simulation , 1996, SIGMETRICS '96.

[7]  Vern Paxson,et al.  TCP Congestion Control , 1999, RFC.

[8]  R. Wilder,et al.  Wide-area Internet traffic patterns and characteristics , 1997, IEEE Netw..

[9]  Mischa Schwartz,et al.  ACM SIGCOMM computer communication review , 2001, CCRV.

[10]  Mark Allman,et al.  On the generation and use of TCP acknowledgments , 1998, CCRV.

[11]  Jeffrey C. Mogul Observing TCP dynamics in real networks , 1992, SIGCOMM 1992.

[12]  Matthew Mathis,et al.  Automatic TCP buffer tuning , 1998, SIGCOMM '98.

[13]  Deborah Estrin,et al.  Recommendations on Queue Management and Congestion Avoidance in the Internet , 1998, RFC.

[14]  Stephen E. Deering,et al.  Path MTU discovery , 1990, RFC.

[15]  Randy H. Katz,et al.  Transport protocols for Internet-compatible satellite networks , 1999, IEEE J. Sel. Areas Commun..

[16]  Luigi Rizzo,et al.  Dummynet: a simple approach to the evaluation of network protocols , 1997, CCRV.

[17]  Stephen E. Deering,et al.  Path MTU Discovery for IP version 6 , 1996, RFC.

[18]  Jon Postel,et al.  Transmission Control Protocol , 1981, RFC.

[19]  Larry L. Peterson,et al.  TCP Vegas: End to End Congestion Avoidance on a Global Internet , 1995, IEEE J. Sel. Areas Commun..

[20]  Janey C. Hoe Improving the start-up behavior of a congestion control scheme for TCP , 1996, SIGCOMM '96.

[21]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[22]  Sally Floyd,et al.  Increasing TCP's Initial Window , 1998, RFC.

[23]  Sally Floyd,et al.  Why we don't know how to simulate the Internet , 1997, WSC '97.

[24]  Ben Verghese,et al.  Application performance pitfalls and TCP's Nagle algorithm , 2000, PERV.

[25]  K. K. Ramakrishnan,et al.  A Proposal to add Explicit Congestion Notification (ECN) to IP , 1999, RFC.

[26]  Mark Allman Fixing Two BSD TCP Bugs , 1997 .

[27]  Sally Floyd Validation Experiences with the NS Simulator , 1999 .

[28]  QUTdN QeO,et al.  Random early detection gateways for congestion avoidance , 1993, TNET.

[29]  S. Hadjiefthymiades,et al.  Hypertext Transfer Protocol (HTTP) , 1996 .

[30]  Sally Floyd,et al.  TCP Selective Acknowledgement Options , 1996 .

[31]  V. Tamari Surely You're Joking, Mr. Feynman! , 1985 .

[32]  Kevin R. Fall,et al.  Network emulation in the VINT/NS simulator , 1999, Proceedings IEEE International Symposium on Computers and Communications (Cat. No.PR00250).

[33]  Mark Allman,et al.  Enhancing TCP Over Satellite Channels using Standard Mechanisms , 1999, RFC.

[34]  Robert T. Braden,et al.  Requirements for Internet Hosts - Communication Layers , 1989, RFC.

[35]  Steve Parker,et al.  Some Testing Tools for TCP Implementors , 1998, RFC.

[36]  Vern Paxson,et al.  Measurements and analysis of end-to-end Internet dynamics , 1997 .

[37]  Sally Floyd,et al.  Simulation-based comparisons of Tahoe, Reno and SACK TCP , 1996, CCRV.

[38]  William C. Fenner,et al.  Known TCP Implementation Problems , 1999, RFC.

[39]  Van Jacobson,et al.  TCP Extensions for High Performance , 1992, RFC.

[40]  John S. Heidemann,et al.  Performance interactions between P-HTTP and TCP implementations , 1997, CCRV.

[41]  Matthew Mathis,et al.  The Rate-Halving Algorithm for TCP Congestion Control , 1999 .

[42]  Alan M. Richard ISINT Performance Validation Test Report , 1999 .

[43]  Sally Floyd,et al.  Wide-area traffic: the failure of Poisson modeling , 1994 .

[44]  Roy T. Fielding,et al.  Hypertext Transfer Protocol - HTTP/1.0 , 1996, RFC.

[45]  Vern Paxson,et al.  Automated packet trace analysis of TCP implementations , 1997, SIGCOMM '97.

[46]  Sally Floyd,et al.  TCP and explicit congestion notification , 1994, CCRV.

[47]  Jeffrey C. Mogul,et al.  Observing TCP dynamics in real networks , 1992, SIGCOMM '92.

[48]  Vern Paxson,et al.  End-to-end Internet packet dynamics , 1997, SIGCOMM '97.

[49]  SemkeJeffrey,et al.  The macroscopic behavior of the TCP congestion avoidance algorithm , 1997 .

[50]  Vern Paxson,et al.  On estimating end-to-end network path properties , 2001, SIGCOMM LA '01.

[51]  Mark Allman,et al.  TCP byte counting refinements , 1999, CCRV.

[52]  Vikram Visweswaraiah,et al.  Improving Restart of Idle TCP Connections , 1999 .

[53]  Zhen Liu,et al.  Evaluation of TCP Vegas: emulation and experiment , 1995, SIGCOMM '95.

[54]  Brian Kantor,et al.  Network news transfer protocol a proposed standard for the stream-based transmission of news , 1986 .

[55]  Van Jacobson,et al.  Congestion avoidance and control , 1988, SIGCOMM '88.

[56]  Mark Allman,et al.  Improving TCP performance over satellite channels , 1997 .