Evaluating Batching for TCP Offload

Ever increasing demand for performance and scalability in server networking has generated significant interest in offloading TCP processing to network adapters. The benefits of TCP offload result from its potential to reduce performance-limiting operations such as interrupts, cache misses, and I/O bus crossings. Exploiting this potential, however, is not easy. Design choices that improve performance for a given hardware configuration, workload or set of network characteristics can reduce performance under different conditions. We have evaluated a TCP offload prototype’s ability to reduce I/O bus crossings focusing on the impact of batching interactions between the host and adapter. Our analysis reveals that latency and the number of bus crossings are sensitive to some key parameters related to batching. We demonstrate the importance of these parameters to the viability of any TCP off-load design.

[1]  David Clark,et al.  An analysis of TCP processing overhead , 1989 .

[2]  Jeffrey S. Chase,et al.  On the elusive benefits of protocol offload , 2003, NICELI '03.

[3]  Scott Rixner,et al.  Isolating the performance impacts of network interface cards through microbenchmarks , 2004, SIGMETRICS '04/Performance '04.

[4]  P. Druschel,et al.  Soft timers: efficient microsecond software timer support for network processing , 2000, OPSR.

[5]  Kai Kunze,et al.  Studying network protocol offload with emulation: approach and preliminary results , 2004, Proceedings. 12th Annual IEEE Symposium on High Performance Interconnects.

[6]  Erich M. Nahum,et al.  Server Network Scalability and TCP Offload , 2005, USENIX Annual Technical Conference, General Track.

[7]  K. K. Ramakrishnan,et al.  Eliminating receive livelock in an interrupt-driven kernel , 1996, TOCS.

[8]  James L. Peterson,et al.  Design and validation of a performance and power simulator for PowerPC systems , 2003, IBM J. Res. Dev..

[9]  W. Richard Stevens,et al.  TCP/IP Illustrated, Volume 1: The Protocols , 1994 .

[10]  Erich M. Nahum,et al.  Performance issues in WWW servers , 2002, IEEE/ACM Trans. Netw..

[11]  Peter Druschel,et al.  Experiences with a high-speed network adaptor: a software perspective , 1994, SIGCOMM 1994.

[12]  Kaladhar Voruganti,et al.  USENIX Association Proceedings of FAST ’ 03 : 2 nd USENIX Conference on File and Storage Technologies , 2003 .

[13]  David Mosberger,et al.  httperf—a tool for measuring web server performance , 1998, PERV.

[14]  R. Wilder,et al.  Wide-area Internet traffic patterns and characteristics , 1997, IEEE Netw..