Improving I/O Forwarding Throughput with Data Compression

While network bandwidth is steadily increasing, it is doing so at a much slower rate than the corresponding increase in CPU performance. This trend has widened the gap between CPU and network speed. In this paper, we investigate improvements to I/O performance by exploiting this gap. We harness idle CPU resources to compress network traffic, reducing the amount of data transferred over the network and increasing effective network bandwidth. We created a set of compression services within the I/O Forwarding Scalability Layer. These services transparently compress and decompress data as it is transferred over the network. We studied the effect of the compression services on a variety of data sets and conducted experiments on a high-performance computing cluster.

[1]  Xiaohui Chen,et al.  Impact of HTTP Compression on Web Response Time in Asymmetrical Wireless Network , 2009, 2009 International Conference on Networks Security, Wireless Communications and Trusted Computing.

[2]  Andrew B. King,et al.  Website Optimization , 2008 .

[3]  Daniel S. Hirschberg,et al.  Data compression , 1987, CSUR.

[4]  Steve Plimpton,et al.  Fast parallel algorithms for short-range molecular dynamics , 1993 .

[5]  Anja Feldmann,et al.  Potential benefits of delta encoding and data compression for HTTP , 1997, SIGCOMM '97.

[6]  David A. Wood,et al.  Adaptive cache compression for high-performance processors , 2004, Proceedings. 31st Annual International Symposium on Computer Architecture, 2004..

[7]  Robert B. Ross,et al.  Optimization Techniques at the I/O Forwarding Layer , 2010, 2010 IEEE International Conference on Cluster Computing.

[8]  Archana Ganapathi,et al.  To compress or not to compress - compute vs. IO tradeoffs for mapreduce energy efficiency , 2010, Green Networking '10.

[9]  Krste Asanovic,et al.  Energy Aware Lossless Data Compression , 2003, MobiSys.

[10]  Somnath Ghosh,et al.  HTTP-MPLEX: An enhanced hypertext transfer protocol and its performance evaluation , 2009, J. Netw. Comput. Appl..

[11]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[12]  Bogdan Nicolae,et al.  High Throughput Data-Compression for Cloud Storage , 2010, Globe.

[13]  Faouzi Kossentini,et al.  Performance Analysis of the JPEG 2000 Image Coding Standard , 2005, Multimedia Tools and Applications.

[14]  Wenjun Zeng,et al.  Scalable streaming of JPEG2000 images using hypertext transfer protocol , 2001, MULTIMEDIA '01.

[15]  Peter Deutsch,et al.  DEFLATE Compressed Data Format Specification version 1.3 , 1996, RFC.

[16]  Robert B. Ross,et al.  Bridging HPC and Grid File I/O with IOFSL , 2010, PARA.

[17]  Stephen G. Yeager,et al.  CORE.2 Global Air-Sea Flux Dataset , 2008 .

[18]  Robert Latham,et al.  Scalable I/O forwarding framework for high-performance computing systems , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[19]  Erez Zadok,et al.  Energy and performance evaluation of lossless file data compression on server systems , 2009, SYSTOR '09.

[20]  Xiaohui Chen,et al.  Proxy-Based Object Packaging and Compression: A Web Acceleration Scheme for UMTS , 2009, 2009 5th International Conference on Wireless Communications, Networking and Mobile Computing.

[21]  R. Canal,et al.  Very low power pipelines using significance compression , 2000, Proceedings 33rd Annual IEEE/ACM International Symposium on Microarchitecture. MICRO-33 2000.

[22]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[23]  Chita R. Das,et al.  Performance and power optimization through data compression in Network-on-Chip architectures , 2008, 2008 IEEE 14th International Symposium on High Performance Computer Architecture.

[24]  Radim Bartos,et al.  Analysis of Transport Optimization Techniques , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).