Obtaining high performance for storage outsourcing

The viability of storage outsourcing is critically dependent on the access performance of remote storage. We study this issue by measuring the behavior of a broad variety of I/O-intensive benchmarks as they access remote storage over an IP network. We measure the effect of network latencies that correspond to distances ranging from a local neighborhood to halfway across a continent. We then measure the effect of latency-hiding mechanisms. Our results indicate that, in many cases, the adverse effects of network delay can be rendered inconsequential by clever file system and operating system techniques.

[1]  Margo I. Seltzer,et al.  Journaling Versus Soft Updates: Asynchronous Meta-data Protection in File Systems , 2000, USENIX Annual Technical Conference, General Track.

[2]  Larry L. Peterson,et al.  TCP Vegas: new techniques for congestion detection and avoidance , 1994 .

[3]  R. Wilder,et al.  Wide-area Internet traffic patterns and characteristics , 1997, IEEE Netw..

[4]  Jim Zelenka,et al.  A cost-effective, high-bandwidth storage architecture , 1998, ASPLOS VIII.

[5]  Yale N. Patt,et al.  Metadata update performance in file systems , 1994, OSDI '94.

[6]  Carl Smith,et al.  NFS Version 3: Design and Implementation , 1994, USENIX Summer.

[7]  David A. Patterson,et al.  Virtual log based file systems for a programmable disk , 1999, OSDI '99.

[8]  Richard P. Martin,et al.  NFS sensitivity to high performance networks , 1999, SIGMETRICS '99.

[9]  kc claffy,et al.  The nature of the beast: Recent traffic measurements from an Internet backbone , 1998 .

[10]  Vern Paxson,et al.  End-to-end Internet packet dynamics , 1997, SIGCOMM '97.

[11]  Peter M. Chen,et al.  The Design and Verification of the Rio File Cache , 2001, IEEE Trans. Computers.

[12]  K HillyerBruce,et al.  Obtaining high performance for storage outsourcing , 2001 .

[13]  Peter B. Danzig,et al.  tcplib: A Library of TCP Internetwork Traffic Characteristics , 2002 .

[14]  David A. Solomon,et al.  Inside windows nt second edition , 1998 .

[15]  Jeffrey Katcher,et al.  PostMark: A New File System Benchmark , 1997 .

[16]  R. S. Fabry,et al.  A fast file system for UNIX , 1984, TOCS.

[17]  Abraham Silberschatz,et al.  Database System Concepts , 1980 .

[18]  Gregory G. Finn,et al.  VISA: Netstation's virtual Internet SCSI adapter , 1998, ASPLOS VIII.

[19]  Paul Barford,et al.  Generating representative Web workloads for network and server performance evaluation , 1998, SIGMETRICS '98/PERFORMANCE '98.

[20]  T. V. Lakshman,et al.  The performance of TCP/IP for networks with high bandwidth-delay products and random loss , 1997, TNET.

[21]  Helen Custer,et al.  Inside Windows NT , 1992 .

[22]  Chandramohan A. Thekkath,et al.  Frangipani: a scalable distributed file system , 1997, SOSP.