Manageable storage via adaptation in WiND

The key to storage manageability is adaptation. In traditional storage systems, adaptation is performed by a human administrator who must assess problems and then manually adjust various knobs and levers to bring the behavior of the system back to an acceptable level. Future storage systems must themselves adapt and, in doing so, reduce the need for manual intervention. In this paper, we describe the Wisconsin Network Disks (WiND) project, wherein we seek to understand and develop the key adaptive techniques required to build a truly manageable network-attached storage system. WiND gracefully and efficiently adapts to changes in the environment, reducing the burden of administration and increasing the flexibility and performance of storage for an eclectic range of clients. In particular, WiND automatically adapts to the addition of new disks to the system, the failure or erratic performance of existing disks and changes in client workload and access patterns.

[1]  Christos Faloutsos,et al.  Active Storage for Large-Scale Data Mining and Multimedia , 1998, VLDB.

[2]  John L. Hennessy,et al.  The Future of Systems Research , 1999, Computer.

[3]  Andrea C. Arpaci-Dusseau,et al.  High-performance sorting on networks of workstations , 1997, SIGMOD '97.

[4]  Shahram Ghandeharizadeh,et al.  Design and Implementation of Scalable Continuous Media Servers , 1998, Parallel Comput..

[5]  Sandy Irani,et al.  Cost-Aware WWW Proxy Caching Algorithms , 1997, USENIX Symposium on Internet Technologies and Systems.

[6]  Yannis Smaragdakis,et al.  EELRU: simple and effective adaptive page replacement , 1999, SIGMETRICS '99.

[7]  Gregory G. Finn,et al.  VISA: Netstation's virtual Internet SCSI adapter , 1998, ASPLOS VIII.

[8]  Stefan Savage,et al.  AFRAID - A Frequently Redundant Array of Independent Disks , 1996, USENIX Annual Technical Conference.

[9]  R. V. Meter.  Observing the effects of multi-zone disks , 1997 .

[10]  Carl Staelin,et al.  The HP AutoRAID hierarchical storage system , 1995, SOSP.

[11]  Carl Staelin,et al.  Idleness is Not Sloth , 1995, USENIX.

[12]  David A. Patterson,et al.  ISTORE: introspective storage for data-intensive network services , 1999, Proceedings of the Seventh Workshop on Hot Topics in Operating Systems.

[13]  Laszlo A. Belady,et al.  A Study of Replacement Algorithms for Virtual-Storage Computer , 1966, IBM Syst. J..

[14]  Noah Treuhaft,et al.  Cluster I/O with River: making the fast case common , 1999, IOPADS '99.

[15]  David A. Patterson,et al.  Towards Availability Benchmarks: A Case Study of Software RAID Systems , 2000, USENIX Annual Technical Conference, General Track.

[16]  Joel H. Saltz,et al.  Active disks: programming model, algorithms and evaluation , 1998, ASPLOS VIII.

[17]  David A. Patterson,et al.  An Analysis of Error Behaviour in a Large Storage System , 1999 .

[18]  Garth A. Gibson,et al.  Filesystems for Network-Attached Secure Disks, , 1997 .

[19]  Neal Young,et al.  The K-Server Dual and Loose Competitiveness for Paging , 1991, On-Line Algorithms.

[20]  Jim Zelenka,et al.  A cost-effective, high-bandwidth storage architecture , 1998, ASPLOS VIII.

[21]  Jeanna Neefe Matthews,et al.  Improving the performance of log-structured file systems with adaptive methods , 1997, SOSP.

[22]  Chandramohan A. Thekkath,et al.  Petal: distributed virtual disks , 1996, ASPLOS VII.

[23]  Mendel Rosenblum,et al.  The design and implementation of a log-structured file system , 1991, SOSP '91.

[24]  David J. DeWitt,et al.  Chained declustering: a new availability strategy for multiprocessor database machines , 1990, [1990] Proceedings. Sixth International Conference on Data Engineering.

[25]  Eric A. Brewer,et al.  Cluster-based scalable network services , 1997, SOSP.

[26]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[27]  Remzi H. Arpaci-Dusseau,et al.  Performance availability for networks of workstations , 1999 .

[28]  Daniel A. Reed,et al.  Adaptive disk striping for parallel input/output , 1999, 16th IEEE Symposium on Mass Storage Systems in cooperation with the 7th NASA Goddard Conference on Mass Storage Systems and Technologies (Cat. No.99CB37098).