Quality of Service Support for Real-time Storage Systems

The performance and capacity of commodity computer systems have improved drastically in recent years. However, these systems still lack the support for real-time data access, which is required by an increasing number of emerging applications. In this paper we first present several important storagebound real-time applications and classify their Quality of Service (QoS) requirements. We then survey the representative work on disk management in the areas of IO scheduling, admission control, and data placement. Finally, we present our approach for providing disk QoS in commodity systems and present key empirical results from the micro-benchmark-based evaluation of our QoSenhanced Linux kernel.

[1]  Prashant J. Shenoy,et al.  Symphony: an integrated multimedia file system , 1997, Electronic Imaging.

[2]  Edward Y. Chang,et al.  Virtual IO: preemptible disk access , 2002, MULTIMEDIA '02.

[3]  Yale N. Patt,et al.  Scheduling algorithms for modern disk drives , 1994, SIGMETRICS 1994.

[4]  R. S. Fabry,et al.  A fast file system for UNIX , 1984, TOCS.

[5]  Edward Y. Chang,et al.  Fine-grained device management in an interactive media server , 2003, IEEE Trans. Multim..

[6]  John Wilkes,et al.  Traveling to Rome: QoS Specifications for Automated Storage System Management , 2001, IWQoS.

[7]  Jan H. M. Korst.  Random duplicated assignment: an alternative to striping in video servers , 1997, MULTIMEDIA '97.

[8]  Prashant J. Shenoy,et al.  Application performance in the QLinux multimedia operating system , 2000, ACM Multimedia.

[9]  Ian A. Pratt,et al.  The User-Safe Device I/O Architecture , 1997 .

[10]  Edward Y. Chang,et al.  Design and Implementation of Semi-preemptible IO , 2003, FAST.

[11]  Jeffrey Scott Vitter,et al.  Strategic directions in storage I/O issues in large-scale computing , 1996, CSUR.

[12]  P. Venkat Rangan,et al.  Multimedia Storage Servers: A Tutorial and Survey , 1995 .

[13]  Pål Halvorsen,et al.  Operating system support for multimedia systems , 2000, Comput. Commun..

[14]  Jay K. Strosnider,et al.  Disk scheduling for multimedia data streams , 1994, Electronic Imaging.

[15]  Edward Y. Chang,et al.  BubbleUp: low latency fast-scan for media servers , 1997, MULTIMEDIA '97.

[16]  Philip S. Yu,et al.  Optimization of the grouped sweeping scheduling (GSS) with heterogeneous multimedia streams , 1993, MULTIMEDIA '93.

[17]  Yale N. Patt,et al.  On-line extraction of SCSI disk drive parameters , 1995, SIGMETRICS '95/PERFORMANCE '95.

[18]  Andrea C. Arpaci-Dusseau,et al.  Semantically-Smart Disk Systems , 2003, FAST.

[19]  John Wilkes,et al.  Disk scheduling algorithms based on rotational position , 1991 .

[20]  Ragunathan Rajkumar,et al.  Real-time filesystems. Guaranteeing timing constraints for disk accesses in RT-Mach , 1997, Proceedings Real-Time Systems Symposium.

[21]  John Regehr,et al.  HLS: a framework for composing soft real-time schedulers , 2001, Proceedings 22nd IEEE Real-Time Systems Symposium (RTSS 2001) (Cat. No.01PR1420).

[22]  Gregory R. Ganger,et al.  Automated Disk Drive Characterization , 1999 .

[23]  Gregory R. Ganger,et al.  Freeblock Scheduling Outside of Disk Firmware , 2002, FAST.

[24]  Ralf Steinmetz,et al.  Multimedia File Systems Survey: Approaches for Continuous Media Disk Scheduling , 1995, Comput. Commun..

[25]  Edward Y. Chang,et al.  2D BubbleUp: Managing Parallel Disks for Media Servers , 1998, FODO.

[26]  Randy H. Katz,et al.  A case for redundant arrays of inexpensive disks (RAID) , 1988, SIGMOD '88.

[27]  P. Venkat Rangan,et al.  Efficient Storage Techniques for Digital Continuous Multimedia , 1993, IEEE Trans. Knowl. Data Eng..

[28]  Gregory R. Ganger,et al.  Track-Aligned Extents: Matching Access Patterns to Disk Drive Characteristics , 2002, FAST.

[29]  Mendel Rosenblum,et al.  The design and implementation of a log-structured file system , 1991, SOSP '91.

[30]  Edward Y. Chang,et al.  The XTREAM multimedia system , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[31]  Sape J. Mullender,et al.  Real-time disk scheduling in a mixed-media file system , 2000, Proceedings Sixth IEEE Real-Time Technology and Applications Symposium. RTAS 2000.

[32]  Edward Y. Chang,et al.  Effective Memory Use in a Media Server , 1997, VLDB.

[33]  John Wilkes,et al.  Data Services - From Data to Containers , 2003, FAST.

[34]  Gregory R. Ganger,et al.  Towards higher disk head utilization: extracting free bandwidth from busy disk drives , 2000, OSDI.

[35]  P. Venkat Rangan,et al.  Multimedia Storage Servers: A Tutorial , 1995, Computer.

[36]  Abraham Silberschatz,et al.  Operating System Concepts , 1983 .

[37]  Guru Parulkar,et al.  Project mars: scalable, high performance, web based multimedia-on-demand (mod) services and servers , 1998 .

[38]  Prashant J. Shenoy,et al.  Cello: A Disk Scheduling Framework for Next Generation Operating Systems* , 1998, SIGMETRICS '98/PERFORMANCE '98.