APEX: adaptive disk scheduling framework with QoS support

APEX is an adaptive disk scheduling framework with Quality-of-Service (QoS) support designed for environments with highly varying disk bandwidth usage. APEX is based on a three-layer scheduling architecture: (1) the upper layer realizes different service classes using a set of queues; (2) the mid-layer distributes available disk bandwidth among these queues; and (3) the lower layer is handled by the disk itself, which does the final ordering of disk requests. We demonstrate the use of APEX in an example scenario, a Learning-on-Demand (LoD) application supported by a multimedia system, where students can search for and playback multimedia-based learning material. In this paper, we present the scheduling concepts of APEX which are based on an extended token bucket algorithm. The disk requests scheduled for service are assembled into batches in order to exploit the intelligence of modern disks. Combined with a specialized work-conservation scheme, this enables APEX to apply bandwidth where it is needed, without the loss of efficiency. We demonstrate, through simulations, that APEX provides both higher throughput and lower response times than other mixed-media disk schedulers while still avoiding deadline violations for real-time requests. We also show its robustness with respect to misaligned bandwidth allocation.

[1]  Chung Laung Liu,et al.  Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment , 1989, JACM.

[2]  Prashant J. Shenoy,et al.  Cello: A Disk Scheduling Framework for Next Generation Operating Systems* , 1998, SIGMETRICS '98/PERFORMANCE '98.

[3]  Gregory R. Ganger,et al.  Freeblock Scheduling Outside of Disk Firmware , 2002, FAST.

[4]  Ramesh Govindan,et al.  A file system for continuous media , 1992, TOCS.

[5]  James W. Layland,et al.  Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment , 1989, JACM.

[6]  Gregory R. Ganger,et al.  Automated Disk Drive Characterization (CMU-CS-99-176) , 1999 .

[7]  Prashant J. Shenoy,et al.  A practical learning-based approach for dynamic storage bandwidth allocation , 2003, IWQoS'03.

[8]  Ion Stoica,et al.  Duality between resource reservation and proportional share resource allocation , 1996, Electronic Imaging.

[9]  Brian S. White,et al.  Performance Comparison of IDE and SCSI Disks , 2005 .

[10]  Jonathan Walpole,et al.  Storage System Support for Continuous-Media Applications, Part 1: Requirements and Single-Disk Issues , 2004, IEEE Distributed Syst. Online.

[11]  Yale N. Patt,et al.  Scheduling algorithms for modern disk drives , 1994, SIGMETRICS 1994.

[12]  Hirokazu Ohnishi,et al.  Flow control schemes and delay/loss tradeoff in ATM networks , 1988, IEEE J. Sel. Areas Commun..

[13]  Ibrahim Kamel,et al.  A novel deadline driven disk scheduling algorithm for multi-priority multimedia objects , 2000, Proceedings of 16th International Conference on Data Engineering (Cat. No.00CB37073).

[14]  Gregory R. Ganger,et al.  Automated Disk Drive Characterization , 1999 .

[15]  Peter J. Denning,et al.  Effects of scheduling on file memory operations , 1899, AFIPS '67 (Spring).

[16]  Philip S. Yu Mon-Song Chen, Dilip D. Kandlur: Design and Analysis of a Grouped Sweeping Scheme for Multimedia Storage Management , 1992, NOSSDAV.

[17]  Yale N. Patt,et al.  On-line extraction of SCSI disk drive parameters , 1995, SIGMETRICS '95/PERFORMANCE '95.

[18]  Rajeev Rastogi,et al.  The fellini multimedia storage system , 1996 .

[19]  Jonathan Walpole,et al.  Storage system support for continuous-media applications. Part 1. Requirements and single-disk issues , 2004, IEEE Distributed Systems Online.

[20]  Rajeev Rastogi,et al.  The Fellini Multimedia Storage Server , 1996 .

[21]  A. L. Narasimha Reddy,et al.  Disk scheduling in a multimedia I/O system , 1993, MULTIMEDIA '93.

[22]  David J. DeWitt,et al.  A methodology for database system performance evaluation , 1984, SIGMOD '84.

[23]  Jonathan Walpole,et al.  Adaptive prefetching for device-independent file I/O , 1997, Electronic Imaging.

[24]  Vera Goebel,et al.  Adaptive disk scheduling in a multimedia DBMS , 2003, ACM Multimedia.