Optimal Read-Once Parallel Disk Scheduling

Abstract An optimal prefetching and I/O scheduling algorithm L-OPT, for parallel I/O systems, using a read-once model of block references is presented. The algorithm uses knowledge of the next $L$ references, $L$-block lookahead, to create a minimal-length I/O schedule. For a system with $D$ disks and a buffer of capacity $m$ blocks, we show that the competitive ratio of L-OPT is $\Theta(\sqrt{mD/L})$ when $L \geq m$, which matches the lower bound of any prefetching algorithm with $L$-block lookahead. Tight bounds for the remaining ranges of lookahead are also presented. In addition we show that L-OPT is the optimal offline algorithm: when the lookahead consists of the entire reference string, it performs the absolute minimum possible number of I/Os. Finally, we show that L-OPT is comparable with the best online algorithm with the same amount of lookahead; the ratio of the length of its schedule to the length of the optimal schedule is always within a constant factor.

[1]  Anna R. Karlin,et al.  Near-optimal parallel prefetching and caching , 1996, Proceedings of 37th Conference on Foundations of Computer Science.

[2]  Carla Schlatter Ellis,et al.  Practical prefetching techniques for parallel file systems , 1991, [1991] Proceedings of the First International Conference on Parallel and Distributed Information Systems.

[3]  Anna R. Karlin,et al.  Competitive snoopy caching , 1986, 27th Annual Symposium on Foundations of Computer Science (sfcs 1986).

[4]  Jeffrey Scott Vitter,et al.  Competitive parallel disk prefetching and buffer management , 1997, IOPADS '97.

[5]  Peter J. Varman,et al.  Optimal Read-once Parallel Disk Scheduling , 1999, IOPADS.

[6]  Edward F. Grove,et al.  Simple Randomized Mergesort on Parallel Disks , 1997, Parallel Comput..

[7]  Robert E. Tarjan,et al.  Amortized efficiency of list update and paging rules , 1985, CACM.

[8]  Peter J. Varman,et al.  Randomized Parallel Prefetching and Buffer Management , 1998, IPPS/SPDP Workshops.

[9]  Peter Sanders,et al.  Fast Concurrent Access to Parallel Disks , 2000, SODA '00.

[10]  Susanne Albers,et al.  Minimizing stall time in single and parallel disk systems , 2000, J. ACM.

[11]  Susanne Albers,et al.  Minimizing stall time in single and parallel disk systems , 1998, STOC '98.

[12]  Jim Zelenka,et al.  Informed prefetching and caching , 1995, SOSP.

[13]  Rakesh M. Verma,et al.  Tight Bounds for Prefetching and Buffer Management Algorithms for Parallel I/O Systems , 1996, FSTTCS.

[14]  Susanne Albers,et al.  On the Influence of Lookahead in Competitive Paging Algorithms , 1997, Algorithmica.

[15]  Jeffrey Scott Vitter,et al.  The power of duality for prefetching and sorting with parallel disks , 2001, SPAA '01.

[16]  Garth A. Gibson,et al.  Automatic I/O hint generation through speculative execution , 1999, OSDI '99.

[17]  Anna R. Karlin,et al.  A study of integrated prefetching and caching strategies , 1995, SIGMETRICS '95/PERFORMANCE '95.

[18]  Christos H. Papadimitriou,et al.  Beyond competitive analysis [on-line algorithms] , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[19]  Per-Åke Larson,et al.  Speeding up External Mergesort , 1996, IEEE Trans. Knowl. Data Eng..

[20]  Mahesh Kallahalla,et al.  Scheduling and Buffer Management for Parallel I/O , 1999 .

[21]  Peter Varman,et al.  Prefetching and buffer management for parallel i/o systems , 1997 .

[22]  Peter J. Varman,et al.  Red-Black Prefetching: An Approximation Algorithm for Parallel Disk Scheduling , 1998, FSTTCS.

[23]  Edward F. Grove,et al.  Simple randomized mergesort on parallel disks , 1996, SPAA '96.

[24]  Susanne Albers,et al.  The Influence of Lookahead in Competitive Paging Algorithms (Extended Abstract) , 1993, ESA.

[25]  Rakesh M. Verma,et al.  Tight Bounds for Prefetching and Buffer Management Algorithms for Parallel I/O Systems , 1996, FSTTCS.

[26]  Peter J. Varman,et al.  Optimal prefetching and caching for parallel I/O sytems , 2001, SPAA '01.

[27]  Vinay S. Pai,et al.  Markov Analysis of Multiple-Disk Prefetching Strategies for External Merging , 1994, Theor. Comput. Sci..

[28]  Garth A. Gibson,et al.  RAID: high-performance, reliable secondary storage , 1994, CSUR.