Performance of parallel I/O scheduling strategies on a network of workstations

Techniques for scheduling parallel I/O for both uniprogrammed systems that run single jobs in isolation and multiprogrammed environments that execute multiple parallel jobs simultaneously are presented. The performance of the scheduling algorithms is evaluated on a network of workstations. A new scheduling algorithm proposed in this paper is observed to perform very well for systems running single jobs in isolation. The algorithms that use knowledge of job characteristics are observed to produce a superior performance in multiprogrammed parallel environments.

[1]  Alok N. Choudhary,et al.  Improved parallel I/O via a two-phase run-time access strategy , 1993, CARN.

[2]  David J. DeWitt,et al.  SPIFFI-A Scalable Parallel File System for the Intel Paragon , 1996, IEEE Trans. Parallel Distributed Syst..

[3]  Randy H. Katz,et al.  A case for redundant arrays of inexpensive disks (RAID) , 1988, SIGMOD '88.

[4]  Peter J. Varman,et al.  Optimal Read-Once Parallel Disk Scheduling , 1999, IOPADS '99.

[5]  David Kotz,et al.  Disk-directed I/O for MIMD multiprocessors , 1994, OSDI '94.

[6]  Marianne Winslett,et al.  Exploiting local data in parallel array I/O on a practical network of workstations , 1997, IOPADS '97.

[7]  Rajeev Thakur,et al.  On implementing MPI-IO portably and with high performance , 1999, IOPADS '99.

[8]  Evgenia Smirni,et al.  Workload Characterization of Input/Output Intensive Parallel Applications , 1997, Computer Performance Evaluation.

[9]  Shikharesh Majumdar,et al.  Scheduling of I/O in Multiprogrammed Parallel Systems , 1999, Informatica.

[10]  Michael Stumm,et al.  HFS: a performance-oriented flexible file system based on building-block compositions , 1996, IOPADS '96.

[11]  Alok N. Choudhary,et al.  MTIO. A multi-threaded parallel I/O system , 1997, Proceedings 11th International Parallel Processing Symposium.

[12]  Dror G. Feitelson,et al.  Parallel access to files in the Vesta file system , 1993, Supercomputing '93. Proceedings.

[13]  D. G. Feitelson,et al.  Parallel access to files in the Vesta file system , 1993, Supercomputing '93.

[14]  Ravi Jain,et al.  Heuristics for Scheduling I/O Operations , 1997, IEEE Trans. Parallel Distributed Syst..