Performance of the Vesta parallel file system

Vesta is an experimental parallel file system implemented on the IBM SPI. Its main features are support for parallel access from multiple application processes to file, and the ability to partition and re-partition the file data among these processes. This paper reports on a set of experiments designed to evaluate Vesta's performance. This includes basic single-node performance, and performance using parallel access with different file partitioning schemes. Results are that bandwidth scales with the number of I/O nodes accessed, and that orthogonal partitioning schemes achieve essentially the same performance. In many cases performance equals the disk hardware limit. This is often attributed to prefetching and write-behind in the I/O nodes.<<ETX>>

[1]  D. G. Feitelson,et al.  Parallel access to files in the Vesta file system , 1993, Supercomputing '93.

[2]  Dror G. Feitelson,et al.  Overview of the Vesta parallel file system , 1993, CARN.

[3]  David B. Loveman.  High performance Fortran , 1993, IEEE Parallel & Distributed Technology: Systems & Applications.

[4]  Dror G. Feitelson,et al.  Design and implementation of the Vesta parallel file system , 1994, Proceedings of IEEE Scalable High Performance Computing Conference.

[5]  E. DeBenedictis,et al.  nCUBE parallel I/O software , 1992, Eleventh Annual International Phoenix Conference on Computers and Communication [1992 Conference Proceedings].

[6]  Alok N. Choudhary,et al.  Improved parallel I/O via a two-phase run-time access strategy , 1993, CARN.

[7]  David A. Patterson,et al.  Storage performance-metrics and benchmarks , 1993 .

[8]  Carla Schlatter Ellis,et al.  Bridge: a high performance file system for parallel processors , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[9]  Craig B. Stunkel,et al.  The SP1 high-performance switch , 1994, Proceedings of IEEE Scalable High Performance Computing Conference.

[10]  Alok N. Choudhary,et al.  An experimental performance evaluation of Touchstone Delta Concurrent File System , 1993, ICS '93.

[11]  Erik DeBenedictis,et al.  Modular Scalable I/O , 1993, J. Parallel Distributed Comput..

[12]  David Kotz,et al.  Dynamic file-access characteristics of a production parallel scientific workload , 1994, Proceedings of Supercomputing '94.

[13]  Randy H. Katz,et al.  Input/output behavior of supercomputing applications , 1991, Proceedings of the 1991 ACM/IEEE Conference on Supercomputing (Supercomputing '91).

[14]  Carla Schlatter Ellis,et al.  Prefetching in File Systems for MIMD Multiprocessors , 1990, IEEE Trans. Parallel Distributed Syst..

[15]  Dror G. Feitelson,et al.  Parallel access to files in the Vesta file system , 1993, Supercomputing '93. Proceedings.

[16]  Carla Schlatter Ellis,et al.  Caching and Writeback Policies in Parallel File Systems , 1993, J. Parallel Distributed Comput..

[17]  Garth A. Gibson,et al.  RAID: high-performance, reliable secondary storage , 1994, CSUR.

[18]  James C. French,et al.  Performance Measurement of the Concurrent File System of the Intel iPSC/2 Hypercube , 1993, J. Parallel Distributed Comput..