PFSLib --- A File System for Parallel Programming Environments.

In 1994, LRR-TUM obtained a research grant from the Intel Foundation for design and implementation of PFSLib, a parallel file system library which provides source code compatibility with Intel's parallel file system PFS. Its primary purpose is to work together with NXLib as an emulator of a Paragon supercomputer. Furthermore, PFSLib can be used as a stand-alone software product together with other parallel programming environments like e.g. PVM. Finally, PFSLib serves as a research platform to investigate issues of parallel file systems like e.g. file distribution or design of the user interface. This document will at first give an introduction into the issues connected with parallel file sytems. The second chapter will give an extended overview over the state of the art in the field of parallel I/O. The main aspect of this investigation will concentrate on the user interfaces of current parallel file systems. Chapter 3 describes in detail concepts of the PFSLib's design and implementation. A presentation of essential data structures and the flow of control and information throughout PFSLib calls will be given. Finally, chapter 4 puts the project of PFSLib in relation to current research in the group at LRR-TUM and shows issues for future research. This report also comprises the PFSLib manual giving details on each PFSLib call. PFSLib may be distributed freely under the GNU license agreements and can be obtained at ftp://ftp.leo.orgbode.informatik.tu-muenchen.de/PFSlib/.

[1]  Arndt Bode,et al.  OMIS - on-line monitoring interface specification , 1996 .

[2]  Dror G. Feitelson,et al.  Parallel access to files in the Vesta file system , 1993, Supercomputing '93. Proceedings.

[3]  E. DeBenedictis,et al.  nCUBE parallel I/O software , 1992, Eleventh Annual International Phoenix Conference on Computers and Communication [1992 Conference Proceedings].

[4]  W. Gropp,et al.  Applications-driven parallel I/O , 1993, Supercomputing '93.

[5]  A. S. Grimshaw,et al.  The Mentat Run-Time System: Support for Medium Grain Parallel Computation , 1990, Proceedings of the Fifth Distributed Memory Computing Conference, 1990..

[6]  Thomas W. Crockett,et al.  File concepts for parallel I/O , 1989, Proceedings of the 1989 ACM/IEEE Conference on Supercomputing (Supercomputing '89).

[7]  Sandra Johnson Baylor,et al.  Parallel I/O Workload Characteristics Using Vesta , 1996, Input/Output in Parallel and Distributed Computer Systems.

[8]  Georg Stellner,et al.  CoCheck: checkpointing and process migration for MPI , 1996, Proceedings of International Conference on Parallel Processing.

[9]  Andrew S. Grimshaw An Introduction to Parallel Object-Oriented Programming with Mentat , 1991 .

[10]  M. L. Scott,et al.  Beyond striping: the bridge multiprocessor file system , 1989, CARN.

[11]  W. Richard Stevens,et al.  Unix network programming , 1990, CCRV.

[12]  Raj Srinivasan,et al.  RPC: Remote Procedure Call Protocol Specification Version 2 , 1995, RFC.

[13]  Carla Schlatter Ellis,et al.  Bridge: a high performance file system for parallel processors , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[14]  James C. French,et al.  Extensible File Systems (ELFS): An Object-Oriented Approach to High Performance File I/O , 1994, OOPSLA.

[15]  Dror G. Feitelson,et al.  Performance of the Vesta parallel file system , 1995, Proceedings of 9th International Parallel Processing Symposium.

[16]  Dror G. Feitelson,et al.  Mpi-io: a parallel file i/o interface for mpi , 1995 .

[17]  Dror G. Feitelson,et al.  Parallel File Systems for the IBM SP Computers , 1995, IBM Syst. J..

[18]  Dror G. Feitelson,et al.  The Vesta parallel file system , 1996, TOCS.

[19]  Vaidy S. Sunderam,et al.  PIOUS: An Architecture for Parallel I/O in Distributed Computing Environments , 1993 .

[20]  Dror G. Feitelson,et al.  Overview of the MPI-IO Parallel I/O Interface , 1996, Input/Output in Parallel and Distributed Computer Systems.

[21]  Juan Miguel Del Rosario High Performance Parallel I/O on the nCUBE 2 (並列/分散処理論文 ) -- (ア-キテクチャ) , 1992 .

[22]  Sun Microsystems,et al.  XDR: External Data Representation standard , 1987, RFC.

[23]  A. S. Grimshaw High Performance Parallel File Objects , 1991, The Sixth Distributed Memory Computing Conference, 1991. Proceedings.

[24]  Peter Braun,et al.  Visualization of Parallel Program Execution , 1995 .

[25]  Dror G. Feitelson,et al.  Overview of the Vesta parallel file system , 1993, CARN.

[26]  David Kotz,et al.  Multiprocessor file system interfaces , 1993, [1993] Proceedings of the Second International Conference on Parallel and Distributed Information Systems.

[27]  Erik DeBenedictis,et al.  Modular Scalable I/O , 1993, J. Parallel Distributed Comput..

[28]  Andrew S. Grimshaw,et al.  ELFS: object-oriented extensible file systems , 1991, [1991] Proceedings of the First International Conference on Parallel and Distributed Information Systems.