Metadata update performance in file systems

Structural changes, such as file creation and block allocation, have consistently been identified as file system performance problems in many user environments. We compare several implementations that maintain metadata integrity in the event of a system failure but do not require changes to the on-disk structures. In one set of schemes, the file system uses asynchronous writes and passes ordering requirements to the disk scheduler. These scheduler-enforced ordering schemes outperform the conventional approach (synchronous writes) by more than 30 percent for metadata update intensive benchmarks, but are suboptimal mainly due to their inability to safely use delayed writes when ordering is required. We therefore introduce soft updates, an implementation that asymptotically approaches memory-based file system performance (within 5 percent) while providing stronger integrity and security guarantees than most UNIX file systems. For metadata update in-tensive benchmarks, this improves performance by more than a factor of two when compared to the conventional approach.

[1]  R. Woodham Tools for Research , 1971, Nature.

[2]  A. Retrospective,et al.  The UNIX Time-sharing System , 1977 .

[3]  Irving L. Traiger,et al.  A history and evaluation of System R , 1981, CACM.

[4]  Steven L. Gaede A Scaling Technique for Comparing Interactive System Capacities , 1982, Int. CMG Conference.

[5]  R. S. Fabry,et al.  A fast file system for UNIX , 1984, TOCS.

[6]  Robert B. Hagmann,et al.  Reimplementing the Cedar file system using logging and group commit , 1987, SOSP '87.

[7]  Mahadev Satyanarayanan,et al.  Scale and performance in a distributed file system , 1987, SOSP '87.

[8]  Michael Stonebraker,et al.  The Design of the POSTGRES Storage System , 1988, VLDB.

[9]  A. J. Kondoff The MPE XL data management system exploiting the HP precision architecture for HP's next generation commercial computer systems , 1988, Digest of Papers. COMPCON Spring 88 Thirty-Third IEEE Computer Society International Conference.

[10]  Masataka Ohta,et al.  A Fast /tmp File System by Delay Mount Option , 1990, USENIX Summer.

[11]  John K. Ousterhout,et al.  Why Aren't Operating Systems Getting Faster As Fast as Hardware? , 1990, USENIX Summer.

[12]  Keith Bostic,et al.  A Pageable Memory Based Filesystem , 1990, USENIX Summer.

[13]  Steve R. Kleiman,et al.  Extent-like Performance from a UNIX File System , 1991, USENIX Winter.

[14]  Sailesh Chutani,et al.  The Episode File System , 1992 .

[15]  John Wilkes,et al.  UNIX Disk Access Patterns , 1993, USENIX Winter.

[16]  Yale N. Patt,et al.  The process-flow model: examining I/O performance from the system's point of view , 1993, SIGMETRICS '93.

[17]  Shivakumar Venkataraman,et al.  The TickerTAIP parallel RAID architecture , 1993, ISCA '93.

[18]  Carl Staelin,et al.  An Implementation of a Log-Structured File System for UNIX , 1993, USENIX Winter.