File system design using large memories

It is shown using experimental data that file activity is fairly stable over time, and the implications of this finding for file system design are examined. Several file access patterns and how they may be exploited to improve file system performance are shown. In particular, it is shown that current file temperature can be used to predict future file temperature. The design of the iPcress file system, which uses both a large disk cache and other techniques to improve file system performance is outlined. iPcress has a variety of cache staging algorithms and can choose the one most appropriate for each file. iPcress also stores access histories for each file to guide decisions such as file layout on DASD and caching. Preliminary performance figures for iPcress are presented.<<ETX>>

[1]  John Kunze,et al.  A trace-driven analysis of the unix 4 , 1985, SOSP 1985.

[2]  Kenneth Baclawski,et al.  A stochastic model of data access and communication , 1989 .

[3]  Alan Jay Smith,et al.  Sequentiality and prefetching in database systems , 1978, TODS.

[4]  Mahadev Satyanarayanan,et al.  Scale and performance in a distributed file system , 1988, TOCS.

[5]  A. Lewis Bastian,et al.  Characteristics of DASD Use , 1981, Int. CMG Conference.

[6]  Michael N. Nelson,et al.  Caching in the Sprite network file system , 1988, TOCS.

[7]  R. S. Fabry,et al.  A fast file system for UNIX , 1984, TOCS.

[8]  Mahadev Satyanarayanan,et al.  A study of file sizes and functional lifetimes , 1981, SOSP.

[9]  Willy Zwaenepoel,et al.  File access performance of diskless workstations , 1986, TOCS.

[10]  Rick Floyd,et al.  Directory Reference Patterns in a UNIX Environment. , 1986 .

[11]  Philip D. L. Koch.  Disk file allocation based on the buddy system , 1987, TOCS.

[12]  Ingrid Liu,et al.  Static vs Dynamic Management of Consistently Very Active Data Sets , 1987, Int. CMG Conference.

[13]  Fred Douglis,et al.  Beating the I/O bottleneck: a case for log-structured file systems , 1989, OPSR.

[14]  Robert S. Fabry,et al.  A fast file system for UNIX , 1984, TOCS.

[15]  Rick Floyd.  Short-Term File Reference Patterns in a UNIX Environment, , 1986 .

[16]  A. Lewis Bastian.  Cached DASD Performance Prediction and Validation , 1982, Int. CMG Conference.

[17]  Alan Jay Smith,et al.  Disk cache—miss ratio analysis and design considerations , 1983, TOCS.

[18]  David K. Gifford,et al.  A caching file system for a programmer's workstation , 1985, SOSP 1985.