Linear aggressive prefetching: a way to increase the performance of cooperative caches

Cooperative caches offer huge amounts of caching memory that is not always used as well as it could be. We might find blocks in the cache that have not been requested for many hours. These blocks will hardly improve the performance of the system while the buffers they occupy could be better used to speedup the I/O operations. In this paper, we present a family of simple prefetching algorithms that increase the file-system performance significantly. Furthermore, we also present a way to make any simple prefetching algorithm into an aggressive one that controls its aggressiveness not to flood the cache unnecessarily. All these algorithms and mechanisms have proven to increase the performance of two state-of-the-art parallel/distributed file systems: PAFS and xFS.

[1]  Brian N. Bershad,et al.  A trace-driven comparison of algorithms for parallel prefetching and caching , 1996, OSDI '96.

[2]  Michael Dahlin,et al.  Cooperative caching: using remote client memory to improve file system performance , 1994, OSDI '94.

[3]  Toni Cortés,et al.  Cooperative caching and prefetching in parallel/distributed file systems , 1997 .

[4]  P. Krishnan,et al.  Optimal prefetching via data compression , 1996, JACM.

[5]  Daniel A. Reed,et al.  Input/output access pattern classification using hidden Markov models , 1997, IOPADS '97.

[6]  Darrell D. E. Long,et al.  Predicting Future File-System Actions From Prior Events , 1996, USENIX Annual Technical Conference.

[7]  Garth A. Gibson,et al.  Exposing I/O concurrency with informed prefetching , 1994, Proceedings of 3rd International Conference on Parallel and Distributed Information Systems.

[8]  Alan Jay Smith,et al.  Disk cache—miss ratio analysis and design considerations , 1983, TOCS.

[9]  Jesús Labarta,et al.  Design issues of a cooperative cache with no coherence problems , 1997, IOPADS '97.

[10]  Antonio Cortés Roselló.  Cooperative caching and prefetching in parallel/distributed file systems , 1997 .

[11]  Jesús Labarta,et al.  DiP: A Parallel Program Development Environment , 1996, Euro-Par, Vol. II.

[12]  Olin Johnson,et al.  PARADISE: an advanced featured parallel file system , 1998, ICS '98.

[13]  Carla Schlatter Ellis,et al.  File-Access Characteristics of Parallel Scientific Workloads , 1996, IEEE Trans. Parallel Distributed Syst..

[14]  P. Krishnan,et al.  Practical prefetching via data compression , 1993 .

[15]  Jim Zelenka,et al.  Informed prefetching and caching , 1995, SOSP.

[16]  Carla Schlatter Ellis,et al.  Prefetching in File Systems for MIMD Multiprocessors , 1990, IEEE Trans. Parallel Distributed Syst..

[17]  Mary Baker,et al.  Measurements of a distributed file system , 1991, SOSP '91.