An Implementation Study of a Detection-Based Adaptive Block Replacement Scheme

In this paper, we propose a new adaptive buffer management scheme called DEAR (DEtection based Adaptive Replacement) that automatically detects the block reference patterns of applications and applies different replacement policies to different applications based on the detected reference pattern. The proposed DEAR scheme uses a periodic process. Detection is made by associating block attribute values such as backward distance and frequency gathered at the (i - 1)-th invocation with forward distances of blocks referenced between the (i - 1)-th and i-th invocations. We implemented the DEAR scheme in FreeBSD 2.2.5 and measured its performance using several real applications. The results show that compared with the LRU buffer management scheme, the proposed scheme reduces the number of disk I/Os by up to 51% (with an average of 23%) and the response time by up to 35% (with an average of 12%) in the case of single application executions. For multiple applications, the proposed scheme reduces the number of disk I/Os by up to 20% (with an average of 12%) and the over-all response time by up to 18% (with an average of 8%).

[1]  Christos Faloutsos,et al.  Flexible and Adaptable Buffer Management Techniques for Database Management Systems , 1995, IEEE Trans. Computers.

[2]  Sang Lyul Min,et al.  On the existence of a spectrum of policies that subsumes the least recently used (LRU) and least frequently used (LFU) policies , 1999, SIGMETRICS '99.

[3]  Jim Zelenka,et al.  Informed prefetching and caching , 1995, SOSP.

[4]  Dennis Shasha,et al.  2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm , 1994, VLDB.

[5]  Peter J. Denning,et al.  Operating Systems Theory , 1973 .

[6]  P. Krishnan,et al.  Practical prefetching via data compression , 1993 .

[7]  J. T. Robinson,et al.  Data cache management using frequency-based replacement , 1990, SIGMETRICS '90.

[8]  Asit Dan,et al.  Generalized interval caching policy for mixed interactive and long video workloads , 1996, Electronic Imaging.

[9]  Sang Lyul Min,et al.  Implementation and performance evaluation of the LRFU replacement policy , 1997, Proceedings 23rd Euromicro Conference New Frontiers of Information Technology - Short Contributions -.

[10]  Alan Jay Smith,et al.  Disk cache—miss ratio analysis and design considerations , 1983, TOCS.

[11]  Kai Li,et al.  Implementation and performance of application-controlled file caching , 1994, OSDI '94.

[12]  Pei Cao,et al.  Adaptive page replacement based on memory reference behavior , 1997, SIGMETRICS '97.

[13]  Mary Baker,et al.  Measurements of a distributed file system , 1991, SOSP '91.

[14]  Harrick M. Vin,et al.  Design and Implementation of Symphony: An Integrated Multimedia File System , 1997 .

[15]  G. C. Polyzos,et al.  A static analysis of I/O characteristics of scientific applications in a production workload , 1993, Supercomputing '93.

[16]  Sang Lyul Min,et al.  An adaptive block management scheme using on-line detection of block reference patterns , 1998, Proceedings International Workshop on Multi-Media Database Management Systems (Cat. No.98TB100249).

[17]  B. Gopinath,et al.  An inter-reference gap model for temporal locality in program behavior , 1995, SIGMETRICS '95/PERFORMANCE '95.

[18]  Jim Griffioen,et al.  Reducing File System Latency using a Predictive Approach , 1994, USENIX Summer.

[19]  Thomas M. Kroeger,et al.  Predicting file system actions from prior events , 1996 .

[20]  Prashant J. Shenoy,et al.  Symphony: an integrated multimedia file system , 1997, Electronic Imaging.

[21]  Garth A. Gibson,et al.  RAID: high-performance, reliable secondary storage , 1994, CSUR.

[22]  Gerhard Weikum,et al.  The LRU-K page replacement algorithm for database disk buffering , 1993, SIGMOD Conference.

[23]  Kai Li,et al.  Application-Controlled File Caching Policies , 1994, USENIX Summer.

[24]  Todd C. Mowry,et al.  Automatic compiler-inserted I/O prefetching for out-of-core applications , 1996, OSDI '96.