Using data clustering to improve cleaning performance for flash memory

Flash memory offers attractive features for storage of data, such as non-volatility, shock resistance, fast access speed, and low power consumption. However, it requires erasing before it can be overwritten. The erase operations are slow and consume comparatively a great deal of power. Furthermore, flash memory can only be erased a limited number of times. To overcome hardware limitations, we use the non-in-place update mechanism that requires a cleaner to reclaim space occupied by obsolete data. To improve cleaning performance and prolong flash memory lifetime, we propose a new data reorganization method. By this method, data in flash memory are dynamically classified and clustered together according to their accessing frequencies. Experimental results show that this clustering technique significantly improved the cleaning performance for a variety of cleaning algorithms. The number of erase operations performed is greatly reduced and flash memory lifetime is prolonged. Even wearing is ensured as well. Copyright  1999 John Wiley & Sons, Ltd.

[1]  Carl Staelin,et al.  Smart Filesystems , 1991, USENIX Winter.

[2]  RosenblumMendel,et al.  The design and implementation of a log-structured file system , 1991 .

[3]  Kenneth Salem,et al.  Adaptive Block Rearrangement Under UNIX , 1997, Softw. Pract. Exp..

[4]  Paul Horton,et al.  A Quantitative Analysis of Disk Drive Power Management in Portable Computers , 1994, USENIX Winter.

[5]  Carl Staelin,et al.  The HP AutoRAID hierarchical storage system , 1995, SOSP.

[6]  Carl Staelin,et al.  An Implementation of a Log-Structured File System for UNIX , 1993, USENIX Winter.

[7]  John Wilkes,et al.  UNIX Disk Access Patterns , 1993, USENIX Winter.

[8]  Wilson C. Hsieh,et al.  LOGICAL DISK: A SIMPLE NEW APPROACH TO IMPROVING FILE SYSTEM PERFORMANCE , 1993 .

[9]  Tom R. Halfhill PDAs arrive: but aren't quite here yet , 1993 .

[10]  Kai Li,et al.  Operating system implications of solid-state mobile computers , 1993, Proceedings of IEEE 4th Workshop on Workstation Operating Systems. WWOS-III.

[11]  Mendel Rosenblum,et al.  The design and implementation of a log-structured file system , 1991, SOSP '91.

[12]  Brian L. Dipert,et al.  Designing with flash memory , 1993 .

[13]  Kester Li Towards A Low Power File System , 1994 .

[14]  David Hinds und Dirk Geschke Linux PCMCIA HOWTO , 1997 .

[15]  Scott D. Carson,et al.  A system for adaptive disk rearrangement , 1990, Softw. Pract. Exp..

[16]  Jeanna Neefe Matthews,et al.  Improving the performance of log-structured file systems with adaptive methods , 1997, SOSP.

[17]  P. Krishnan,et al.  Flash memory file caching for mobile computers , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[18]  Tom Shanley,et al.  PCMCIA system architecture , 1995 .

[19]  Chris Ruemmler,et al.  Disk Shuffling , 1991 .

[20]  Keith Bostic,et al.  A Pageable Memory Based Filesystem , 1990, USENIX Summer.

[21]  Margo I. Seltzer,et al.  Heuristic Cleaning Algorithms in Log-Structured File Systems , 1995, USENIX.

[22]  Hiroshi Motoda,et al.  A Flash-Memory Based File System , 1995, USENIX.

[23]  Michael Wu,et al.  eNVy: a non-volatile, main memory storage system , 1994, ASPLOS VI.

[24]  Ruei-Chuan Chang,et al.  Cleaning policies in mobile computers using flash memory , 1999, J. Syst. Softw..

[25]  Mary Baker,et al.  Non-volatile memory for fast, reliable file systems , 1992, ASPLOS V.

[26]  DiskPerformanceCarl StaelinHector Garcia-MolinaDepartment Clustering Active Disk Data to Improve , 1990 .

[27]  Wilson C. Hsieh,et al.  The logical disk: a new approach to improving file systems , 1994, SOSP '93.

[28]  John Wilkes,et al.  A trace-driven analysis of disk working set sizes , 1993 .

[29]  Kai Li,et al.  Storage alternatives for mobile computers , 1994, OSDI '94.

[30]  Ruei-Chuan Chang,et al.  Managing flash memory in personal communication devices , 1997, ISCE '97. Proceedings of 1997 IEEE International Symposium on Consumer Electronics (Cat. No.97TH8348).

[31]  Kenneth Salem,et al.  Adaptive block rearrangement , 1993, TOCS.