NAND flash memory-based hybrid file system for high I/O performance

As the performance potentials of SSD (Solid State Device) have been recognized, adopting SSD to IT products as HDD replacements is rapidly increasing. Since SSD is organized into multiple flash memory packages, it deploys peculiar device characteristics that do not occur in HDD, such as block-unit erasure overhead. Also, its high cost per capacity is the main obstacle to building a large-scale storage subsystem with only SSDs. An alternative is to build a hybrid storage subsystem where a small portion of SSDs are integrated with HDDs so as to utilize SSD's performance advantages in a cost-effective way. This study introduces a new form of file system, called N-hybrid (New-Form of hybrid file system), that enables us to support the hybrid device structure combined with both HDD and SSD. Our primary objectives in developing N-hybrid are to provide better I/O bandwidth by exploiting the characteristics of HDD and SSD and to provide a flexible data layout maximizing the usage of tight SSD storage resources. Several experiments were conducted to verify the effectiveness and suitability of N-hybrid.

[1]  Mendel Rosenblum,et al.  The design and implementation of a log-structured file system , 1991, SOSP '91.

[2]  Sungjin Lee,et al.  FlexFS: A Flexible Flash File System for MLC NAND Flash Memory , 2009, USENIX Annual Technical Conference.

[3]  Michael M. Swift,et al.  FlashVM: Virtual Memory Management on Flash , 2010, USENIX Annual Technical Conference.

[4]  Wei Hu,et al.  Scalability in the XFS File System , 1996, USENIX Annual Technical Conference.

[5]  Sang Lyul Min,et al.  A space-efficient flash translation layer for CompactFlash systems , 2002, IEEE Trans. Consumer Electron..

[6]  Rajeev Thakur,et al.  High-performance scientific data management system , 2003, J. Parallel Distributed Comput..

[7]  Li-Pin Chang,et al.  Design and implementation of an efficient wear-leveling algorithm for solid-state-disk microcontrollers , 2009, TODE.

[8]  Tei-Wei Kuo,et al.  Efficient identification of hot data for flash memory storage systems , 2006, TOS.

[9]  Mahesh Balakrishnan,et al.  Extending SSD Lifetimes with Disk-Based Write Caches , 2010, FAST.

[10]  Jaemin Jung,et al.  FRASH: Exploiting storage class memory in hybrid file system for hierarchical storage , 2010, TOS.

[11]  Geoffrey H. Kuenning,et al.  The Conquest file system: Better performance through a disk/persistent-RAM hybrid design , 2006, TOS.

[12]  Tei-Wei Kuo,et al.  An efficient management scheme for large-scale flash-memory storage systems , 2004, SAC '04.

[13]  Kanad Ghose,et al.  hFS: a hybrid file system prototype for improving small file and metadata performance , 2007, EuroSys '07.

[14]  Sung Hoon Baek,et al.  A Hybrid Flash File System Based on NOR and NAND Flash Memories for Embedded Devices , 2008, IEEE Transactions on Computers.

[15]  Sivan Toledo,et al.  Algorithms and data structures for flash memories , 2005, CSUR.

[16]  John D. Davis,et al.  Block Management in Solid-State Devices , 2009, USENIX Annual Technical Conference.

[17]  Sang Lyul Min,et al.  Development Platforms for Flash Memory Solid State Disks , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[18]  David Woodhouse,et al.  JFFS : The Journalling Flash File System , 2001 .

[19]  A. Leon-Garcia,et al.  Probability, statistics, and random processes for electrical engineering , 2008 .

[20]  Jongmoo Choi,et al.  Exploiting non-volatile RAM to enhance flash file system performance , 2007, EMSOFT '07.

[21]  Hyojun Kim,et al.  BPLRU: A Buffer Management Scheme for Improving Random Writes in Flash Storage , 2008, FAST.

[22]  Jeffrey Katcher,et al.  PostMark: A New File System Benchmark , 1997 .

[23]  M. Polte,et al.  Comparing performance of solid state devices and mechanical disks , 2008, 2008 3rd Petascale Data Storage Workshop.

[24]  Chanik Park,et al.  A Re-configurable FTL (Flash Translation Layer) Architecture for NAND Flash based Applications , 2007, IEEE International Workshop on Rapid System Prototyping.

[25]  Sivan Toledo,et al.  A Transactional Flash File System for Microcontrollers , 2005, USENIX Annual Technical Conference, General Track.

[26]  Michael Neufeld,et al.  ELF: an efficient log-structured flash file system for micro sensor nodes , 2004, SenSys '04.