Managing storage space in a flash and disk hybrid storage system

This paper considers the problem of efficiently managing storage space in a hybrid storage system employing flash and disk drives. The flash and disk drives exhibit different performance characteristics of read and write behavior. We propose a technique for balancing the workload properties across flash and disk drives in such a hybrid storage system. The presented approach automatically and transparently manages migration of data blocks among flash and disk drives based on their access patterns. This paper presents the design and an evaluation of the proposed approach on a Linux testbed through realistic experiments.

[1]  Randy H. Katz,et al.  An Analysis of File Migration in a UNIX Supercomputing Environment , 1993, USENIX Winter.

[2]  Jeffrey Katcher,et al.  PostMark: A New File System Benchmark , 1997 .

[3]  Alexander A. Stepanov,et al.  Loge: A Self-Organizing Disk Controller , 1991 .

[4]  Trevor N. Mudge,et al.  Improving NAND Flash Based Disk Caches , 2008, 2008 International Symposium on Computer Architecture.

[5]  David A. Patterson,et al.  Virtual log based file systems for a programmable disk , 1999, OSDI '99.

[6]  Sivan Toledo,et al.  Algorithms and data structures for flash memories , 2005, CSUR.

[7]  A. L. Narasimha Reddy,et al.  Umbrella file system: Storage management across heterogeneous devices , 2009, TOS.

[8]  Jongmoo Choi,et al.  Uniformity improving page allocation for flash memory file systems , 2007, EMSOFT '07.

[9]  Sriram Sankar,et al.  Sensitivity Based Power Management of Enterprise Storage Systems , 2008, 2008 IEEE International Symposium on Modeling, Analysis and Simulation of Computers and Telecommunication Systems.

[10]  Hyojun Kim,et al.  BPLRU: A Buffer Management Scheme for Improving Random Writes in Flash Storage , 2008, FAST.

[11]  Richard P. Martin,et al.  NFS sensitivity to high performance networks , 1999, SIGMETRICS '99.

[12]  Chenyang Lu,et al.  Proceedings of the Fast 2002 Conference on File and Storage Technologies Aqueduct: Online Data Migration with Performance Guarantees , 2022 .

[13]  Ethan L. Miller,et al.  A fast algorithm for online placement and reorganization of replicated data , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[14]  Christian Scheideler,et al.  Efficient, distributed data placement strategies for storage area networks (extended abstract) , 2000, SPAA '00.

[15]  Carl Staelin,et al.  The HP AutoRAID hierarchical storage system , 1995, SOSP.

[16]  Eric Anderson,et al.  Proceedings of the Fast 2002 Conference on File and Storage Technologies Hippodrome: Running Circles around Storage Administration , 2022 .

[17]  Sandeep Uttamchandani,et al.  Risk-Modulated Proactive Data Migration for Maximizing Storage System Utility , 2006 .

[18]  Li-Pin Chang,et al.  On efficient wear leveling for large-scale flash-memory storage systems , 2007, SAC '07.

[19]  Stratis Viglas,et al.  Flashing up the storage layer , 2008, Proc. VLDB Endow..

[20]  Bruce S. Davie,et al.  Computer Networks: A Systems Approach , 1996 .

[21]  Michael Wu,et al.  eNVy: a non-volatile, main memory storage system , 1994, ASPLOS VI.

[22]  Howard Gobioff,et al.  The Google file system , 2003, SOSP '03.

[23]  Olivia R. Liu Sheng.  Dynamic file migration in distributed computer systems , 1990, CACM.

[24]  Arif Merchant,et al.  FAB: building distributed enterprise disk arrays from commodity components , 2004, ASPLOS XI.

[25]  Han-joon Kim,et al.  An Effective Flash Memory Manager for Reliable Flash Memory Space Management , 2002 .

[26]  Michael Isard,et al.  A design for high-performance flash disks , 2007, OPSR.

[27]  A. L. Narasimha Reddy,et al.  User-centric data migration in networked storage systems , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[28]  Changxun Wu,et al.  Handling Heterogeneity in Shared-Disk File Systems , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[29]  Krzysztof Nienartowicz,et al.  An overview of a large-scale data migration , 2003, 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings..

[30]  Medha Bhadkamkar,et al.  EXCES: External caching in energy saving storage systems , 2008, 2008 IEEE 14th International Symposium on High Performance Computer Architecture.

[31]  Thomas Gross,et al.  Combining the concepts of compression and caching for a two-level filesystem , 1991 .

[32]  Kenneth Salem,et al.  Adaptive block rearrangement , 1993, TOCS.

[33]  Daniel M. Dias,et al.  Placement of multimedia blocks on zoned disks , 1996, Electronic Imaging.

[34]  Geoffrey H. Kuenning,et al.  Conquest: Better Performance Through a Disk/Persistent-RAM Hybrid File System , 2002, USENIX Annual Technical Conference, General Track.

[35]  Alan Jay Smith,et al.  Long term file migration: development and evaluation of algorithms , 1981, CACM.

[36]  Jongmoo Choi,et al.  Block recycling schemes and their cost-based optimization in nand flash memory based storage system , 2007, EMSOFT '07.