Classifying Data to Reduce Long-Term Data Movement in Shingled Write Disks

Shingled magnetic recording (SMR) is a means of increasing the density of hard drives that brings a new set of challenges. Due to the nature of SMR disks, updating in place is not an option. Holes left by invalidated data can only be filled if the entire band is reclaimed, and a poor band compaction algorithm could result in spending a lot of time moving blocks over the lifetime of the device. We propose using write frequency to separate blocks to reduce data movement and develop a band compaction algorithm that implements this heuristic. We demonstrate how our algorithm results in improved data management, resulting in an up to 45% reduction in required data movements when compared to naive approaches to band management.

[1]  P. Desnoyers,et al.  Skylight—A Window on Shingled Disk Operation , 2015, FAST.

[2]  Tei-Wei Kuo,et al.  Efficient identification of hot data for flash memory storage systems , 2006, TOS.

[3]  Carl Staelin,et al.  An Implementation of a Log-Structured File System for UNIX , 1993, USENIX Winter.

[4]  Mendel Rosenblum,et al.  The design and implementation of a log-structured file system , 1991, SOSP '91.

[5]  Hakim Weatherspoon,et al.  Gecko: contention-oblivious disk arrays for cloud storage , 2013, FAST.

[6]  David Hung-Chang Du,et al.  H-SWD: Incorporating Hot Data Identification into Shingled Write Disks , 2012, 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[7]  Vagelis Hristidis,et al.  BORG: Block-reORGanization for Self-optimizing Storage Systems , 2009, FAST.

[8]  Yanping Zhao,et al.  HyLog: A High Performance Approach to Managing Disk Layout , 2004, FAST.

[9]  J. D. Coker,et al.  Data Handling Algorithms For Autonomous Shingled Magnetic Recording HDDs , 2012, IEEE Transactions on Magnetics.

[10]  Jun Wang,et al.  PROFS-performance-oriented data reorganization for log-structured file system on multi-zone disks , 2001, MASCOTS 2001, Proceedings Ninth International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[11]  David A. Patterson,et al.  Virtual log based file systems for a programmable disk , 1999, OSDI '99.

[12]  David Hung-Chang Du,et al.  Novel Address Mappings for Shingled Write Disks , 2014, HotStorage.

[13]  Ahmed Amer,et al.  Emulating a Shingled Write Disk , 2012, 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[14]  Andrea C. Arpaci-Dusseau,et al.  Semantically-Smart Disk Systems , 2003, FAST.

[15]  Antony I. T. Rowstron,et al.  Write off-loading: Practical power management for enterprise storage , 2008, TOS.

[16]  Jun Wang,et al.  WOLF - A Novel Reordering Write Buffer to Boost the Performance of Log-Structured File Systems , 2002, FAST.

[17]  Jeanna Neefe Matthews,et al.  Improving the performance of log-structured file systems with adaptive methods , 1997, SOSP.

[18]  Zvonimir Bandic,et al.  Shingled file system host-side management of Shingled Magnetic Recording disks , 2012, 2012 IEEE International Conference on Consumer Electronics (ICCE).

[19]  Quoc Minh Le,et al.  Workload Impact on Shingled Write Disks: All-Writes Can Be Alright , 2011, 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems.

[20]  Ahmed Amer,et al.  Predictive data grouping: Defining the bounds of energy and latency reduction through predictive data grouping and replication , 2008, TOS.

[21]  Zvonimir Bandic,et al.  Indirection systems for shingled-recording disk drives , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[22]  Chao Jin,et al.  HiSMRfs: A high performance file system for shingled storage array , 2014, 2014 30th Symposium on Mass Storage Systems and Technologies (MSST).

[23]  Peter Desnoyers,et al.  What Systems Researchers Need to Know about NAND Flash , 2013, HotStorage.

[24]  Peter Desnoyers,et al.  Analytic Models of SSD Write Performance , 2014, TOS.

[25]  Margo I. Seltzer,et al.  Heuristic Cleaning Algorithms in Log-Structured File Systems , 1995, USENIX.

[26]  Ahmed Amer,et al.  Design issues for a shingled write disk system , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).