GreenFS: making enterprise computers greener by protecting them better

Hard disks contain data - frequently an irreplaceable asset of high monetary and non-monetary value. At the same time, hard disks are mechanical devices that consume power, are noisy, and fragile when their platters are rotating. In this paper we demonstrate that hard disks cause different kinds of problems for different types of computer systems and demystify several common misconceptions. We show that solutions developed to date are incapable of solving the power consumption, noise, and data reliability problems without sacrificing hard disk life-time, data reliability, or user convenience. We considered data reliability, recovery, performance, user convenience, and hard disk-caused problems together at the enterprise scale. We have designed GreenFS: a fan-out stackable file system that offers all-time all-data run-time data protection, improves performance under typical user workloads, and allows hard disks to be kept off most of the time. As a result, GreenFS improves enterprise data protection, minimizes disk drive-related power consumption and noise and increases the chances of disk drive survivability in case of unexpected external impacts.

[1]  Randal Burns,et al.  Ext3cow: The Design, Implementation, and Analysis of Metadata for a Time-Shifting File System , 2003 .

[2]  Erez Zadok,et al.  A Versatile and User-Oriented Versioning File System , 2004, FAST.

[3]  Michael Austin Halcrow eCryptfs: An Enterprise-class Encrypted Filesystem for Linux , 2010 .

[4]  Paula Ta-Shma,et al.  Architectures for Controller Based CDP , 2007, FAST.

[5]  Jacob R. Lorch,et al.  A five-year study of file-system metadata , 2007, TOS.

[6]  Nikolai Joukov,et al.  RAIF: Redundant Array of Independent Filesystems , 2007, 24th IEEE Conference on Mass Storage Systems and Technologies (MSST 2007).

[7]  Jason Flinn,et al.  PAN-on-Demand: Building self-organizing WPANs for better power management , 2006 .

[8]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[9]  Michael L. Scott,et al.  Energy efficient prefetching and caching , 2004 .

[10]  Scott A. Brandt,et al.  A Hybrid Disk-Aware Spin-Down Algorithm with I/O Subsystem Support , 2007, 2007 IEEE International Performance, Computing, and Communications Conference.

[11]  Erez Zadok,et al.  Proceedings of the General Track: 2003 Usenix Annual Technical Conference Ncryptfs: a Secure and Convenient Cryptographic File System , 2022 .

[12]  Jason Flinn,et al.  Energy-Efficiency and Storage Flexibility in the Blue File System , 2004, OSDI.

[13]  Darrell D. E. Long,et al.  Duplicate Data Elimination in a SAN File System , 2004, MSST.

[14]  Bianca Schroeder,et al.  Disk Failures in the Real World: What Does an MTTF of 1, 000, 000 Hours Mean to You? , 2007, FAST.

[15]  Dirk Grunwald,et al.  Massive Arrays of Idle Disks For Storage Archives , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[16]  Jin Qian,et al.  PARAID: A gear-shifting power-aware RAID , 2007, TOS.

[17]  Nikolai Joukov,et al.  On incremental file system development , 2006, TOS.

[18]  Geoffrey H. Kuenning,et al.  Conquest: Better Performance Through a Disk/Persistent-RAM Hybrid File System , 2002, USENIX Annual Technical Conference, General Track.

[19]  P. Sarbanes,et al.  Sarbanes-Oxley Act of 2002 , 2002 .

[20]  Nikolai Joukov,et al.  Adding secure deletion to your favorite file system , 2005, Third IEEE International Security in Storage Workshop (SISW'05).

[21]  Yuanyuan Zhou,et al.  Hibernator: helping disk arrays sleep through the winter , 2005, SOSP '05.

[22]  Kang G. Shin,et al.  FS2: dynamic data replication in free disk space for improving disk performance and energy consumption , 2005, SOSP '05.

[23]  Ricardo Bianchini,et al.  Conserving disk energy in network servers , 2003, ICS '03.

[24]  Erez Zadok,et al.  Round-trip privacy with nfsv4 , 2007, StorageSS '07.

[25]  Jason Flinn,et al.  Ghosts in the machine: interfaces for better power management , 2004, MobiSys '04.

[26]  Vibhore Vardhan,et al.  Power Consumption Breakdown on a Modern Laptop , 2004, PACS.

[27]  David S. H. Rosenthal,et al.  Evolving the Vnode interface , 1990, USENIX Summer.

[28]  Erez Zadok,et al.  Avfs: An On-Access Anti-Virus File System , 2004, USENIX Security Symposium.

[29]  Jun Wang,et al.  RIMAC: a novel redundancy-based hierarchical cache architecture for energy efficient, high performance storage systems , 2006, EuroSys.

[30]  David Quigley,et al.  Unionfs: User- and Community-Oriented Development of a Unification File System , 2006 .

[31]  P. Krishnan,et al.  Thwarting the Power-Hungry Disk , 1994, USENIX Winter.

[32]  Nikolai Joukov,et al.  Operating system profiling via latency analysis , 2006, OSDI '06.

[33]  Nikolai Joukov,et al.  Auto-pilot: A Platform for System Software Benchmarking , 2005, USENIX Annual Technical Conference, FREENIX Track.

[34]  Erez Zadok,et al.  I3FS: An In-Kernel Integrity Checker and Intrusion Detection File System , 2004, LISA.

[35]  Fred Douglis,et al.  Redundancy Elimination Within Large Collections of Files , 2004, USENIX Annual Technical Conference, General Track.

[36]  Erez Zadok,et al.  Fast Indexing: Support for Size-Changing Algorithms in Stackable File Systems , 2001, USENIX Annual Technical Conference, General Track.

[37]  Ahmed Amer,et al.  Expecting the unexpected: adaptation for predictive energy conservation , 2005, StorageSS '05.

[38]  G. Evans,et al.  Stress and open-office noise. , 2000, The Journal of applied psychology.

[39]  Michael J. Feeley,et al.  Secure file system versioning at the block level , 2007, EuroSys '07.