Creating a programmable object storage stack

The current file system and storage stack is restricted in the amount of information that flows from application to storage and from storage to application. This limits the ability of applications to tailor the storage system to particular needs of the application. In this paper, we investigate the programmability of the storage system stack and how to enable application aware storage. Our focus is on object storage systems because of its amenability to these ideas. We introduce two main ideas, namely enabling active objects in order to allow computation at the object storage system and the use of higher level object interfaces to enable intra-stack communications to allow application-aware storage and storage-aware applications. We show preliminary results using a key-value interface to access object stores directly.

[1]  Scott A. Brandt,et al.  Dynamic Metadata Management for Petabyte-Scale File Systems , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[2]  Robert B. Ross,et al.  PVFS: A Parallel File System for Linux Clusters , 2000, Annual Linux Showcase & Conference.

[3]  Sumit Narayan,et al.  ATTEST: ATTributes-based Extendable STorage , 2010, J. Syst. Softw..

[4]  Paul A. Wortman,et al.  An active storage framework for object storage devices , 2012, 012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST).

[5]  Josef Bacik,et al.  BTRFS: The Linux B-Tree Filesystem , 2013, TOS.

[6]  Steven W. Schlosser,et al.  Enabling database-aware storage with OSD , 2007, 24th IEEE Conference on Mass Storage Systems and Technologies (MSST 2007).

[7]  Jon Howell,et al.  Embassies: Radically Refactoring the Web , 2013, NSDI.

[8]  Garth A. Gibson,et al.  Active Disks: Remote Execution for Network-Attached Storage (CMU-CS-97-198) , 1997 .

[9]  John S. Heidemann,et al.  File-system development with stackable layers , 1994, TOCS.

[10]  Joel H. Saltz,et al.  Active disks: programming model, algorithms and evaluation , 1998, ASPLOS VIII.

[11]  Erez Zadok,et al.  Extending File Systems Using Stackable Templates , 1999, USENIX Annual Technical Conference, General Track.

[12]  John A. Chandy,et al.  Active storage using object-based devices , 2008, 2008 IEEE International Conference on Cluster Computing.

[13]  Yuanyuan Zhou,et al.  Mining block correlations to improve storage performance , 2005, TOS.

[14]  Tao Yang,et al.  The Panasas ActiveScale Storage Cluster - Delivering Scalable High Bandwidth Storage , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[15]  OHAD RODEH,et al.  B-trees, shadowing, and clones , 2008, TOS.

[16]  Christos Faloutsos,et al.  Active Disks for Large-Scale Data Processing , 2001, Computer.