An active storage framework for object storage devices

In this paper, we present the design and implementation of an active storage framework for object storage devices. The framework is based on the use of virtual machines/execution engines to execute function code downloaded from client applications. We investigate the issues involved in supporting multiple execution engines. Allowing user-downloadable code fragments introduces potential safety and security considerations, and we study the effect of these considerations on these engines. In particular, we look at various remote procedure execution mechanisms and the efficiency and safety of these mechanisms. Finally, we present performance results of the active storage framework on a variety of applications.

[1]  Joel H. Saltz,et al.  Infrastructure for Building Parallel Database Systems for Multi-Dimensional Data , 1999, IPPS/SPDP.

[2]  Rodney Van Meter,et al.  Network attached storage architecture , 2000, CACM.

[3]  Christos Faloutsos,et al.  Active Storage for Large-Scale Data Mining and Multimedia , 1998, VLDB.

[4]  Sun Microsystems,et al.  RPC: Remote Procedure Call Protocol specification: Version 2 , 1988, RFC.

[5]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[6]  Pete Wyckoff,et al.  Integrating parallel file systems with object-based storage devices , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[7]  Pete Wyckoff,et al.  An OSD-based approach to managing directory operations in parallel file systems , 2008, 2008 IEEE International Conference on Cluster Computing.

[8]  Jeffrey Scott Vitter,et al.  Distributed computing with load-managed active storage , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[9]  Jarek Nieplocha,et al.  Evaluation of active storage strategies for the lustre parallel file system , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[10]  Yu Zhang,et al.  An Active Storage System for High Performance Computing , 2008, 22nd International Conference on Advanced Information Networking and Applications (aina 2008).

[11]  Dana N. Xu,et al.  Design of an Intelligent Object-based Storage device , 2009 .

[12]  Robert B. Ross,et al.  PVFS: A Parallel File System for Linux Clusters , 2000, Annual Linux Showcase & Conference.

[13]  Kanishk Jain.  Object-based Storage , 2022 .

[14]  Joseph L. Hellerstein,et al.  The intelligent disk (idisk): a revolutionary approach to database computing infrastucture , 1998 .

[15]  Tao Yang,et al.  The Panasas ActiveScale Storage Cluster - Delivering Scalable High Bandwidth Storage , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[16]  Carlos Maltzahn,et al.  Ceph: a scalable, high-performance distributed file system , 2006, OSDI '06.

[17]  Michael Hearn.  Security-oriented fast local RPC , 2006 .

[18]  Chris Ruemmler,et al.  DataMesh research project , phase 1 , 1997 .

[19]  David A. Patterson,et al.  A case for intelligent disks (IDISKs) , 1998, SGMD.

[20]  Frank B. Schmuck,et al.  GPFS: A Shared-Disk File System for Large Computing Clusters , 2002, FAST.

[21]  Jim Zelenka,et al.  A cost-effective, high-bandwidth storage architecture , 1998, ASPLOS VIII.

[22]  Yulai Xie,et al.  Design and evaluation of Oasis: An active storage framework based on T10 OSD standard , 2011, 2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST).

[23]  Christos Faloutsos,et al.  Active Disks for Large-Scale Data Processing , 2001, Computer.

[24]  Joel H. Saltz,et al.  DataCutter: Middleware for Filtering Very Large Scientific Datasets on Archival Storage Systems , 2000, IEEE Symposium on Mass Storage Systems.

[25]  Christos Faloutsos,et al.  Data mining on an OLTP system (nearly) for free , 2000, SIGMOD '00.

[26]  Garth A. Gibson,et al.  Active Disks: Remote Execution for Network-Attached Storage (CMU-CS-97-198) , 1997 .

[27]  Joel H. Saltz,et al.  Active disks: programming model, algorithms and evaluation , 1998, ASPLOS VIII.

[28]  Dan Feng,et al.  Active Storage Framework for Object-based Storage Device , 2006, 20th International Conference on Advanced Information Networking and Applications - Volume 1 (AINA'06).

[29]  Pete Wyckoff,et al.  Attribute Storage Design for Object-based Storage Devices , 2007, 24th IEEE Conference on Mass Storage Systems and Technologies (MSST 2007).