The SDSC storage resource broker

This paper describes the architecture of the SDSC Storage Resource Broker (SRB). The SRB is middleware that provides applications a uniform API to access heterogeneous distributed storage resources including, filesystems, database systems, and archival storage systems. The SRB utilizes a metadata catalog service, MCAT, to provide a "collection"-oriented view of data. Thus, data items that belong to a single collection may, in fact, be stored on heterogeneous storage systems. The SRB infrastructure is being used to support digital library projects at SDSC. This paper describes the architecture and various features of the SDSC SRB.

[1]  R. A. Coyne,et al.  The high performance storage system , 1993, Supercomputing '93.

[2]  W. Marsden.  I and J , 2012 .

[3]  Chaitanya K. Baru,et al.  A hierarchical access control scheme for digital libraries , 1998, DL '98.

[4]  Telecommunications Board,et al.  The Unpredictable Certainty: Information Infrastructure Through 2000 , 1996 .

[5]  Larry Carter,et al.  Evaluation of a Multithreaded Architecture for Defense Applications. , 1999 .

[6]  Mic Bowman,et al.  Digital Libraries: The Next Generation in File System Technology , 1998, D Lib Mag..

[7]  Eric Ketelaar,et al.  Archiving metadata , 2001 .

[8]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[9]  Wang Yi.  Information-Based Computing Technology in Grid , 2003 .

[10]  Wayne Schroeder.  The SDSC encryption/authentication (SEA) system , 1999 .

[11]  Reagan Moore,et al.  Towards the Interoperability of Web, Database, and Mass Storage Technologies for Petabyte Archives , 1996 .

[12]  Judith R. Davis.  DATALINKS : MANAGING EXTERNAL DATA WITH DB 2 UNIVERSAL DATABASE Prepared for IBM Corporation by , 1999 .

[13]  Wayne Schroeder.  The SDSC encryption/authentication (SEA) system , 1999, Concurr. Pract. Exp..

[14]  Reagan Moore,et al.  A Data Handling Architecture for a Prototype Federal Application , 1998 .

[15]  Ulrich Brosch.  Dublin Core Metadata , 2006 .

[16]  Robert Wilensky,et al.  Testbed Development for the Berkeley Digital Library Project , 1996, D Lib Mag..

[17]  J. Howard Et El,et al.  Scale and performance in a distributed file system , 1988 .

[18]  Terence R. Smith,et al.  The Alexandria Digital Library Testbed , 1996, D-Lib Magazine.