Wide area data replication for scientific collaborations

Scientific applications require sophisticated data management capabilities. We present the design and implementation of a data replication service (DRS), one of a planned set of higher-level data management services for Grids. The capabilities of the DRS are based on the publication capability of the lightweight data replicator (LDR) system developed for the LIGO Scientific Collaboration. We describe LIGO publication requirements and LDR functionality. We also describe the design and implementation of the DRS in the Globus Toolkit Version 4.0 environment and present performance results.

[1]  Donald F. Ferguson,et al.  The WS-Resource Framework , 2004 .

[2]  Frank Leymann,et al.  Modeling Stateful Resources with Web Services , 2004 .

[3]  Joshua R. Smith,et al.  LIGO: The laser interferometer gravitational-wave observatory , 2006, QELS 2006.

[4]  Arie Shoshani,et al.  Storage resource managers: Middleware components for gridstorage , 2005 .

[5]  Reagan Moore,et al.  The SDSC storage resource broker , 2010, CASCON.

[6]  C. Aulbert,et al.  Detector description and performance for the first coincidence observations between LIGO and GEO , 2003 .

[7]  Peter Z. Kunszt,et al.  Giggle: A Framework for Constructing Scalable Replica Location Services , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[8]  Carl Kesselman,et al.  Performance and scalability of a replica location service , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[9]  M Branco.  Don Quijote - Data Management for the ATLAS Automatic Production System , 2005 .

[10]  Arie Shoshani,et al.  The Earth System Grid: Supporting the Next Generation of Climate Modeling Research , 2005, Proceedings of the IEEE.

[11]  Roy Williams,et al.  Network data analysis server (NDAS) prototype development , 2002 .

[12]  Carl Kesselman,et al.  GriPhyN and LIGO, building a virtual data Grid for gravitational wave scientists , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[13]  Erwin Laure,et al.  Advanced Replica Management with Reptor , 2003, PPAM.

[14]  et al,et al.  Detector description and performance for the first coincidence observations between LIGO and GEO , 2004 .

[15]  William E. Allcock,et al.  The Globus Striped GridFTP Framework and Server , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[16]  Satoshi Matsuoka,et al.  Worldwide Fast File Replication on Grid Datafarm , 2003, ArXiv.