Towards dynamic data grid framework for eResearch

The scale at which scientific data is produced will undergo a massive change in the near future. Many sophisticated scientific discovery laboratories or the installation of sensor networks would produce a large amount of data. Research in protein crystallography for instance can produce hundreds of Terabytes of data from a single crystallography beamline. These data have to be saved for future use and made available for collaborative use by researchers. There is a need to develop a framework which can deal with storing such data volumes. This framework should also handle disparate data sources tightly integrated with the users' applications and large data streams arising from instruments and sensors. This paper presents an initial study into the framework for servicing large dynamic data sets over a national grid for eResearch.

[1]  Serguei Leontiev,et al.  Using the GOST R 34.10-94, GOST R 34.10-2001, and GOST R 34.11-94 Algorithms with the Internet X.509 Public Key Infrastructure Certificate and CRL Profile , 2006, RFC.

[2]  Andrew S. Grimshaw,et al.  The Legion vision of a worldwide virtual computer , 1997, Commun. ACM.

[3]  David F. Snelling,et al.  UNICORE: uniform access to supercomputing as an element of electronic commerce , 1999, Future Gener. Comput. Syst..

[4]  Donald F. McMullen,et al.  Instruments and Sensors as Network Services : Making Instruments First Class Members of the Grid , 2003 .

[5]  Alan O. Freier,et al.  The SSL Protocol Version 3.0 , 1996 .

[6]  Steven Tuecke,et al.  Internet X.509 Public Key Infrastructure (PKI) Proxy Certificate Profile , 2004, RFC.

[7]  Steven Tuecke,et al.  An online credential repository for the Grid: MyProxy , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[8]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[9]  Reagan Moore,et al.  Data and Metadata Collections for Scientific Applications , 2001, HPCN Europe.

[10]  William E. Johnston,et al.  Computational and data Grids in large-scale science and engineering , 2002, Future Gener. Comput. Syst..

[11]  Steven Tuecke,et al.  X.509 Proxy Certificates for Dynamic Delegation , 2004 .

[12]  W. Allcock,et al.  GridFTP protocol specification , 2002 .

[13]  Reagan Moore,et al.  MySRB & SRB: Components of a Data Grid , 2002 .

[14]  Shi-Yi Mao,et al.  A study on an algorithm of multisensor data fusion , 1994, Proceedings of National Aerospace and Electronics Conference (NAECON'94).

[15]  Russ Housley,et al.  Internet X.509 Public Key Infrastructure Certificate and CRL Profile , 1999, RFC.

[16]  Anne E. Trefethen,et al.  The UK e-Science Core Programme and the Grid , 2002, Future Gener. Comput. Syst..

[17]  Ken Klingenstein.  3rd Annual PKI R&D Workshop , 2004 .

[18]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[19]  Ian T. Foster,et al.  A security architecture for computational grids , 1998, CCS '98.

[20]  Lucien Wald,et al.  Some terms of reference in data fusion , 1999, IEEE Trans. Geosci. Remote. Sens..