Databases in Grid Applications: Locality and Distribution

This paper focuses on two areas that experience in building database-oriented e-science applications has shown to be important. Firstly, methods of promoting data locality are vital due to the high cost of moving data in service-based distributed systems. Databases provide an excellent basis for achieving this due to their potential for moving computation to data. The paper also describes a new infrastructure that further promotes locality by enabling service-based computations to migrate to data. Secondly, the ability to combine information from a set of distributed databases has proved invaluable in many applications. The paper describes the design of an adaptive distributed query processing system that is able to exploit facilities offered by an underlying grid infrastructure. In addressing these two areas, the paper gives an overview of some of the generic components that have been designed to simplify the integration of databases into e-science applications.

[1]  Ian T. Foster,et al.  Security for Grid services , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[2]  Paul McKee,et al.  Dynamic Allocation of Servers to Jobs in a Grid Hosting Environment , 2004 .

[3]  Jean Bacon,et al.  Using events to build distributed applications , 1995, Second International Workshop on Services in Distributed and Networked Environments.

[4]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[5]  Nicholas R. Jennings,et al.  The Semantic Grid: Past, Present, and Future , 2005, Proceedings of the IEEE.

[6]  Norman W. Paton,et al.  Self-monitoring query execution for adaptive query processing , 2004, Data Knowl. Eng..

[7]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[8]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[9]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[10]  I. Mitrani,et al.  Optimal Server Allocation in Reconfigurable Clusters with Multiple Job Types , 2004, ICCSA.

[11]  Joel H. Saltz,et al.  DataCutter and A Client Interface for the Storage Resource Broker withDataCutter Services , 2000 .

[12]  Geoffrey C. Fox,et al.  The Narada Event Brokering System: Overview and Extensions , 2002, PDPTA.

[13]  Aniruddha R. Thakar,et al.  When Database Systems Meet the Grid , 2005, CIDR.

[14]  Paul Watson,et al.  An Architecture for the Dynamic Deployment of Web Services on a Grid or the Internet , 2005 .

[15]  Miron Livny,et al.  Condor: a distributed job scheduler , 2001 .

[16]  Jim Smith,et al.  Fault-tolerance in distributed query processing , 2005, 9th International Database Engineering & Application Symposium (IDEAS'05).

[17]  Goetz Graefe,et al.  Encapsulation of parallelism in the Volcano query processing system , 1990, SIGMOD '90.

[18]  Francine Berman,et al.  Grid Computing: Making the Global Infrastructure a Reality , 2003 .

[19]  Robert Stevens,et al.  {myGrid} and the drug discovery process , 2004 .

[20]  Tony Linde,et al.  AstroGrid: Initial Deployment of the UK's Virtual Observatory , 2004 .

[21]  Paul Watson,et al.  Databases and the Grid , 2003 .

[22]  Antonio Laganà,et al.  Computational Science and Its Applications – ICCSA 2004 , 2004, Lecture Notes in Computer Science.

[23]  Jim Smith,et al.  Service-Based Distributed Querying on the Grid , 2003, ICSOC.

[24]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[25]  Francisco Curbera,et al.  Web Services Business Process Execution Language Version 2.0 , 2007 .

[26]  William Gropp,et al.  Beowulf Cluster Computing with Linux , 2003 .

[27]  Paul Watson,et al.  The NU-Grid Persistent Object Computation Server , 2000 .

[28]  Dennis Gannon,et al.  Active management of scientific data , 2005, IEEE Internet Computing.

[29]  Bob Atkinson.  Web Services Security (WS-Security) , 2003 .