Grids and Grid technologies for wide‐area distributed computing

The last decade has seen a substantial increase in commodity computer and network performance, mainly as a result of faster hardware and more sophisticated software. Nevertheless, there are still problems, in the fields of science, engineering, and business, which cannot be effectively dealt with using the current generation of supercomputers. In fact, due to their size and complexity, these problems are often very numerically and/or data intensive and consequently require a variety ofheterogeneous resources that are not available on a single machine. A number of teams have conducted experimental studies on the cooperative use of geographically distributed resources unified to act as a single powerful computer. This new approach is known by several names, such as metacomputing, scalable computing, global computing, Internet computing, and more recently peer‐to‐peer or Grid computing. The early efforts in Grid computing started as a project to link supercomputing sites, but have now grown far beyond their original intent. In fact, many applications can benefit from the Grid infrastructure, including collaborative engineering, data exploration, high‐throughput computing, and of course distributed supercomputing. Moreover, due to the rapid growth of the Internet and Web, there has been a rising interest in Web‐based distributed computing, and many projects have been started and aim to exploit the Web as an infrastructure for running coarse‐grained distributed and parallel applications. In this context, the Web has the capability to be a platform for parallel and collaborative work as well as a key technology to create a pervasive and ubiquitous Grid‐based infrastructure. This paper aims to present the state‐of‐the‐art of Grid computing and attempts to survey the major international efforts in developing this emerging technology. Copyright © 2002 John Wiley & Sons, Ltd.

[1]  William E. Johnston,et al.  Grids as production computing environments: the engineering aspects of NASA's Information Power Grid , 1999, Proceedings. The Eighth International Symposium on High Performance Distributed Computing (Cat. No.99TH8469).

[2]  Sonia Sharama,et al.  Grid Computing , 2004, Lecture Notes in Computer Science.

[3]  Jay Boisseau,et al.  Development of Web toolkits for computational science portals: the NPACI HotPage , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[4]  Javier Jaén Martínez,et al.  Data Management in an International Data Grid Project , 2000, GRID.

[5]  Rajkumar Buyya,et al.  GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing , 2002, Concurr. Comput. Pract. Exp..

[6]  Richard M. Fujimoto.  Distributed simulation systems , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[7]  David Abramson,et al.  An Economy Driven Resource Management Architecture for Global Computational Power Grids , 2000, PDPTA.

[8]  Tamotsu Noguchi,et al.  PAPIA (Parallel Protein Information Analysis) System and MolTreC Parallel Molecular Dynamics Simulator Running on a Compact 8-node Linux PC Cluster , 1999 .

[9]  Rajkumar Buyya,et al.  Economic-based Distributed Resource Management and Scheduling for Grid Computing , 2002, ArXiv.

[10]  Satoshi Matsuoka.  Grid RPC meets data grid: network enabled services for data farming on the grid , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[11]  David Abramson,et al.  Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid , 2000, Proceedings Fourth International Conference/Exhibition on High Performance Computing in the Asia-Pacific Region.

[12]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[13]  David Abramson,et al.  An Evaluation of Economy-based Resource Trading and Scheduling on Computational Power Grids for Parameter Sweep Applications , 2000 .

[14]  Paul Roe,et al.  ActiveSheets: Super-Computing with Spreadsheets , 2001 .

[15]  Maxine D. Brown.  The International Grid (iGrid): Empowering Global Research Community Networking Using High Performance International Internet Services , 1999 .

[16]  Henri Casanova,et al.  NetSovle: A Network Server for Solving Computational Science Problems , 1996, Proceedings of the 1996 ACM/IEEE Conference on Supercomputing.

[17]  Rajkumar Buyya,et al.  Libra: An Economy driven Job Scheduling System for Clusters , 2002, ArXiv.

[18]  Rajkumar Buyya,et al.  A Deadline and Budget Constrained Cost-Time Optimisation Algorithm for Scheduling Task Farming Applications on Global Grids , 2002, ArXiv.

[19]  A. Watson,et al.  OMG (Object Management Group) architecture and CORBA (common object request broker architecture) specification , 2002 .

[20]  Steven Tuecke,et al.  The Physiology of the Grid An Open Grid Services Architecture for Distributed Systems Integration , 2002 .

[21]  Ken Arnold,et al.  The Java Programming Language , 1996 .

[22]  Geoffrey C. Fox,et al.  Parallel Computing Works , 1994 .

[23]  Federico Ruggieri.  The Datagrid Project , 2001 .

[24]  Mitsuhisa Sato,et al.  Ninf: A Network Based Information Library for Global World-Wide Computing Infrastructure , 1997, HPCN Europe.

[25]  Dale Rogerson,et al.  Inside COM , 1997 .

[26]  David F. Snelling,et al.  UNICORE: uniform access to supercomputing as an element of electronic commerce , 1999, Future Gener. Comput. Syst..

[27]  Ken Arnold,et al.  The Java programming language (2nd ed.) , 1998 .

[28]  Jason Lee,et al.  High-Performance Remote Access to Climate Simulation Data: A Challenge Problem for Data Grid Technologies , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[29]  L. Camarinha-Matos,et al.  Infrastructures for Virtual Enterprises , 1999, IFIP — The International Federation for Information Processing.

[30]  Carl Kesselman,et al.  High-Performance Remote Access to Climate Simulation Data: A Challenge Problem for Data Grid Technologies , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[31]  David Abramson,et al.  Economic models for management of resources in peer-to-peer and grid computing , 2001, SPIE ITCom.

[32]  Geoffrey C. Fox,et al.  WebFlow - High-Level Programming Environment and Visual Authoring Toolkit for High Performance Distributed Computing , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[33]  Richard M. Fujimoto,et al.  Parallel and Distribution Simulation Systems , 1999 .

[34]  R.M. Fujimoto,et al.  Parallel and distributed simulation systems , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[35]  Francine Berman,et al.  Combining workstations and supercomputers to support grid applications: the parallel tomography experience , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[36]  Jim Waldo,et al.  The Jini architecture for network-centric computing , 1999, CACM.

[37]  David Abramson,et al.  High performance parametric modeling with Nimrod/G: killer application for the global grid? , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[38]  Domenico Laforenza.  Programming High Performance Applications in Grid Environments , 2001, PVM/MPI.

[39]  Vipin Kumar,et al.  Information power grid: The new frontier in parallel computing? , 1999, IEEE Concurr..

[40]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[41]  Rajkumar Buyya,et al.  High Performance Cluster Computing: Architectures and Systems , 1999 .

[42]  Geoffrey C. Fox,et al.  Using Gateway system to provide a desktop access to high performance computational resources , 1999, Proceedings. The Eighth International Symposium on High Performance Distributed Computing (Cat. No.99TH8469).

[43]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[44]  Koen Holtman,et al.  CMS Data Grid System Overview and Requirements , 2001 .

[45]  Wolfgang Gentzsch.  Metacomputing: from workstation clusters to Internet computing , 1999 .

[46]  David Abramson,et al.  The Virtual Laboratory: a toolset to enable distributed molecular modelling for drug design on the World‐Wide Grid , 2003, Concurr. Comput. Pract. Exp..

[47]  Andrew S. Grimshaw,et al.  The Legion vision of a worldwide virtual computer , 1997, Commun. ACM.

[48]  James F. Doyle,et al.  Peer-to-Peer: harnessing the power of disruptive technologies , 2001, UBIQ.

[49]  David Abramson,et al.  A case for economy grid architecture for service oriented grid computing , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[50]  Li Gong.  Project JXTA: A Technology Overview , 2001 .

[51]  Rajkumar Buyya,et al.  Weaving computational grids: how analogous are they with electrical grids? , 2002, Comput. Sci. Eng..