Communication over a Secured Heterogeneous Grid with the GriddLeS Runtime Environment

Scientific workflows are a powerful programming technique for specifying complex computations using a number of otherwise independent components. When used in a Grid environment, it is possible to build powerful "virtual applications" across multiple distributed and heterogeneous resources. Whilst toolkits such as Globus virtualize many system attributes, and thus make it easier to span different organizations, inconsistent security policies and resource heterogeneity can limit the applicability of workflow techniques. In earlier work, we have described a novel run time environment, GriddLeS, that supports flexible communication patterns between workflow components. GriddLeS abstracts IO operations, such that applications are given the illusion of operating on a local file system, whilst in fact they send and receive data between components. In this paper, we describe how GriddLeS assists in resolving some of the issues that arise due to heterogeneity in security policies and system architectures in a Grid environment. We illustrate the solution using a real world scientific workflow for climate modeling, and demonstrate a system that spans multiple conflicting security domains with heterogeneous resources.

[1]  Rajkumar Buyya,et al.  A Taxonomy of Workflow Management Systems for Grid Computing , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[2]  M. Shields,et al.  Chapter 1 RESOURCE MANAGEMENT OF TRIANA P2P SERVICES , 2003 .

[3]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[4]  Carl Kesselman,et al.  Performance and scalability of a replica location service , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[5]  Andrew S. Grimshaw,et al.  Grid-based file access: the Legion I/O model , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[6]  David Abramson,et al.  High performance parametric modeling with Nimrod/G: killer application for the global grid? , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[7]  David Abramson,et al.  Bridging organizational network boundaries on the grid , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[8]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[9]  Ian Foster,et al.  The Globus toolkit , 1998 .

[10]  Sven Graupner,et al.  Globus Grid and Firewalls: Issues and Solutions in a Utility Data Center Environment , 2002 .

[11]  David Abramson,et al.  An Atmospheric Sciences Workflow and Its Implementation with Web Services , 2004, International Conference on Computational Science.

[12]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[13]  K. J. Tory,et al.  The use of long-range transport simulations to verify the Australian Air Quality Forecasting System , 2003 .

[14]  Ali Afzal,et al.  Workflow Enactment in ICENI , 2004 .

[15]  Mike Jackson,et al.  Introduction to OGSA-DAI Services , 2004, SAG.

[16]  William E. Allcock,et al.  The Globus Striped GridFTP Framework and Server , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[17]  David Abramson,et al.  The GriddLeS data replication service , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[18]  David Abramson,et al.  Flexible IO services in the Kepler grid workflow system , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).