Scientific workflow orchestration interoperating HTC and HPC resources

Abstract In this work we describe our developments towards the provision of a unified access method to different types of computing infrastructures at the interoperation level. For that, we have developed a middleware suite which bridges not interoperable middleware stacks used for building distributed computing infrastructures, UNICORE and gLite. Our solution allows to transparently access and operate on HPC and HTC resources from a single interface. Using Kepler as workflow manager, we provide users with the needed integration of codes to create scientific workflows accessing both types of infrastructures.

[1]  Michal Owsiak,et al.  Graphical Framework for Grid Interactive and Parallel Applications , 2008, Comput. Informatics.

[2]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[3]  R. Petronzio,et al.  QCD with light Wilson quarks on fine lattices (I): first experiences and physics results , 2006, hep-lat/0610059.

[4]  Jordi Marco.  The Interactive European Grid: Project Objectives and Achievements , 2008, Comput. Informatics.

[5]  Massimo Lamanna,et al.  Lattice QCD thermodynamics on the Grid , 2009, Comput. Phys. Commun..

[6]  Dieter Kranzlmüller,et al.  glogin - a multifunctional, interactive tunnel into the grid , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[7]  Jarek Nabrzyski,et al.  The Vine Toolkit: A Java Framework for Developing Grid Applications , 2007, PPAM.

[8]  R. Petronzio,et al.  QCD with light Wilson quarks on fine lattices (II): DD-HMC simulations and data analysis , 2007, hep-lat/0701009.

[9]  S. Stork,et al.  MPI Support on the Grid , 2008, Comput. Informatics.

[10]  André Ribes,et al.  Salome platform component model for numerical simulation , 2007, 31st Annual International Computer Software and Applications Conference (COMPSAC 2007).

[11]  Ian T. Foster.  Globus Toolkit Version 4: Software for Service-Oriented Systems , 2005, NPC.

[12]  Bertram Ludäscher,et al.  Scientific workflow design for mere mortals , 2009, Future Gener. Comput. Syst..

[13]  J. Lindemann,et al.  Advanced Resource Connector middleware for lightweight computational Grids , 2007, Future Gener. Comput. Syst..

[14]  Elisa Heymann,et al.  CrossBroker: A Grid Metascheduler for Interactive and Parallel Jobs , 2008, Comput. Informatics.

[15]  Mathilde Romberg.  The UNICORE architecture: seamless access to distributed resources , 1999, Proceedings. The Eighth International Symposium on High Performance Distributed Computing (Cat. No.99TH8469).

[16]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[17]  Maciej Stroinski,et al.  The Migrating Desktop as a GUI Framework for the "Applications on Demand" Concept , 2004, International Conference on Computational Science.

[18]  Ákos Frohner,et al.  From gridmap-file to VOMS: managing authorization in a Grid environment , 2005, Future Gener. Comput. Syst..

[19]  Jean-Philippe Baud,et al.  Performance analysis of a file catalog for the LHC computing grid , 2005, HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005..

[20]  Arie Shoshani,et al.  EFFIS: An End-to-end Framework for Fusion Integrated Simulation , 2010, 2010 18th Euromicro Conference on Parallel, Distributed and Network-based Processing.

[21]  A. D. Meglio,et al.  Programming the Grid with gLite , 2006 .