Multi-domain grid/cloud computing through a hierarchical component-based middleware

Current solutions for hybrid Grid/Cloud computing have been developed to hide from heterogeneity, dynamism and distributed nature of resources. These solutions are however insufficient to support distributed applications with non trivial communication patterns among processes, or that are structured so as to reflect the organization of resources they are deployed onto. In this paper, we present a generic, adaptable and extensible component-based middleware that seamlessly enables a transition of non-trivial applications from traditional Grids to hybrid Grid-Cloud platforms. This middleware goes beyond the resolution of well known technical challenges for multi-domain computing, as it offers mechanisms to exploit the hierarchical, heterogeneous and dynamic nature of platforms. We validate its capabilities and versatility through two use cases: an Internet-wide federation of Distributed Service Buses and a runtime supporting domain-decomposition HPC in heterogeneous computing environments using MPI-like programming. Performance results show the efficiency and usefulness of our middleware, and so contribute to promote research efforts geared towards flexible, on-demand IT solutions.

[1]  Ian T. Foster,et al.  MPICH-G2: A Grid-enabled implementation of the Message Passing Interface , 2002, J. Parallel Distributed Comput..

[2]  Jason Maassen,et al.  Smartsockets: solving the connectivity problems in grid computing , 2007, HPDC '07.

[3]  S. Piperno,et al.  TIME-DOMAIN PARALLEL SIMULATION OF HETEROGENEOUS WAVE PROPAGATION ON UNSTRUCTURED GRIDS USING EXPLICIT, NONDIFFUSIVE, DISCONTINUOUS GALERKIN METHODS , 2006 .

[4]  Hideo Saito,et al.  High performance wide-area overlay using deadlock-free routing , 2009, HPDC '09.

[5]  Denis Caromel,et al.  Interactive and descriptor-based deployment of object-oriented grid applications , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[6]  Rajkumar Buyya,et al.  Market-Oriented Cloud Computing: Vision, Hype, and Reality of Delivering Computing as the 5th Utility , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[7]  Stéphane Lanteri,et al.  Grid-Enabling SPMD Applications through Hierarchical Partitioning and a Component-Based Runtime , 2009, Euro-Par.

[8]  Daniel S. Katz,et al.  Critical perspectives on large-scale distributed applications and production Grids , 2009, 2009 10th IEEE/ACM International Conference on Grid Computing.

[9]  Elena Paslaru Bontas Simperl,et al.  ESB federation for large-scale SOA , 2010, SAC '10.

[10]  Anders Hast,et al.  Proceedings of the combined workshops on UnConventional high performance computing workshop plus memory access workshop , 2009 .

[11]  Denis Caromel,et al.  GCM: a grid extension to Fractal for autonomous distributed components , 2009, Ann. des Télécommunications.

[12]  Françoise Baude,et al.  A GCM-based runtime support for parallel grid applications , 2008, CBHPC '08.

[13]  Paolo Bientinesi,et al.  Can cloud computing reach the top500? , 2009, UCHPC-MAW '09.

[14]  Shantenu Jha,et al.  An Autonomic Approach to Integrated HPC Grid and Cloud Usage , 2009, 2009 Fifth IEEE International Conference on e-Science.

[15]  Motohiko Matsuda,et al.  Evaluation of MPI implementations on grid-connected clusters using an emulated WAN environment , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..