Service and Resource Discovery supports over P2P overlays

We describe the main architecture and the design principles of the Service/Resource Discovery System (SRDS), a component of the XtreemOS Operating System. XtreemOS is a Linux extension that enables management and exploitation as single platform of computational resources provided by federated Virtual Organizations. The SRDS provides scalable and fault-tolerant directory services supporting many of the platform functionalities, ranging from dynamic resource location and job control to system and application-oriented directory services. The key challenge of the SRDS design is to provide the common metaphor of the directory service, meeting the scalability requirements of a Grid-aware Operating system, and at the same time enjoy extendability and configurability, especially with respect to the quality of service provided. The SRDS design combines different peer to peer structured overlay networks, exploiting their peculiar strengths. We describe the implementation and our design of the namespace abstraction as implemented on top of multiple overlay networks. Finally, we show test results of the SRDS on top of a subset of the Grid5000 platform.

[1]  Benjamin Aziz,et al.  A formal security requirements model for a grid-based operating system , 2007 .

[2]  Antonio F. Gómez-Skarmeta,et al.  Cyclone: a novel design schema for hierarchical DHTs , 2005, Fifth IEEE International Conference on Peer-to-Peer Computing (P2P'05).

[3]  Rajkumar Buyya,et al.  Peer-to-peer-based resource discovery in global grids: a tutorial , 2008, IEEE Communications Surveys & Tutorials.

[4]  Thomas Fuhrmann,et al.  Providing KBR service for multiple applications , 2008, IPTPS.

[5]  Emin Gün Sirer,et al.  The design and implementation of a next generation name service for the internet , 2004, SIGCOMM.

[6]  A. Rowstron,et al.  Scalable, decentralized object location and routing for large-scale peer-to-peer systems , 2001 .

[7]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[8]  Brighten Godfrey,et al.  OpenDHT: a public DHT service and its uses , 2005, SIGCOMM '05.

[9]  Pedro A. Szekely,et al.  MAAN: A Multi-Attribute Addressable Network for Grid Information Services , 2003, Proceedings. First Latin American Web Congress.

[10]  Kazuyuki Shudo,et al.  Overlay Weaver: An overlay construction toolkit , 2008, Computer Communications.

[11]  Thorsten Schütt,et al.  Highly available and scalable grid services , 2009, WDDM '09.

[12]  Laura Ricci,et al.  Reducing traffic in DHT-based discovery protocols for dynamic resources , 2009, CoreGRID@Euro-Par.

[13]  Robert Tappan Morris,et al.  Vivaldi: a decentralized network coordinate system , 2004, SIGCOMM '04.

[14]  Carsten Franke,et al.  XtreemOS: A Vision for a Grid Operating System , 2008 .

[15]  Guillaume Pierre,et al.  Autonomous Resource Selection for Decentralized Utility Computing , 2009, 2009 29th IEEE International Conference on Distributed Computing Systems.

[16]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[17]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[18]  Domenico Talia,et al.  PARIS: A peer-to-peer architecture for large-scale semantic data sharing , 2008, Comput. Syst. Sci. Eng..

[19]  Hai Jin,et al.  Scalable dht-based information service for large-scale grids , 2008, CF '08.

[20]  Emin Gün Sirer,et al.  The design and implementation of a next generation name service for the internet , 2004, SIGCOMM '04.

[21]  M. Frans Kaashoek,et al.  Vivaldi: a decentralized network coordinate system , 2004, SIGCOMM 2004.

[22]  David R. Karger,et al.  Diminished Chord: A Protocol for Heterogeneous Subgroup Formation in Peer-to-Peer Networks , 2004, IPTPS.

[23]  Krishna P. Gummadi,et al.  Canon in G major: designing DHTs with hierarchical structure , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[24]  Florian Schintke,et al.  Scalaris: reliable transactional p2p key/value store , 2008, ERLANG '08.

[25]  David R. Karger,et al.  Chord: a scalable peer-to-peer lookup protocol for internet applications , 2003, TNET.