GRIDKIT: Pluggable Overlay Networks for Grid Computing

A ‘second generation’ approach to the provision of Grid middleware is now emerging which is built on service-oriented architecture and web services standards and technologies. However, advanced Grid applications have significant demands that are not addressed by present-day web services platforms. As one prime example, current platforms do not support the rich diversity of communication ‘interaction types’ that are demanded by advanced applications (e.g. publish-subscribe, media streaming, peer-to-peer interaction). In the paper we describe the Gridkit middleware which augments the basic service-oriented architecture to address this particular deficiency. We particularly focus on the communications infrastructure support required to support multiple interaction types in a unified, principled and extensible manner—which we present in terms of the novel concept of pluggable overlay networks.

[1]  Amin Vahdat,et al.  MACEDON: Methodology for Automatically Creating, Evaluating, and Designing Overlay Networks , 2004, NSDI.

[2]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[3]  ZHANGLi-xia,et al.  A reliable multicast framework for light-weight sessions and application level framing , 1995 .

[4]  Robert Tappan Morris,et al.  Resilient overlay networks , 2001, SOSP.

[5]  Peter Druschel,et al.  Pastry: Scalable, distributed object location and routing for large-scale peer-to- , 2001 .

[6]  Baochun Li,et al.  iOverlay: A Lightweight Middleware Infrastructure for Overlay Application Implementations , 2004, Middleware.

[7]  Gordon S. Blair,et al.  An extensible binding framework for component-based middleware , 2003, Seventh IEEE International Enterprise Distributed Object Computing Conference, 2003. Proceedings..

[8]  Seyed Masoud Sadjadi,et al.  Architecture and operation of an adaptable communication substrate , 2003, The Ninth IEEE Workshop on Future Trends of Distributed Computing Systems, 2003. FTDCS 2003. Proceedings..

[9]  David Hutchison,et al.  An Overlay Tree Building Control Protocol , 2001, Networked Group Communication.

[10]  Warren Smith,et al.  A Resource Management Architecture for Metacomputing Systems , 1998, JSSPP.

[11]  Ben Y. Zhao,et al.  Towards a Common API for Structured Peer-to-Peer Overlays , 2003, IPTPS.

[12]  Wei Cai,et al.  A Reflective Middleware Approach to the Provision of Grid Middleware , 2003, Middleware Workshops.

[13]  David R. Karger,et al.  Looking up data in P2P systems , 2003, CACM.

[14]  Ian Warren,et al.  AGnuS: the altruistic Gnutella server , 2003, Proceedings Third International Conference on Peer-to-Peer Computing (P2P2003).

[15]  Fabio Kon,et al.  Reflective Middleware: From Your Desk to Your Hand , 2001, IEEE Distributed Syst. Online.

[16]  Fabio Kon,et al.  Monitoring, Security, and Dynamic Configuration with the dynamicTAO Reflective ORB , 2000, Middleware.

[17]  Wei Cai,et al.  Towards a component-based middleware framework for configurable and reconfigurable grid computing , 2004, 13th IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[18]  Ben Y. Zhao,et al.  Tapestry: a resilient global-scale overlay for service deployment , 2004, IEEE Journal on Selected Areas in Communications.

[19]  David Hutchison,et al.  Peer-to-Peer Networking for Discovering Programmable Resources , 2002, Networked Group Communication.

[20]  Miguel Castro,et al.  Scribe: a large-scale and decentralized application-level multicast infrastructure , 2002, IEEE J. Sel. Areas Commun..

[21]  Geoffrey C. Fox,et al.  NaradaBrokering: A Distributed Middleware Framework and Architecture for Enabling Durable Peer-to-Peer Grids , 2003, Middleware.

[22]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[23]  Gordon S. Blair,et al.  ReMMoC: A Reflective Middleware to Support Mobile Client Interoperability , 2003, OTM.

[24]  Gordon S. Blair,et al.  Reflection, self-awareness and self-healing in OpenORB , 2002, WOSS '02.

[25]  Gordon S. Blair,et al.  The design of a configurable and reconfigurable middleware platform , 2002, Distributed Computing.

[26]  Vincent Roca,et al.  A survey of proposals for an alternative group communication service , 2003, IEEE Netw..

[27]  Miguel Castro,et al.  Should we build Gnutella on a structured overlay? , 2004, Comput. Commun. Rev..

[28]  Gordon S. Blair,et al.  An Efficient Component Model for the Construction of Adaptive Middleware , 2001, Middleware.

[29]  E. Carrapatoso,et al.  A reflective component-based and architecture aware framework to manage architecture composition , 2001, Proceedings 3rd International Symposium on Distributed Objects and Applications.

[30]  Miguel Castro,et al.  SplitStream: High-Bandwidth Content Distribution in Cooperative Environments , 2003, IPTPS.

[31]  A. Stephen McGough,et al.  ICENI: Optimisation of component applications within a Grid environment , 2002, Parallel Comput..

[32]  Vinny Cahill,et al.  STEAM: event-based middleware for wireless ad hoc networks , 2002, Proceedings 22nd International Conference on Distributed Computing Systems Workshops.

[33]  Gordon S. Blair,et al.  Arctic beans, configurable and re-configurable enterprise component architectures , 2001 .

[34]  Gordon S. Blair,et al.  A Resource Adaptation Framework For Reflective Middleware , 2003, Middleware Workshops.

[35]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[36]  Deborah Estrin,et al.  Directed diffusion: a scalable and robust communication paradigm for sensor networks , 2000, MobiCom '00.

[37]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[38]  Andrew S. Grimshaw,et al.  Legion: An Operating System for Wide-Area Computing , 1999 .