Efficient event-based resource discovery

The ability to find services or resources that satisfy some criteria is an important aspect of distributed systems. This paper presents an event-based architecture to support more dynamic discovery scenarios, including efficient discovery of resources whose attributes can change, and continuous monitoring for resources that satisfy a set of constraints. Furthermore, algorithms are developed to optimize the discovery cost by reusing results among similar concurrent discovery requests. Detailed evaluations under various workload distributions demonstrate the feasibility of the architecture and show significant benefits of the optimizations in terms of network traffic and discovery processing time.

[1]  Rajesh Raman,et al.  Matchmaking: distributed resource management for high throughput computing , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[2]  Srinivasan Seshan,et al.  Mercury: supporting scalable multi-attribute range queries , 2004, SIGCOMM '04.

[3]  Divyakant Agrawal,et al.  Meghdoot: Content-Based Publish/Subscribe over P2P Networks , 2004, Middleware.

[4]  Ian Foster,et al.  A Peer-to-Peer Approach to Resource Discovery in Grid Environments , 2007 .

[5]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[6]  Pascal Felber,et al.  XNET: a reliable content-based publish/subscribe system , 2004, Proceedings of the 23rd IEEE International Symposium on Reliable Distributed Systems, 2004..

[7]  Marcos K. Aguilera,et al.  Matching events in a content-based subscription system , 1999, PODC '99.

[8]  Hans-Arno Jacobsen,et al.  Historic data access in publish/subscribe , 2007, DEBS '07.

[9]  Hans-Arno Jacobsen,et al.  The PADRES Distributed Publish/Subscribe System , 2005, FIW.

[10]  Dennis Shasha,et al.  Filtering algorithms and implementation for very fast publish/subscribe systems , 2001, SIGMOD '01.

[11]  Mukesh Agrawal,et al.  Mercury : Supporting Scalable Multi-Attribute Range , 2004 .

[12]  Raouf Boutaba,et al.  Resource and service discovery in large-scale multi-domain networks , 2007, IEEE Communications Surveys & Tutorials.

[13]  Hans-Arno Jacobsen,et al.  Composite Subscriptions in Content-Based Publish/Subscribe Systems , 2005, Middleware.

[14]  Ian T. Foster,et al.  Grid information services for distributed resource sharing , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[15]  Ben Y. Zhao,et al.  Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and , 2001 .

[16]  Ben Y. Zhao,et al.  An Infrastructure for Fault-tolerant Wide-area Location and Routing , 2001 .

[17]  Hans-Arno Jacobsen,et al.  Small Scale Peer-to-Peer Publish/Subscribe , 2005, P2PKM.

[18]  Indranil Gupta,et al.  Peer-to-peer discovery of computational resources for Grid applications , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[19]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[20]  Amy L. Murphy,et al.  Efficient content-based event dispatching in the presence of topological reconfiguration , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[21]  Peter Triantafillou,et al.  PastryStrings: A Comprehensive Content-Based Publish/Subscribe DHT Network , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[22]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[23]  Twittie Senivongse,et al.  A query federation of UDDI registries , 2003, ISICT.

[24]  Hans-Arno Jacobsen,et al.  Routing of XML and XPath Queries in Data Dissemination Networks , 2008, 2008 The 28th International Conference on Distributed Computing Systems.

[25]  Hans-Arno Jacobsen,et al.  Distributed automatic service composition in large-scale systems , 2008, DEBS.

[26]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[27]  Ian Foster,et al.  A peer-to-peer approach to resource location in grid environments , 2002 .

[28]  David Thomas Lynch.  A Proactive Approach to Semantically Oriented Service Discovery , 2005 .