Publish/Subscribe with RDF Data over Large Structured Overlay Networks

We study the problem of evaluating RDF queries over structured overlay networks.We consider the publish/subscribe scenario where nodes subscribewith long-standing queries and receive notifications whenever triples matching their queries are inserted in the network. In this paper we focus on conjunctive multi-predicate queries. We demonstrate that these queries are useful in various modern applications e.g., distributed digital libraries or Grid resource discovery. Conjunctive multipredicate queries are hard to answer since multiple triples are necessary for their evaluation, and these triples will usually be inserted in the network asynchronously. We present and evaluate query processing algorithms that are scalable and distribute the query processing load evenly.

[1]  Wolfgang Nejdl,et al.  Super-peer-based routing strategies for RDF-based peer-to-peer networks , 2004, J. Web Semant..

[2]  Rajeev Motwani,et al.  The price of validity in dynamic networks , 2004, SIGMOD '04.

[3]  Robert M. MacGregor,et al.  A subscribable peer-to-peer RDF repository for distributed metadata management , 2004, J. Web Semant..

[4]  Tore Risch,et al.  EDUTELLA: a P2P networking infrastructure based on RDF , 2002, WWW.

[5]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[6]  David R. Karger,et al.  Looking up data in P2P systems , 2003, CACM.

[7]  Wolfgang Nejdl,et al.  Designing Semantic Publish/Subscribe Networks Using Super-Peers , 2006, Semantic Web and Peer-to-Peer.

[8]  Andy Seaborne,et al.  Three Implementations of SquishQL, a Simple RDF Query Language , 2002, SEMWEB.

[9]  Vassilis Christophides,et al.  Semantic Query Routing and Processing in P2P Database Systems: The ICS-FORTH SQPeer Middleware , 2004, EDBT Workshops.

[10]  Wolfgang Nejdl,et al.  Publish/Subscribe for RDF-based P2P Networks , 2004, ESWS.

[11]  Manolis Koubarakis,et al.  Distributed Evaluation of Continuous Equi-join Queries over Large Structured Overlay Networks , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[12]  Karl Aberer,et al.  GridVine: Building Internet-Scale Semantic Overlay Networks , 2004, SEMWEB.

[13]  Manolis Koubarakis,et al.  LibraRing: An Architecture for Distributed Digital Libraries Based on DHTs , 2005, ECDL.