Continuous query evaluation over distributed sensor networks

In this paper1 we address the problem of processing continuous multi-join queries, over distributed data streams. Our approach makes use of existing work in the field of publish/subscribe systems. We show how these principles can be ported to our envisioned architectural model by enriching the common query model with location dependent attributes. We allow users to subscribe to a set of sensor attributes, a service that requires processing multi-join correlation queries. The goal is to decrease the overall network traffic consumption by removing redundant subscriptions and eliminating unrequested events close to the publishing sensors. This is non-trivial, especially in the presence of multi-join queries without any central control mechanism. Our approach is based on the concept of filter-split-forward phases for efficient subscription filtering and placement inside the network. We report on a performance evaluation using a real-world dataset, showing the improvements over the state-of-the-art, as we reduce the overall data traffic by half.

[1]  Paolo Scotton,et al.  Techniques for integrating sensors into the enterprise network , 2006, IEEE Transactions on Network and Service Management.

[2]  François Ingelrest,et al.  SensorScope: Out-of-the-Box Environmental Monitoring , 2008, 2008 International Conference on Information Processing in Sensor Networks (ipsn 2008).

[3]  Jennifer Widom,et al.  Operator placement for in-network stream query processing , 2005, PODS.

[4]  Matt Welsh,et al.  Hourglass: An Infrastructure for Connecting Sensor Networks and Applications , 2004 .

[5]  Ying Xing,et al.  Dynamic load distribution in the Borealis stream processor , 2005, 21st International Conference on Data Engineering (ICDE'05).

[6]  Daniel J. Abadi,et al.  REED: Robust, Efficient Filtering and Event Detection in Sensor Networks , 2005, VLDB.

[7]  Karl Aberer,et al.  A middleware for fast and flexible sensor network deployment , 2006, VLDB.

[8]  Carlos André Guimarães Ferraz,et al.  Mires: a publish/subscribe middleware for sensor networks , 2005, Personal and Ubiquitous Computing.

[9]  Karl Aberer,et al.  Efficient Probabilistic Subsumption Checking for Content-Based Publish/Subscribe Systems , 2006, Middleware.

[10]  Frederick Reiss,et al.  TelegraphCQ: Continuous Dataflow Processing for an Uncertain World , 2003, CIDR.

[11]  Divesh Srivastava,et al.  Subsumption and indexing in constraint query languages with linear arithmetic constraints , 1993, Annals of Mathematics and Artificial Intelligence.

[12]  Johannes Gehrke,et al.  Query Processing in Sensor Networks , 2003, CIDR.

[13]  Alexander L. Wolf,et al.  A Content-Based Networking Protocol For Sensor Networks , 2004 .

[14]  Margo I. Seltzer,et al.  Network-Aware Operator Placement for Stream-Processing Systems , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[15]  Ying Xing,et al.  Scalable Distributed Stream Processing , 2003, CIDR.

[16]  Frederick Reiss,et al.  TelegraphCQ: continuous dataflow processing , 2003, SIGMOD '03.

[17]  Adam Wolisz,et al.  A Service-Based Universal Application Interface for Ad Hoc Wireless Sensor and Actuator Networks , 2005, Ambient Intelligence.

[18]  Yanif Ahmad,et al.  Networked Query Processing for Distributed Stream-Based Applications , 2004, VLDB.

[19]  Frederick Reiss,et al.  Design Considerations for High Fan-In Systems: The HiFi Approach , 2005, CIDR.

[20]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[21]  Ying Xing,et al.  Providing resiliency to load variations in distributed stream processing , 2006, VLDB.

[22]  Badrish Chandramouli,et al.  End-to-end support for joins in large-scale publish/subscribe systems , 2008, Proc. VLDB Endow..

[23]  Deborah Estrin,et al.  Directed diffusion: a scalable and robust communication paradigm for sensor networks , 2000, MobiCom '00.

[24]  Paolo Costa,et al.  Publish-subscribe on sensor networks: a semi-probabilistic approach , 2005, IEEE International Conference on Mobile Adhoc and Sensor Systems Conference, 2005..

[25]  Feng Yu,et al.  Leveraging Distributed Publish/Subscribe Systems for Scalable Stream Query Processing , 2006, BIRTE.

[26]  Srinivasan Seshan,et al.  IrisNet: An Architecture for a Worldwide Sensor Web , 2003, IEEE Pervasive Comput..