Efficient support for multi-resolution queries in global sensor networks

Stream processing has evolved as a paradigm for efficiently sharing and integrating a massive amount of data into applications. However, the integration of globally dispersed sensor data imposes challenges in the effective utilization of the IT infrastructure that forms the global sensor network. Especially simulations require the integration of sensor streams at widely differing spatial and temporal resolutions. For current stream processing solutions it is necessary to generate a separate data stream for each requested resolution. Therefore, these systems suffer from high redundancy in data streams, wasting a significant amount of bandwidth and limiting their scalability. This paper presents a new approach to scalable distributed stream processing of data which stems from globally dispersed sensor networks. The approach supports applications in establishing continuous queries for sensor data at different resolutions and ensures efficient bandwidth usage of the data distribution network. Unlike existing work in the context of video stream processing which provides multiple resolutions by establishing separate channels for each resolution, this paper presents a stream processing system that can efficiently split/combine data streams in order to decrease/increase their resolution without loss in data precision. In addition the system provides mechanisms for load balancing of sensor data streams that allow efficient utilization of the bandwidth of the global sensor network.

[1]  Margo I. Seltzer,et al.  Network-Aware Operator Placement for Stream-Processing Systems , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[2]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[3]  Kurt Rothermel,et al.  Providing Probabilistic Latency Bounds for Dynamic Publish/Subscribe Systems , 2009, KiVS.

[4]  Srinivasan Seshan,et al.  IrisNet: An Architecture for a Worldwide Sensor Web , 2003, IEEE Pervasive Comput..

[5]  Miguel Castro,et al.  Scribe: a large-scale and decentralized application-level multicast infrastructure , 2002, IEEE J. Sel. Areas Commun..

[6]  Karl Aberer,et al.  The Global Sensor Networks middleware for efficient and flexible deployment and interconnection of sensor networks , 2006 .

[7]  Joel H. Saltz,et al.  Distributed processing of very large datasets with DataCutter , 2001, Parallel Comput..

[8]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, TOCS.

[9]  Ying Xing,et al.  The Design of the Borealis Stream Processing Engine , 2005, CIDR.

[10]  Jason Lee,et al.  High-Performance Remote Access to Climate Simulation Data: A Challenge Problem for Data Grid Technologies , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[11]  Frank Dürr,et al.  Solving the Multi-Operator Placement Problem in Large-Scale Operator Networks , 2010, 2010 Proceedings of 19th International Conference on Computer Communications and Networks.

[12]  Masao Sakauchi,et al.  A new tree type data structure with homogeneous nodes suitable for a very large spatial database , 1990, [1990] Proceedings. Sixth International Conference on Data Engineering.

[13]  Anne-Marie Kermarrec,et al.  The many faces of publish/subscribe , 2003, CSUR.

[14]  Kurt Rothermel,et al.  Dynamic Publish/Subscribe to Meet Subscriber-Defined Delay and Bandwidth Constraints , 2010, Euro-Par.

[15]  Oliver Günther,et al.  Multidimensional access methods , 1998, CSUR.

[16]  Frederick Reiss,et al.  Design Considerations for High Fan-In Systems: The HiFi Approach , 2005, CIDR.

[17]  Kurt Rothermel,et al.  Multilevel Predictions for the Aggregation of Data in Global Sensor Networks , 2010, 2010 IEEE/ACM 14th International Symposium on Distributed Simulation and Real Time Applications.

[18]  Hans-Peter Kriegel,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990, SIGMOD '90.

[19]  Matt Welsh,et al.  Hourglass: An Infrastructure for Connecting Sensor Networks and Applications , 2004 .

[20]  Z. B. Bouallègue,et al.  Uncertainties in COSMO-DE precipitation forecasts introduced by model perturbations and variation of lateral boundaries , 2011 .

[21]  Boris Koldehofe,et al.  SPINE: Adaptive Publish/Subscribe for Wireless Mesh Networks , 2009, Stud. Inform. Univ..

[22]  Jennifer Widom,et al.  Adaptive filters for continuous queries over distributed data streams , 2003, SIGMOD '03.

[23]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM 2001.