Communication Reduction for Continuous Extreme Values Monitoring Over Distributed Data Streams

We focus on aspects of physical distribution of streams, and address the problem of communication reduction for continuous extreme values monitoring over distributed data streams. We firstly develop an effective pruning technique to minimize the number of elements to be kept for extreme values queries. Then we consider the distributed environment, where remote nodes delay the data transmission as late as possible, and adopt the pruning strategy to filter local stream tuples, which is quite efficient in communication reduction. The method is extended to adaptively run in a degraded manner for resource limitation. Analytical analysis and experimental evidences show the efficiency of proposed approach on communication reduction.

[1]  David E. Culler,et al.  Supporting aggregate queries over ad-hoc wireless sensor networks , 2002, Proceedings Fourth IEEE Workshop on Mobile Computing Systems and Applications.

[2]  Edward Y. Chang,et al.  Adaptive stream resource management using Kalman Filters , 2004, SIGMOD '04.

[3]  Li Tian,et al.  Research on Prediction Models over Distributed Data Streams , 2006, WISE Workshops.

[4]  Zhenyu Liu,et al.  Cost-efficient processing of MIN/MAX queries over distributed sensors with uncertainty , 2005, SAC '05.

[5]  Kamesh Munagala,et al.  Energy-efficient monitoring of extreme values in sensor networks , 2006, SIGMOD Conference.

[6]  Jennifer Widom,et al.  Adaptive precision setting for cached approximate values , 2001, SIGMOD '01.

[7]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[8]  Qian Weining,et al.  Analysis and Management of Streaming Data: A Survey , 2004 .

[9]  Graham Cormode,et al.  Sketching Streams Through the Net: Distributed Approximate Query Tracking , 2005, VLDB.

[10]  Jennifer Widom,et al.  Models and issues in data stream systems , 2002, PODS.

[11]  H. T. Kung,et al.  On the Average Number of Maxima in a Set of Vectors and Applications , 1978, JACM.

[12]  Wei Hong,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tag: a Tiny Aggregation Service for Ad-hoc Sensor Networks , 2022 .

[13]  Jennifer Widom,et al.  Adaptive filters for continuous queries over distributed data streams , 2003, SIGMOD '03.