QUALITY OF SERVICE AWARE OPTIMIZATION OF SENSOR NETWORK QUERIES

Sensor networks comprise resource-constrained wireless nodes with the capabil- ity of gathering information about their surroundings and have recently risen to prominence with the promise of being an effective computing platform for di- verse applications, ranging from event detection to environmental monitoring. The database community proposed the use of sensor network query processors (SNQPs) as means to meet data collection requirements using a declarative query language. Declarative queries posed against a sensor network constitute an effec- tive means to repurpose sensor networks and reduce the high software develop- ment costs associated with them.The range of sensor network applications is very broad. Such applications have diverse, and often conflicting, QoS expectations in terms of the delivery time of results, the acquisition interval at which data is collected, the total energy consumption of the deployment, or the network lifetime. The conflicting nature of these desiderata is aggravated by the resource-constrained nature of sensor networks as a computing fabric, making it particularly challenging to reconcile the trade-offs that arise. Previously, SNQPs have been focussed on evaluating queries as energy-efficiently as possible. There has been comparatively less work on attempting to meet a broad range of optimization goals and constraints that captured these QoS expectations. In this respect, previous work in SNQP has not aimed at being general purpose across the breadth of applications to which sensor networks have been applied.This PhD dissertation presents an approach for enabling QoS-awareness in SNQPs so that query evaluation plans are generated that exhibit good perfor- mance for a broader range of sensor network applications in terms of their QoS expectations. The research contributions reported here include (a) a functional decomposition of the decision-making steps required to compile a declarative query into a query evaluation plan in a sensor network setting; (b) algorithms to implement these decision-making steps; and (c) an empirical evaluation to show the benefits of QoS-awareness compared to a representative fixed-goal SNQP.

[1]  Rajmohan Rajaraman,et al.  The Cougar Project: a work-in-progress report , 2003, SGMD.

[2]  Ian W. Marshall,et al.  Multi-sensor Cross Correlation for Alarm Generation in a Deployed Sensor Network , 2007, EuroSSC.

[3]  Sang Hyuk Son,et al.  Maintaining data freshness in distributed real-time databases , 2004, Proceedings. 16th Euromicro Conference on Real-Time Systems, 2004. ECRTS 2004..

[4]  John Beidler,et al.  Data Structures and Algorithms , 1996, Wiley Encyclopedia of Computer Science and Engineering.

[5]  Rajmohan Rajaraman,et al.  Multi-query Optimization for Sensor Networks , 2005, DCOSS.

[6]  Jeffrey Considine,et al.  Approximate aggregation techniques for sensor databases , 2004, Proceedings. 20th International Conference on Data Engineering.

[7]  Andreas Krause,et al.  Intelligent light control using sensor networks , 2005, SenSys '05.

[8]  Frederick Reiss,et al.  TelegraphCQ: Continuous Dataflow Processing for an Uncertain World , 2003, CIDR.

[9]  Evaggelia Pitoura.  Query Optimization , 2009, Encyclopedia of Database Systems.

[10]  Goetz Graefe,et al.  Query evaluation techniques for large databases , 1993, CSUR.

[11]  Cornelia Kappler,et al.  A Real-World, Simple Wireless Sensor Network for Monitoring Electrical Energy Consumption , 2004, EWSN.

[12]  Johannes Gehrke,et al.  Query Processing in Sensor Networks , 2003, CIDR.

[13]  Christian Y. A. Brenninkmeijer,et al.  Validated cost models for sensor network queries , 2009, DMSN '09.

[14]  Vladimir Zadorozhny,et al.  Sensor Queries: Algebraic Optimization for Time and Energy , 2008, Int. J. Distributed Sens. Networks.

[15]  Wei Hong,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tag: a Tiny Aggregation Service for Ad-hoc Sensor Networks , 2022 .

[16]  Charles Audet,et al.  Mesh Adaptive Direct Search Algorithms for Constrained Optimization , 2006, SIAM J. Optim..

[17]  Yannis E. Ioannidis,et al.  Randomized algorithms for optimizing large join queries , 1990, SIGMOD '90.

[18]  Kirk Martinez,et al.  Glacsweb: a sensor network for hostile environments , 2004, 2004 First Annual IEEE Communications Society Conference on Sensor and Ad Hoc Communications and Networks, 2004. IEEE SECON 2004..

[19]  Theodore S. Rappaport,et al.  Wireless communications - principles and practice , 1996 .

[20]  Nick Roussopoulos,et al.  Processing approximate aggregate queries in wireless sensor networks , 2006, Inf. Syst..

[21]  B. Betts,et al.  Smart Sensors , 2006, IEEE Spectrum.

[22]  Ying Xing,et al.  Scalable Distributed Stream Processing , 2003, CIDR.

[23]  Wei Hong,et al.  Exploiting correlated attributes in acquisitional query processing , 2005, 21st International Conference on Data Engineering (ICDE'05).

[24]  Goetz Graefe,et al.  Optimization of dynamic query evaluation plans , 1994, SIGMOD '94.

[25]  John Anderson,et al.  Wireless sensor networks for habitat monitoring , 2002, WSNA '02.

[26]  Margaret Martonosi,et al.  Hardware design experiences in ZebraNet , 2004, SenSys '04.

[27]  Ashish Goel,et al.  Efficient computation of delay-sensitive routes from one source to all destinations , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[28]  Ying Xing,et al.  Load Management and High Availability in the Borealis Distributed Stream Processing Engine , 2006, GSN.

[29]  Mark D. Yarvis,et al.  Design and deployment of industrial sensor networks: experiences from a semiconductor plant and the north sea , 2005, SenSys '05.

[30]  Andreas Willig,et al.  Protocols and Architectures for Wireless Sensor Networks , 2005 .

[31]  Hartmut Ritter,et al.  Fence Monitoring - Experimental Evaluation of a Use Case for Wireless Sensor Networks , 2007, EWSN.

[32]  Donald Kossmann,et al.  The state of the art in distributed query processing , 2000, CSUR.

[33]  Nick Roussopoulos,et al.  Bandwidth-constrained queries in sensor networks , 2008, The VLDB Journal.

[34]  Michael Stonebraker,et al.  The Aurora and Medusa Projects , 2003, IEEE Data Eng. Bull..

[35]  Wolf-Tilo Balke,et al.  Multi-objective Query Processing for Database Systems , 2004, VLDB.

[36]  Mike Horton,et al.  The platforms enabling wireless sensor networks , 2004, CACM.

[37]  Masayuki Numao,et al.  Deadline and QoS Aware Data Warehouse , 2007, VLDB.

[38]  Gustavo Alonso,et al.  A virtual machine for sensor networks , 2007, EuroSys '07.

[39]  Rajmohan Rajaraman,et al.  Wave scheduling and routing in sensor networks , 2007, TOSN.

[40]  Patricia G. Selinger,et al.  Access Path Selection in Distributed Database Management Systems , 1980, ICOD.

[41]  J. J. Sharples,et al.  A simple index for assessing fire danger rating , 2009, Environ. Model. Softw..

[42]  Agathoniki Trigoni,et al.  Interplay of Processing and Routing in Aggregate Query Optimization for Sensor Networks , 2008, ICDCN.

[43]  Christian Y. A. Brenninkmeijer,et al.  A Semantics for a Query Language over Sensors, Streams and Relations , 2008, BNCOD.

[44]  Hans Mulder,et al.  Smart sensors to network the world. , 2004, Scientific American.

[45]  Theodore Johnson,et al.  Gigascope: a stream database for network applications , 2003, SIGMOD '03.

[46]  Michael Stonebraker,et al.  Retrospective on Aurora , 2004, The VLDB Journal.

[47]  Joseph M. Hellerstein,et al.  Eddies: continuously adaptive query processing , 2000, SIGMOD '00.

[48]  Wei Hong,et al.  TinyDB: an acquisitional query processing system for sensor networks , 2005, TODS.

[49]  Kirk Martinez,et al.  Environmental Sensor Networks: A revolution in the earth system science? , 2006 .

[50]  Divesh Srivastava,et al.  On computing correlated aggregates over continual data streams , 2001, SIGMOD '01.

[51]  Seif Haridi,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[52]  Patrick Martin,et al.  Poster Session: Adapting Mixed Workloads to Meet SLOs in Autonomic DBMSs , 2007, 2007 IEEE 23rd International Conference on Data Engineering Workshop.

[53]  Jenna Burrell,et al.  Vineyard computing: sensor networks in agricultural production , 2004, IEEE Pervasive Computing.

[54]  Jim Smith,et al.  Distributed Query Processing on the Grid , 2003, Int. J. High Perform. Comput. Appl..

[55]  Philippe Bonnet,et al.  GADT: a probability space ADT for representing and querying the physical world , 2002, Proceedings 18th International Conference on Data Engineering.

[56]  Hojung Cha,et al.  Acoustic Sensor Network-Based Parking Lot Surveillance System , 2009, EWSN.

[57]  Wei Hong,et al.  Model-based approximate querying in sensor networks , 2005, The VLDB Journal.

[58]  Timos K. Sellis,et al.  Parametric query optimization , 1992, The VLDB Journal.

[59]  Philippe Bonnet,et al.  Querying the physical world , 2000, IEEE Wirel. Commun..

[60]  Norman W. Paton,et al.  Optimizing Utility in Cloud Computing through Autonomic Workload Execution , 2009 .

[61]  Erich M. Nahum,et al.  Achieving Class-Based QoS for Transactional Workloads , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[62]  Hamid Pirahesh,et al.  Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals , 1996, Data Mining and Knowledge Discovery.

[63]  Margaret Martonosi,et al.  Data compression algorithms for energy-constrained devices in delay tolerant networks , 2006, SenSys '06.

[64]  Kay Römer,et al.  The design space of wireless sensor networks , 2004, IEEE Wireless Communications.

[65]  Deborah Estrin,et al.  Geography-informed energy conservation for Ad Hoc routing , 2001, MobiCom '01.

[66]  Surajit Chaudhuri,et al.  An overview of query optimization in relational systems , 1998, PODS.

[67]  Angelo Brayner,et al.  Toward adaptive query processing in wireless sensor networks , 2007, Signal Process..

[68]  Michael C. Ferris,et al.  A Genetic Algorithm for Database Query Optimization , 1991, ICGA.

[69]  Peter I. Corke,et al.  Dynamic Virtual Fences for Controlling Cows , 2004, ISER.

[70]  Goetz Graefe,et al.  Encapsulation of parallelism in the Volcano query processing system , 1990, SIGMOD '90.

[71]  Norman W. Paton,et al.  Adaptive Query Processing: A Survey , 2002, BNCOD.

[72]  Hamid Pirahesh,et al.  Extensible query processing in starburst , 1989, SIGMOD '89.

[73]  Peter A. Dinda,et al.  Evaluating a BASIC approach to sensor network node programming , 2009, SenSys '09.

[74]  Jim Smith,et al.  Adaptive workload allocation in query processing in autonomous heterogeneous environments , 2009, Distributed and Parallel Databases.

[75]  Michael Stonebraker,et al.  Aurora: a data stream management system , 2003, SIGMOD '03.

[76]  Ying Xing,et al.  Providing resiliency to load variations in distributed stream processing , 2006, VLDB.

[77]  Michael Stonebraker,et al.  Monitoring Streams - A New Class of Data Management Applications , 2002, VLDB.

[78]  Stephen P. Boyd,et al.  A tutorial on geometric programming , 2007, Optimization and Engineering.

[79]  Gregor von Bochmann,et al.  Pushing quality of service information and requirements into global query optimization , 2003, Seventh International Database Engineering and Applications Symposium, 2003. Proceedings..

[80]  Vladimir Zadorozhny,et al.  A framework for extending the synergy between MAC layer and query optimization in sensor networks , 2004, DMSN '04.

[81]  David J. DeWitt,et al.  Progressive Parametric Query Optimization , 2009, IEEE Transactions on Knowledge and Data Engineering.

[82]  Kirk Martinez,et al.  Deploying a sensor network in an extreme environment , 2006, IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC'06).

[83]  Patrick Martin,et al.  Managing database server performance to meet QoS requirements in electronic commerce systems , 2002, International Journal on Digital Libraries.

[84]  Felix Naumann,et al.  Quality-driven Integration of Heterogenous Information Systems , 1999, VLDB.

[85]  K. Lin,et al.  Sdlib: a sensor network data and communications library for rapid and robust application development , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[86]  Norman W. Paton,et al.  The design and implementation of OGSA-DQP: A service-based distributed query processor , 2009, Future Gener. Comput. Syst..

[87]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[88]  Dimitrios Gunopulos,et al.  Online outlier detection in sensor data using non-parametric models , 2006, VLDB.

[89]  Lukasz Golab,et al.  Issues in data stream management , 2003, SGMD.

[90]  Ying Xing,et al.  The Design of the Borealis Stream Processing Engine , 2005, CIDR.

[91]  Rajeev Motwani,et al.  Coloring Away Communication in Parallel Query Optimization , 1995, VLDB.

[92]  Gyula Simon,et al.  Countersniper system for urban warfare , 2005, TOSN.

[93]  Samson Abramsky,et al.  Handbook of logic in computer science. , 1992 .

[94]  Karen Ward,et al.  Dynamic query evaluation plans , 1989, SIGMOD '89.

[95]  Wei Hong,et al.  Approximate Data Collection in Sensor Networks using Probabilistic Models , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[96]  Norman W. Paton,et al.  Adaptive join processing in pipelined plans , 2010, EDBT '10.

[97]  Srinivasan Seshan,et al.  Synopsis diffusion for robust aggregation in sensor networks , 2004, SenSys '04.

[98]  Christian Y. A. Brenninkmeijer,et al.  QUERYING SENSOR NETWORKS: REQUIREMENTS, SEMANTICS, ALGORITHMS AND COST MODELS , 2010 .

[99]  Rajarshi Das,et al.  Achieving Self-Management via Utility Functions , 2007, IEEE Internet Computing.

[100]  David Sun,et al.  COUGAR: the network is the database , 2002, SIGMOD '02.

[101]  Hejun Wu,et al.  Quality aware query scheduling in wireless sensor networks , 2009, DMSN '09.

[102]  Philippe Bonnet,et al.  Towards Sensor Database Systems , 2001, Mobile Data Management.

[103]  J. S. Saini,et al.  Adaptive Query Processing , 2006 .

[104]  Stanley B. Zdonik,et al.  Staying FIT: Efficient Load Shedding Techniques for Distributed Stream Processing , 2007, VLDB.

[105]  Rajmohan Rajaraman,et al.  Hybrid Push-Pull Query Processing for Sensor Networks , 2004, GI Jahrestagung.

[106]  Dimitrios Gunopulos,et al.  Region Sampling: Continuous Adaptive Sampling on Sensor Networks , 2008, 2008 IEEE 24th International Conference on Data Engineering.

[107]  Frederick Reiss,et al.  Satisfying database service level agreements while minimizing cost through storage QoS , 2005, 2005 IEEE International Conference on Services Computing (SCC'05) Vol-1.

[108]  Michael Stonebraker,et al.  Load Shedding in a Data Stream Manager , 2003, VLDB.

[109]  Philippe Bonnet,et al.  Adaptive and Decentralized Operator Placement for In-Network Query Processing , 2003, Telecommun. Syst..

[110]  Michael Stonebraker,et al.  Mariposa: a wide-area distributed database system , 1996, The VLDB Journal.

[111]  Jennifer Widom,et al.  Operator placement for in-network stream query processing , 2005, PODS.

[112]  Norman W. Paton,et al.  The Tripod spatio-historical data model , 2004, Data Knowl. Eng..

[113]  Arun N. Swami,et al.  Optimization of large join queries: combining heuristics and combinatorial techniques , 1989, SIGMOD '89.

[114]  Gregory J. Pottie,et al.  Wireless integrated network sensors , 2000, Commun. ACM.

[115]  Wei Hong,et al.  A macroscope in the redwoods , 2005, SenSys '05.

[116]  Jennifer Widom,et al.  STREAM: The Stanford Stream Data Manager , 2003, IEEE Data Eng. Bull..

[117]  Norman W. Paton,et al.  A Foundation for the Replacement of Pipelined Physical Join Operators in Adaptive Query Processing , 2006, EDBT Workshops.

[118]  John Anderson,et al.  An analysis of a large scale habitat monitoring application , 2004, SenSys '04.

[119]  Mihalis Yannakakis,et al.  Multiobjective query optimization , 2001, PODS '01.

[120]  Wen-Syan Li,et al.  QoS-based Data Access and Placement for Federated Information Systems , 2005, VLDB.

[121]  Samuel Madden,et al.  PAQ: Time Series Forecasting for Approximate Query Answering in Sensor Networks , 2006, EWSN.

[122]  Sanjay Jha,et al.  The design and evaluation of a hybrid sensor network for cane-toad monitoring , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[123]  Peter J. Stuckey,et al.  Programming with Constraints: An Introduction , 1998 .

[124]  Paul N. Weinberg,et al.  SQL, the complete reference , 1999 .

[125]  Jennifer Widom,et al.  CQL: A Language for Continuous Queries over Streams and Relations , 2003, DBPL.

[126]  Christian Y. A. Brenninkmeijer,et al.  Comprehensive Optimization of Declarative Sensor Network Queries , 2009, SSDBM.

[127]  Philip Levis,et al.  The design and implementation of a declarative sensor network system , 2007, SenSys '07.

[128]  Suman Nath,et al.  Tributaries and deltas: efficient and robust aggregation in sensor network streams , 2005, SIGMOD '05.

[129]  Matt Welsh,et al.  Fidelity and yield in a volcano monitoring sensor network , 2006, OSDI '06.

[130]  Robert Tappan Morris,et al.  Span: An Energy-Efficient Coordination Algorithm for Topology Maintenance in Ad Hoc Wireless Networks , 2001, MobiCom '01.

[131]  Deborah Estrin,et al.  Medium access control with coordinated adaptive sleeping for wireless sensor networks , 2004, IEEE/ACM Transactions on Networking.

[132]  Shivnath Babu,et al.  Adaptive Query Processing in the Looking Glass , 2005, CIDR.