From Data Streams to Fields: Extending Stream Data Models with Field Data Types

With ubiquitous live sensors and sensor networks, increasingly large numbers of individual sensors are deployed in physical space. Sensor data streams are a fundamentally novel mechanism to create and deliver observations to information systems, enabling us to represent spatio-temporal continuous phenomena such as radiation accidents, pollen distributions, or toxic plumes almost as instantaneously as they happen in the real world. While data stream engines (DSE) are available to process high-throughput updates, DSE support for phenomena that are continuous in both space and time is not available. This places the burden of handling any tasks related to the integration of potentially very large sets of concurrent sensor streams into higher-level abstractions on the user. In this paper, we propose a formal extension to stream data model languages based on the concept of fields to support high-level abstractions of continuous ST phenomena that are known to the DSE, and therefore, can be supported through queries and processing optimization. The proposed field data types are formalized in a data model language independent way using second order signatures. We formalize both the set of supported field types are as well as the embedding into stream data model languages.

[1]  Walid G. Aref,et al.  NILE-PDT: A Phenomenon Detection and Tracking Framework for Data Stream Management Systems , 2005, VLDB.

[2]  Ralf Hartmut Güting,et al.  Spatio-Temporal Data Types: An Approach to Modeling and Querying Moving Objects in Databases , 1999, GeoInformatica.

[3]  Max J. Egenhofer,et al.  Fields as a Generic Data Type for Big Spatial Data , 2014, GIScience.

[4]  Silvia Nittel,et al.  Towards window stream queries over continuous phenomena , 2013, IWGS '13.

[5]  Michael F. Goodchild,et al.  Extending geographical representation to include fields of spatial objects , 2002, Int. J. Geogr. Inf. Sci..

[6]  Genny Tortora,et al.  A spatial SQL extension for continuous field querying , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[7]  Karen K. Kemp Fields as a framework for integrating GIS and environmental process models. Part 1: Representing spatial continuity , 1996, Trans. GIS.

[8]  Jennifer Widom,et al.  The CQL continuous query language: semantic foundations and query execution , 2006, The VLDB Journal.

[9]  Yan Huang,et al.  New Data Types and Operations to Support Geo-streams , 2008, GIScience.

[10]  Michael Stonebraker,et al.  The 8 requirements of real-time stream processing , 2005, SGMD.

[11]  Matt Duckham,et al.  Challenges to using decentralized spatial algorithms in the field: the RISERnet geosensor network case study , 2015, SIGSPACIAL.

[12]  Kresimir Krizanovic,et al.  Geospatial data streams: Formal framework and implementation , 2014, Data Knowl. Eng..

[13]  Karen K. Kemp Fields as a framework for integrating GIS and environmental process models. Part 2: Specifying field variables , 1996, Trans. GIS.

[14]  Helen Couclelis,et al.  People Manipulate Objects (but Cultivate Fields): Beyond the Raster-Vector Debate in GIS , 1992, Spatio-Temporal Reasoning.

[15]  Ralf Hartmut Güting,et al.  Second-order signature , 1993, SIGMOD Conference.

[16]  Badrish Chandramouli,et al.  Spatio-Temporal Stream Processing in Microsoft StreamInsight , 2010, IEEE Data Eng. Bull..

[17]  Jennifer Widom,et al.  Continuous queries over data streams , 2001, SGMD.

[18]  Silvia Nittel,et al.  Real-time sensor data streams , 2015, SIGSPACIAL.

[19]  Markus Schneider,et al.  A foundation for representing and querying moving objects , 2000, TODS.

[20]  Peter Baumann,et al.  The OGC web coverage processing service (WCPS) standard , 2010, GeoInformatica.

[21]  Antony Galton,et al.  Fields and Objects in Space, Time, and Space-time , 2004, Spatial Cogn. Comput..

[22]  Andreas Krause,et al.  The next big one: Detecting earthquakes and other rare events from community-based sensors , 2011, Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks.

[23]  Alexander Gluhak,et al.  SmartSantander: The meeting point between Future Internet research and experimentation and the smart cities , 2011, 2011 Future Network & Mobile Summit.

[24]  Qinghan Liang Towards The Continuous Spatio-Temporal Field Model for Sensor Data Streams , 2015 .

[25]  Gilberto Câmara,et al.  An Algebra for Spatiotemporal Data: From Observations to Events , 2014, Trans. GIS.

[26]  Silvia Nittel,et al.  Evaluating stream predicates over dynamic fields , 2014, IWGS.

[27]  Antony Galton,et al.  A Formal Theory of Objects and Fields , 2001, COSIT.

[28]  Michael Gertz,et al.  Querying Streaming Geospatial Image Data: The GeoStreams Project , 2005, SSDBM.