Temporal Stream Algebra

Data stream management systems (DSMS) so far focus on event queries and hardly consider combined queries to both data from event streams and from a database. However, applications like emergency management require combined data stream and database queries. Further requirements are the simultaneous use of multiple timestamps after different time lines and semantics, expressive temporal relations between multiple time-stamps and exible negation, grouping and aggregation which can be controlled, i. e. started and stopped, by events and are not limited to fixed-size time windows. Current DSMS hardly address these requirements. This article proposes Temporal Stream Algebra (TSA) so as to meet the afore mentioned requirements. Temporal streams are a common abstraction of data streams and data- base relations; the operators of TSA are generalizations of the usual operators of Relational Algebra. A in-depth 'analysis of temporal relations guarantees that valid TSA expressions are non-blocking, i. e. can be evaluated incrementally. In this respect TSA differs significantly from previous algebraic approaches which use specialized operators to prevent blocking expressions on a "syntactical" level.

[1]  Klaus R. Dittrich,et al.  Detecting composite events in active database systems using Petri nets , 1994, Proceedings of IEEE International Workshop on Research Issues in Data Engineering: Active Databases Systems.

[2]  Markus Endler,et al.  Evaluating composite events using shared trees , 2001, IEE Proc. Softw..

[3]  Morris Sloman,et al.  GEM: a generalized event monitoring language for distributed systems , 1997, Distributed Syst. Eng..

[4]  Michael J. Franklin,et al.  Continuous Analytics: Rethinking Query Processing in a Network-Effect World , 2009, CIDR.

[5]  Michael Eckert,et al.  Complex event processing with Xchange_1hnE_1hnQ: language design, formal semantics, and incremental evaluation for querying events. , 2008 .

[6]  Opher Etzion,et al.  Amit - the situation manager , 2003, The VLDB Journal.

[7]  Yanlei Diao,et al.  High-performance complex event processing over streams , 2006, SIGMOD Conference.

[8]  Gultekin Özsoyoglu,et al.  Temporal and Real-Time Databases: A Survey , 1995, IEEE Trans. Knowl. Data Eng..

[9]  Jennifer Widom,et al.  Towards a streaming SQL standard , 2008, Proc. VLDB Endow..

[10]  Richard T. Snodgrass,et al.  Evaluation of relational algebras incorporating the time dimension in databases , 1991, CSUR.

[11]  Norman W. Paton,et al.  Active Rules in Database Systems , 1998, Monographs in Computer Science.

[12]  César Sánchez,et al.  Expressive Completeness of an Event-Pattern Reactive Programming Language , 2005, FORTE.

[13]  Johannes Gehrke,et al.  Cayuga: A General Purpose Event Monitoring System , 2007, CIDR.

[14]  David Maier,et al.  Exploiting punctuation semantics in data streams , 2002, Proceedings 18th International Conference on Data Engineering.

[15]  Michael Eckert,et al.  On static determination of temporal relevance for incremental evaluation of complex event queries , 2008, DEBS.

[16]  Bernhard Seeger,et al.  PIPES: a public infrastructure for processing and exploring streams , 2004, SIGMOD '04.

[17]  François Bry,et al.  Complex Actions for Event Processing , 2012 .

[18]  Henry A. Kautz,et al.  Constraint propagation algorithms for temporal reasoning: a revised report , 1989 .

[19]  Roger S. Barga,et al.  Event Correlation and Pattern Detection in CEDR , 2006, EDBT Workshops.

[20]  Dennis Gannon,et al.  The Client and the Cloud: Democratizing Research Computing , 2011, IEEE Internet Computing.

[21]  Narain H. Gehani,et al.  COMPOSE: A System For Composite Specification And Detection , 1993, Advanced Database Systems.

[22]  Serge Abiteboul,et al.  Foundations of Databases , 1994 .

[23]  Jennifer Widom,et al.  Database Systems: The Complete Book , 2001 .

[24]  Christian S. Jensen,et al.  A Foundation for Conventional and Temporal Query Optimization Addressing Duplicates and Ordering , 2001, IEEE Trans. Knowl. Data Eng..

[25]  Manolis Koubarakis,et al.  Backtracking algorithms for disjunctions of temporal constraints , 1998, Artif. Intell..

[26]  Johannes Gehrke,et al.  Expressive and Scalable Event Stream Processing , 2009 .

[27]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[28]  Michael Eckert,et al.  A CEP Babelfish: Languages for Complex Event Processing and Querying Surveyed , 2011 .

[29]  Arie Shoshani,et al.  Enabling Real-Time Querying of Live and Historical Stream Data , 2007, 19th International Conference on Scientific and Statistical Database Management (SSDBM 2007).

[30]  Björn Lisper,et al.  An event detection algebra for reactive systems , 2004, EMSOFT '04.

[31]  Adarshpal S. Sethi,et al.  SEL, a new event pattern specification language for event correlation , 2001, Proceedings Tenth International Conference on Computer Communications and Networks (Cat. No.01EX495).

[32]  Martin Kersten,et al.  A Query Language for a Data Refinery Cell , 2007 .

[33]  Robert K. Brayton,et al.  Logic Minimization Algorithms for VLSI Synthesis , 1984, The Kluwer International Series in Engineering and Computer Science.

[34]  Martin Kersten,et al.  Exploiting the power of relational databases for efficient stream processing , 2009, EDBT '09.

[35]  Stevan D. Vidich.  Complex Event Processing with Coral8 , 2008 .

[36]  Sharma Chakravarthy,et al.  Composite Events for Active Databases: Semantics, Contexts and Detection , 1994, VLDB.

[37]  Mikael Berndtsson,et al.  Design and Implementation of an ECA Rule Markup Language , 2005, RuleML.

[38]  Michael Eckert.  Complex event processing with XchangeEQ: language design, formal semantics, and incremental evaluation for querying events , 2008 .

[39]  Qiang Chen,et al.  Aurora : a new model and architecture for data stream management ) , 2006 .

[40]  Gerti Kappel,et al.  Composite events for xml , 2004, WWW '04.

[41]  Annika Hinze,et al.  A parameterized algebra for event notification services , 2002, Proceedings Ninth International Symposium on Temporal Representation and Reasoning.

[42]  E. F. Codd,et al.  Relational Completeness of Data Base Sublanguages , 1972, Research Report / RJ / IBM / San Jose, California.

[43]  Frederick Reiss,et al.  TelegraphCQ: Continuous Dataflow Processing for an Uncertain World , 2003, CIDR.

[44]  Michael Eckert,et al.  Reactivity on the web: paradigms and applications of the language XChange , 2005, SAC '05.

[45]  Jennifer Widom,et al.  The CQL continuous query language: semantic foundations and query execution , 2006, The VLDB Journal.

[46]  JÜRGEN KRÄMER,et al.  Semantics and implementation of continuous sliding window queries over data streams , 2009, TODS.

[47]  Sharma Chakravarthy,et al.  SnoopIB: Interval-based event specification and detection for active databases , 2003, Data Knowl. Eng..

[48]  Rina Dechter,et al.  Temporal Constraint Networks , 1989, Artif. Intell..

[49]  Michael Eckert,et al.  Two Semantics for CEP, no Double Talk: Complex Event Relational Algebra (CERA) and Its Application to XChange EQ , 2011 .

[50]  Claudia Roncancio,et al.  Toward Duration-Based, Constrained and Dynamic Event Types , 1997, ARTDB.