Accelerating Sequence Event Detection through Condensed Composition

Composite event processing systems are useful in various application domains such as stock data stream monitoring, RFID data management, web access pattern monitoring, etc. The tree-based method is a typical method for implementing composite event processing system. In this paper, we introduce an optimization method called "condensed composition" for the tree-based composite event processing. "Condensed composition" divides the events in groups to participate the composition. We analyze the reason why the performance is improved and utilizes the statistics of the "condensation degree" to dynamically decide using condensed composition or not for different data characteristics. In the experiments, the "condensed composition" method significantly improved the performance on the real stock data.

[1]  Samuel Madden,et al.  Continuously adaptive continuous queries over streams , 2002, SIGMOD '02.

[2]  Johannes Gehrke,et al.  Cayuga: A General Purpose Event Monitoring System , 2007, CIDR.

[3]  Dennis Shasha,et al.  Filtering algorithms and implementation for very fast publish/subscribe systems , 2001, SIGMOD '01.

[4]  Michael Gertz,et al.  Indexing Query Regions for Streaming Geospatial Data , 2004, STDBM.

[5]  Yanlei Diao,et al.  High-performance complex event processing over streams , 2006, SIGMOD Conference.

[6]  Rajeev Rastogi,et al.  Scalable regular expression matching on data streams , 2008, SIGMOD Conference.

[7]  Neil Immerman,et al.  Efficient pattern matching over event streams , 2008, SIGMOD Conference.

[8]  Frederick Reiss,et al.  TelegraphCQ: continuous dataflow processing , 2003, SIGMOD '03.

[9]  Samuel Madden,et al.  ZStream: a cost-based query processor for adaptively detecting composite events , 2009, SIGMOD Conference.

[10]  C. Zaniolo,et al.  Expressing and optimizing sequence queries in database systems , 2004, TODS.

[11]  Yanlei Diao,et al.  Architectural Considerations for Distributed RFID Tracking and Monitoring , 2009 .

[12]  Bonghee Hong,et al.  A Continuous Query Index for Processing Queries on RFID Data Stream , 2007, 13th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA 2007).

[13]  Jun-Ki Min.  A Query Index for Stream Data Using Interval Skip Lists Exploiting Locality , 2007, International Conference on Computational Science.

[14]  Jennifer Widom,et al.  Database System Implementation , 2000 .