Anomaly management using complex event processing: extending data base technology paper

During the last decade, complex event processing (CEP) has emerged as a technological foundation for many time-critical monitoring applications. CEP is powerful, effective, easy to use and low in costs at the same time. Common CEP applications are for example stock-market analysis, detection of fraudulent credit card use, traffic monitoring and consumption forecasting in power grids. Many application domains are still hard to target by CEP, because state of the art CEP technology is characterized by a static behavior and by a signature-based detection paradigm. In this paper, we motivate substantial improvements of CEP technology by making the behavior of the infrastructure dynamic and by switching the detection paradigm from signatures to anomalies. This leads to multiple changes in the infrastructure that raise interesting and challenging research questions. The resulting dynamic CEP infrastructure not only makes existing applications more powerful and easier to maintain but also enables novel application domains.

[1]  Johannes Gehrke,et al.  Cayuga: a high-performance event processing engine , 2007, SIGMOD '07.

[2]  Gustavo Alonso,et al.  Complex event detection at wire speed with FPGAs , 2010, Proc. VLDB Endow..

[3]  Carlo Curino,et al.  Update Rewriting and Integrity Constraint Maintenance in a Schema Evolution Support System: PRISM++ , 2010, Proc. VLDB Endow..

[4]  Richard Y. Wang,et al.  Data quality assessment , 2002, CACM.

[5]  Lukasz Golab,et al.  Data Stream Management , 2017, Data Stream Management.

[6]  Gagandeep Saini,et al.  Milk Run Logistics: Literature Review and Directions , 2011 .

[7]  Laura M. Haas,et al.  Modeling the execution semantics of stream processing engines with SECRET , 2012, The VLDB Journal.

[8]  Carsten Binnig,et al.  Towards Automatic Test Database Generation , 2008, IEEE Data Eng. Bull..

[9]  Haixun Wang,et al.  Adaptive system anomaly prediction for large-scale hosting infrastructures , 2010, PODC.

[10]  Elke A. Rundensteiner,et al.  Active complex event processing , 2010, Proc. VLDB Endow..

[11]  Hyoil Han,et al.  An Infrastructure of Stream Data Mining, Fusion and Management for Monitored Patients , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).

[12]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[13]  Yogesh L. Simmhan,et al.  Towards an inexact semantic complex event processing framework , 2011, DEBS '11.

[14]  Richard Y. Wang,et al.  Journey to Data Quality , 2006 .

[15]  Samuel Madden,et al.  ZStream: a cost-based query processor for adaptively detecting composite events , 2009, SIGMOD Conference.

[16]  Peter R. Pietzuch,et al.  Distributed complex event processing with query rewriting , 2009, DEBS '09.

[17]  Jennifer Widom,et al.  Towards a streaming SQL standard , 2008, Proc. VLDB Endow..

[18]  Adrian Paschke,et al.  Knowledge-based processing of complex stock market events , 2012, EDBT '12.

[19]  Patrick Valduriez,et al.  StreamCloud: A Large Scale Data Streaming System , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[20]  Timos K. Sellis,et al.  Event Processing and Real-Time Monitoring over Streaming Traffic Data , 2012, W2GIS.

[21]  Felix Naumann,et al.  Data Fusion in Three Steps : Resolving Inconsistencies at Schema-, Tuple-, and Value-lvel , 2006 .

[22]  Laura M. Haas,et al.  SECRET: A Model for Analysis of the Execution Semantics of Stream Processing Systems , 2010, Proc. VLDB Endow..

[23]  Felix Naumann,et al.  Data Fusion in Three Steps: Resolving Schema, Tuple, and Value Inconsistencies , 2006, IEEE Data Eng. Bull..

[24]  Timo Michelsen,et al.  Odysseus: a highly customizable framework for creating efficient event stream management systems , 2012, DEBS.