Sequence Clustering-based Automated Rule Generation for Adaptive Complex Event Processing

In Complex Event Processing (CEP), complex events are detected according to a set of rules that are defined by domain experts. However, it makes the reliability of the system decreased as dynamic changes occur in the domain environment or domain experts make mistakes. To address such problem, this study proposes a Sequence Clustering-based Automated Rule Generation (SCARG) that can automatically generate rules by mining decision-making history of domain experts based on sequence clustering and probabilistic graphical modeling. Furthermore, based on a two-way learning approach, the proposed method is able to support automated regular or occasional rule updates. It makes self-adaptive CEP system possible by combining the rule generation method and the existing dynamic CEP systems. This technique is verified by establishing an automated stock trading system, and the performance of the system is measured in terms of the rate of return. The study solves the aforementioned problems and shows excellent results with an increase of 19.32% in performance when compared to the existing dynamic CEP technique. The paper presents a novel framework for complex event processing.The proposed method has been designed by temporal probabilistic model.It has been applied to stock trading system.

[1]  Patrick Valduriez,et al.  StreamCloud: A Large Scale Data Streaming System , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[2]  Adrian Paschke,et al.  Knowledge-based processing of complex stock market events , 2012, EDBT '12.

[3]  David Luckham,et al.  The power of events - an introduction to complex event processing in distributed enterprise systems , 2002, RuleML.

[4]  S. Gubser.  Time warps , 2008, 0812.5107.

[5]  Timos K. Sellis,et al.  Event Processing and Real-Time Monitoring over Streaming Traffic Data , 2012, W2GIS.

[6]  Yushun Fan,et al.  Complex event processing in enterprise information systems based on RFID , 2007, Enterp. Inf. Syst..

[7]  Giordano Tamburrelli,et al.  Introducing uncertainty in complex event processing: model, implementation, and validation , 2014, Computing.

[8]  Avigdor Gal,et al.  A Model for Reasoning with Uncertain Rules in Event Composition Systems , 2005, UAI.

[9]  Adrian Paschke,et al.  A Homogeneous Reaction Rule Language for Complex Event Processing , 2010, ArXiv.

[10]  David Sankoff,et al.  Time Warps, String Edits, and Macromolecules: The Theory and Practice of Sequence Comparison , 1983 .

[11]  Adrian E. Raftery,et al.  How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis , 1998, Comput. J..

[12]  Opher Etzion,et al.  Event processing under uncertainty , 2012, DEBS.

[13]  Peter R. Pietzuch,et al.  Distributed complex event processing with query rewriting , 2009, DEBS '09.

[14]  Edward Curry,et al.  Approximate semantic matching of heterogeneous events , 2012, DEBS.

[16]  Alessandro Margara,et al.  Processing flows of information: From data stream to complex event processing , 2012, CSUR.

[17]  Lars George.  Event Pattern Mining for Smart Environments , 2015, SDL Forum.

[18]  Richard H. Jones,et al.  Bayesian information criterion for longitudinal and clustered data , 2011, Statistics in medicine.

[19]  Klemen Kenda,et al.  Supporting Rule Generation and Validation on Environmental Data in EnStreaM , 2012, ESWC.

[20]  Bernhard Seeger,et al.  Anomaly management using complex event processing: extending data base technology paper , 2013, EDBT '13.

[21]  Avigdor Gal,et al.  Efficient Processing of Uncertain Events in Rule-Based Systems , 2012, IEEE Transactions on Knowledge and Data Engineering.

[22]  Yanlei Diao,et al.  High-performance complex event processing over streams , 2006, SIGMOD Conference.

[23]  Daisy Zhe Wang,et al.  Probabilistic Data Management for Pervasive Computing: The Data Furnace Project , 2006, IEEE Data Eng. Bull..

[24]  Avigdor Gal,et al.  Complex event processing over uncertain data , 2008, DEBS.

[25]  Elon Portugaly,et al.  Efficient algorithms for accurate hierarchical clustering of huge datasets: tackling the entire protein space , 2008, ISMB.

[26]  Adrian Paschke,et al.  Probabilistic Event Pattern Discovery , 2015, RuleML.

[27]  Annika Hinze,et al.  Event-based applications and enabling technologies , 2009, DEBS '09.

[28]  Avigdor Gal,et al.  Tuning complex event processing rules using the prediction-correction paradigm , 2009, DEBS '09.

[29]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[30]  Giordano Tamburrelli,et al.  Learning from the past: automated rule generation for complex event processing , 2014, DEBS '14.

[31]  Luc De Raedt,et al.  Bayesian Logic Programming: Theory and Tool , 2007 .