Efficient Processing of Uncertain Events in Rule-Based Systems

There is a growing need for systems that react automatically to events. While some events are generated externally and deliver data across distributed systems, others need to be derived by the system itself based on available information. Event derivation is hampered by uncertainty attributed to causes such as unreliable data sources or the inability to determine with certainty whether an event has actually occurred, given available information. Two main challenges exist when designing a solution for event derivation under uncertainty. First, event derivation should scale under heavy loads of incoming events. Second, the associated probabilities must be correctly captured and represented. We present a solution to both problems by introducing a novel generic and formal mechanism and framework for managing event derivation under uncertainty. We also provide empirical evidence demonstrating the scalability and accuracy of our approach.

[1]  Philip S. Yu,et al.  Epi-SPIRE: a system for environmental and public health activity monitoring , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[2]  Avigdor Gal,et al.  A Model for Reasoning with Uncertain Rules in Event Composition Systems , 2005, UAI.

[3]  M. Balazinska,et al.  PEEX : Extracting Probabilistic Events from RFID Data , 2007 .

[4]  Avigdor Gal,et al.  Complex event processing over uncertain data , 2008, DEBS.

[5]  Jennifer Widom,et al.  Trio: A System for Integrated Management of Data, Accuracy, and Lineage , 2004, CIDR.

[6]  Hendrik Segers,et al.  Composite event specification in active databases: model and implementation , 1992 .

[7]  Umeshwar Dayal,et al.  The HiPAC project: combining active databases and timing constraints , 1988, SGMD.

[8]  Seth White,et al.  WebLogic event server: a lightweight, modular application server for event processing , 2008, DEBS.

[9]  David Luckham,et al.  The power of events - an introduction to complex event processing in distributed enterprise systems , 2002, RuleML.

[10]  Avigdor Gal,et al.  A Taxonomy and Representation of Sources of Uncertainty in Active Systems , 2006, NGITS.

[11]  Wei Hong,et al.  Approximate Data Collection in Sensor Networks using Probabilistic Models , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[12]  Rainer von Ammon Event-Driven Business Process Management , 2009, Encyclopedia of Database Systems.

[13]  Alfonso Fuggetta,et al.  The JEDI Event-Based Infrastructure and Its Application to the Development of the OPSS WFMS , 2001, IEEE Trans. Software Eng..

[14]  Ryan Newton,et al.  The Case for a Signal-Oriented Data Stream Management System , 2007, CIDR.

[15]  Charles L. Forgy,et al.  Rete: a fast algorithm for the many pattern/many object pattern match problem , 1991 .

[16]  Christopher Ré,et al.  Query Evaluation on Probabilistic Databases , 2006, IEEE Data Eng. Bull..

[17]  Joseph Y. Halpern Reasoning about uncertainty , 2003 .

[18]  Avigdor Gal,et al.  Generic Architecture of Complex Event Processing Systems , 2010, Principles and Applications of Distributed Event-Based Systems.

[19]  Johannes Gehrke,et al.  Cayuga: A General Purpose Event Monitoring System , 2007, CIDR.

[20]  Val Tannen,et al.  Models for Incomplete and Probabilistic Information , 2006, IEEE Data Eng. Bull..

[21]  Catriel Beeri,et al.  Query-based monitoring of BPEL business processes , 2007, SIGMOD '07.

[22]  Norman W. Paton,et al.  Active Rules in Database Systems , 1998, Monographs in Computer Science.

[23]  Peter R. Pietzuch,et al.  Composite event detection as a generic middleware extension , 2004, IEEE Network.

[24]  Avigdor Gal,et al.  Tuning complex event processing rules using the prediction-correction paradigm , 2009, DEBS '09.

[25]  Amit P. Sheth,et al.  A Semantic Framework for Identifying Events in a Service Oriented Architecture , 2007, IEEE International Conference on Web Services (ICWS 2007).

[26]  Stephen E. Fienberg,et al.  Current and Potential Statistical Methods for Monitoring Multiple Data Streams for Biosurveillance , 2006 .

[27]  Sharma Chakravarthy,et al.  Snoop: An Expressive Event Specification Language for Active Databases , 1994, Data Knowl. Eng..

[28]  Opher Etzion,et al.  Amit - the situation manager , 2003, The VLDB Journal.

[29]  Kurt Rothermel,et al.  An architecture for observing physical world events , 2005, 11th International Conference on Parallel and Distributed Systems (ICPADS'05).

[30]  Alejandro P. Buchmann,et al.  Principles and Applications of Distributed Event-Based Systems , 2010, Principles and Applications of Distributed Event-Based Systems.

[31]  Norman W. Paton,et al.  DEAR: a DEbugger for Active Rules in an object-oriented context , 1993, Rules in Database Systems.

[32]  Charu C. Aggarwal,et al.  AN EVALUATION OF OVER-THE-COUNTER MEDICATION SALES FOR SYNDROMIC SURVEILLANCE , 2006 .

[33]  Christof Bornhövd,et al.  Event Handling for the Universal Enterprise , 2005, Inf. Technol. Manag..

[34]  Ying Li,et al.  JTang Synergy: A Service Oriented Architecture for Enterprise Application Integration , 2007, 2007 11th International Conference on Computer Supported Cooperative Work in Design.

[35]  Yougu Yuan,et al.  Internet worms and global routing instabilities , 2002, SPIE ITCom.

[36]  Jun Wang,et al.  A metamodel for distributed event based systems , 2008, DEBS.

[37]  Johannes Gehrke,et al.  Towards Expressive Publish/Subscribe Systems , 2006, EDBT.

[38]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[39]  Jennifer Widom,et al.  Active Database Systems: Triggers and Rules For Advanced Database Processing , 1994 .

[40]  Asaf Adi A language and an execution model for the detection of active situations , 2002 .