Sensors to Events: Semantic Modeling and Recognition of Events from Data Streams

Detecting and responding to real-world events is an integral part of any enterprise or organization, but Semantic Computing has been largely underutilized for complex event processing (CEP) applications. A primary reason for this gap is the difference in the level of abstraction between the high-level semantic models for events and the low-level raw data values received from sensor data streams. In this work, we investigate the need for Semantic Computing in various aspects of CEP, and intend to bridge this gap by utilizing recent advances in time series analytics and machine learning. We build upon the Process-oriented Event Model, which provides a formal approach to model real-world objects and events, and specifies the process of moving from sensors to events. We extend this model to facilitate Semantic Computing and time series data mining directly over the sensor data, which provides the advantage of automatically learning the required background knowledge without domain expertise. We illustrate the expressive power of our model in case studies from diverse applications, with particular emphasis on non-intrusive load monitoring in smart energy grids. We also demonstrate that this powerful semantic representation is still highly accurate and performs at par with existing approaches for event detection and classification.

[1]  Opher Etzion,et al.  Blending Complex Event Processing with the RETE Algorithm , 2008 .

[2]  Sebastian Rudolph,et al.  ETALIS: Rule-Based Reasoning in Event Processing , 2011 .

[3]  Dong Liu,et al.  A Framework for Feeding Linked Data to Complex Event Processing Engines , 2010, COLD.

[4]  Eric N. Hanson,et al.  A performance comparison of the Rete and TREAT algorithms for testing database rule conditions , 1992, [1992] Eighth International Conference on Data Engineering.

[5]  Opher Etzion,et al.  Context-Based Event Processing Systems , 2011 .

[6]  Lucio Soibelman,et al.  User-Centered Nonintrusive Electricity Load Monitoring for Residential Buildings , 2011 .

[7]  Charles L. Forgy,et al.  Rete: a fast algorithm for the many pattern/many object pattern match problem , 1991 .

[8]  Ramesh C. Jain,et al.  {\rm E} - A Generic Event Model for Event-Centric Multimedia Data Management in eChronicle Applications , 2006, 22nd International Conference on Data Engineering Workshops (ICDEW'06).

[9]  Om Prasad Patri,et al.  Doctoral Symposium: Modeling and Recognition of Events from Multidimensional Data , 2016 .

[10]  Viktor K. Prasanna,et al.  Extracting discriminative shapelets from heterogeneous sensor data , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[11]  Shwetak N. Patel,et al.  ElectriSense: single-point sensing using EMI for electrical event detection and classification in the home , 2010, UbiComp.

[12]  Pierluigi Siano,et al.  Ontology and semantic web for manufacturing , 2014 .

[13]  Vikram Sorathia Dynamic information management methodology with situation awareness capability , 2008 .

[14]  Amarnath Gupta,et al.  Managing Event Information: Modeling, Retrieval, and Applications , 2011, Managing Event Information.

[15]  Jason Lines,et al.  Classification of time series by shapelet transformation , 2013, Data Mining and Knowledge Discovery.

[16]  Eric C. Larson,et al.  Disaggregated End-Use Energy Sensing for the Smart Grid , 2011, IEEE Pervasive Computing.

[17]  Li Wei,et al.  Fast time series classification using numerosity reduction , 2006, ICML.

[18]  Ken Fukuda,et al.  An Upper Ontology for Event Classifications and Relations , 2007, Australian Conference on Artificial Intelligence.

[19]  Michael J. Witbrock,et al.  An Introduction to the Syntax and Content of Cyc , 2006, AAAI Spring Symposium: Formalizing and Compiling Background Knowledge and Its Applications to Knowledge Representation and Question Answering.

[20]  Yogesh L. Simmhan,et al.  Incorporating Semantic Knowledge into Dynamic Data Processing for Smart Power Grids , 2012, International Semantic Web Conference.

[21]  Viktor K. Prasanna,et al.  Predicting Failures from Oilfield Sensor Data using Time Series Shapelets , 2014 .

[22]  Kia Teymourian,et al.  Enabling knowledge-based complex event processing , 2010, EDBT '10.

[23]  Viktor K. Prasanna,et al.  Semantic Information Integration for Smart Grid Applications , 2011 .

[24]  Tino Breddin,et al.  Relative temporal constraints in the Rete algorithm for complex event detection , 2008, DEBS.

[25]  Akhil Kumar,et al.  Ensuring Compliance with Semantic Constraints in Process Adaptation with Rule-Based Event Processing , 2010, RuleML.

[26]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[27]  Annika Marie Hinze A-MEDIAS: concept and design of an adaptive integrating event notification service , 2003 .

[28]  Xindong Wu,et al.  Data mining with big data , 2014, IEEE Transactions on Knowledge and Data Engineering.

[29]  Giuseppe Carenini,et al.  Methods for Mining and Summarizing Text Conversations , 2011, Synthesis Lectures on Data Management.

[30]  D. Mukherjee,et al.  Ad-hoc ride sharing application using continuous SPARQL queries , 2012, WWW.

[31]  Philip S. Yu,et al.  Extracting Interpretable Features for Early Classification on Time Series , 2011, SDM.

[32]  Alexandre Alves,et al.  Tutorial on advanced design patterns in event processing , 2012, DEBS.

[33]  Steven B. Leeb,et al.  Nonintrusive Load Monitoring and Diagnostics in Power Systems , 2008, IEEE Transactions on Instrumentation and Measurement.

[34]  Adrian Paschke,et al.  Semantic Enrichment of Event Stream for Semantic Situation Awareness , 2016 .

[35]  Jae-Yoon Jung,et al.  Semantic annotation on Event Pattern Languages for Complex Event Processing in ubiquitous logistics , 2011, 2011 IEEE 3rd International Conference on Communication Software and Networks.

[36]  Adrian Paschke,et al.  RuleML 1.0: The Overarching Specification of Web Rules , 2010, RuleML.

[37]  Muhammad Ali Imran,et al.  Non-Intrusive Load Monitoring Approaches for Disaggregated Energy Sensing: A Survey , 2012, Sensors.

[38]  K. Mani Chandy,et al.  Theory and implementation of a distributed event based platform , 2016, DEBS.

[39]  Kamin Whitehouse,et al.  Gemello: Creating a Detailed Energy Breakdown from Just the Monthly Electricity Bill , 2016, KDD.

[40]  Adrian Paschke,et al.  Knowledge-based processing of complex stock market events , 2012, EDBT '12.

[41]  Kerry L. Taylor,et al.  Ontology-Driven Complex Event Processing in Heterogeneous Sensor Networks , 2011, ESWC.

[42]  Pascal Lorenz,et al.  A Semantic-oriented Framework for System Diagnosis , 2011 .

[43]  Jun Ma,et al.  Semantic Complex Event Reasoning - Beyond Complex Event Processing , 2011, Foundations for the Web of Information and Services.

[44]  Vikrambhai S. Sorathia,et al.  Semantic management of Enterprise Integration Patterns: A use case in Smart Grids , 2014, 2014 IEEE 30th International Conference on Data Engineering Workshops.

[45]  Alessandro Margara,et al.  Processing flows of information: From data stream to complex event processing , 2012, CSUR.

[46]  Eamonn J. Keogh,et al.  Time series shapelets: a new primitive for data mining , 2009, KDD.

[47]  Viktor K. Prasanna,et al.  Personalized trip planning by integrating multimodal user-generated content , 2015, Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015).

[48]  Rainer Unland,et al.  On the semantics of complex events in active database management systems , 1999, Proceedings 15th International Conference on Data Engineering (Cat. No.99CB36337).

[49]  Heiko Paulheim,et al.  Efficient Semantic Event Processing: Lessons Learned in User Interface Integration , 2010, ESWC.

[50]  Bruno Berstel,et al.  Extending the RETE algorithm for event management , 2002, Proceedings Ninth International Symposium on Temporal Representation and Reasoning.

[51]  Vikrambhai S. Sorathia,et al.  Event-driven Information Integration for the Digital Oilfield , 2012 .

[52]  Radu Zmeureanu,et al.  Using a pattern recognition approach to disaggregate the total electricity consumption in a house into the major end-uses , 1999 .

[53]  Annika Hinze,et al.  Event-based applications and enabling technologies , 2009, DEBS '09.

[54]  Eamonn J. Keogh,et al.  Fast Shapelets: A Scalable Algorithm for Discovering Time Series Shapelets , 2013, SDM.

[55]  Martin Doerr,et al.  The CIDOC Conceptual Reference Module: An Ontological Approach to Semantic Interoperability of Metadata , 2003, AI Mag..

[56]  Surajit Chaudhuri,et al.  What next?: a half-dozen data management research goals for big data and the cloud , 2012, PODS '12.

[57]  Yehia Taher,et al.  Automatic learning of predictive rules for complex event processing: doctoral symposium , 2016, DEBS.

[58]  Nenad Stojanovic,et al.  Semantic-based Complex Event Processing in the AAL Domain , 2010, ISWC Posters&Demos.

[59]  Holger Ziekow,et al.  ARCHITECT: A layered framework for classifying technologies of event-based systems , 2011, Inf. Syst..

[60]  Manish Marwah,et al.  A Temporal Motif Mining Approach to Unsupervised Energy Disaggregation: Applications to Residential and Commercial Buildings , 2013, AAAI.

[61]  Karl Hammar Modular Semantic CEP for Threat Detection , 2012 .

[62]  Michael Zeifman,et al.  Nonintrusive appliance load monitoring ( NIALM ) for energy control in residential buildings , 2011 .

[63]  Eamonn J. Keogh,et al.  Logical-shapelets: an expressive primitive for time series classification , 2011, KDD.

[64]  Srinath Perera,et al.  Siddhi: a second look at complex event processing architectures , 2011, GCE '11.

[65]  Jun Wang,et al.  A metamodel for distributed event based systems , 2008, DEBS.

[66]  Sharma Chakravarthy,et al.  SnoopIB: Interval-based event specification and detection for active databases , 2003, Data Knowl. Eng..

[67]  Michael Eckert,et al.  Two Semantics for CEP, no Double Talk: Complex Event Relational Algebra (CERA) and Its Application to XChange EQ , 2011 .

[68]  Jane Hunter,et al.  The ABC Ontology and Model , 2001, J. Digit. Inf..

[69]  Fusheng Wang,et al.  Bridging Physical and Virtual Worlds: Complex Event Processing for RFID Data Streams , 2006, EDBT.

[70]  Adrian Paschke,et al.  Semantic Rule-Based Complex Event Processing , 2009, RuleML.

[71]  Viktor K. Prasanna,et al.  Applying Semantic Web Techniques to Reservoir Engineering: Challenges and Experiences from Event Modeling , 2010, 2010 Seventh International Conference on Information Technology: New Generations.

[72]  Yogesh L. Simmhan,et al.  Cloud-Based Software Platform for Big Data Analytics in Smart Grids , 2013, Computing in Science & Engineering.

[73]  Stefan Biffl,et al.  Semantic Event Correlation Using Ontologies , 2009, OTM Conferences.

[74]  Anthony Rowe,et al.  BLUED : A Fully Labeled Public Dataset for Event-Based Non-Intrusive Load Monitoring Research , 2012 .

[75]  Avigdor Gal,et al.  Efficient Processing of Uncertain Events in Rule-Based Systems , 2012, IEEE Transactions on Knowledge and Data Engineering.

[76]  Eamonn J. Keogh,et al.  Clustering Time Series Using Unsupervised-Shapelets , 2012, 2012 IEEE 12th International Conference on Data Mining.

[77]  Viktor K. Prasanna,et al.  Extracting discriminative features for event-based electricity disaggregation , 2014, 2014 IEEE Conference on Technologies for Sustainability (SusTech).

[78]  Vikrambhai S. Sorathia,et al.  The process-oriented event model (PoEM): a conceptual model for industrial events , 2014, DEBS '14.

[79]  Annika Hinze,et al.  A flexible parameter dependent algebra for event notification services , 2002 .

[80]  Junqiang Liu,et al.  Complex event processing for sequence data and domain knowledge , 2010, 2010 International Conference on Mechanic Automation and Control Engineering.

[81]  Sharma Chakravarthy,et al.  Snoop: An Expressive Event Specification Language for Active Databases , 1994, Data Knowl. Eng..

[82]  Michael F. Worboys,et al.  From Objects to Events: GEM, the Geospatial Event Model , 2004, GIScience.

[83]  Alexandra Poulovassilis,et al.  Event-Condition-Action Rule Languages for the Semantic Web , 2006, EDBT Workshops.

[84]  Raphaël Troncy,et al.  LODE: Linking Open Descriptions of Events , 2009, ASWC.

[85]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[86]  David Luckham,et al.  The power of events - an introduction to complex event processing in distributed enterprise systems , 2002, RuleML.

[87]  Véronique Malaisé,et al.  Design and use of the Simple Event Model (SEM) , 2011, J. Web Semant..