Methods and Tools for Management of Distributed Event Processing Applications

Gathering and processing events from cyber-physical systems provides users with the opportunity to continuously be aware of current performance indicators and potentially upcoming issues (situational awareness) as well as to optimize maintenance processes based on the current condition of machines or other equipment (conditionbased maintenance). Due to the large volume and variety of data and, in addition, the demand for real-time analysis, these scenarios require appropriate technologies. In this context, Event Processing has become an established technology to process event streams in real-time while providing capabilities to detect event patterns based on spatial, temporal or causal relationships. In contrast, today’s available systems still suffer from high technical complexity in terms of their underlying declarative languages. On the one hand, such systems require deep technical knowledge of event processing systems, making the development of real-time applications a time-consuming task due to slow development cycles. On the other hand, event processing applications are often highly dynamic in regard to oftentimes changing requirements of observed situations as well as frequent syntactic and semantic changes of incoming sensor data. The main contribution of this thesis enables application specialists to define, modify and execute event processing applications in a self-service manner by abstracting from underlying technical details in form of so-called real-time processing pipelines. The contributions of this thesis are summarized as follows: 1. A methodology supporting the development of real-time applications under special consideration of extensibility and accessibility for application specialists. 2. Models to semantically describe characteristics of event producers, event processing agents and event consumers. 3. A system to execute processing pipelines consisting of geographically distributed event processing components. 4. A software artifact that supports graphical modeling of processing pipelines and automatic pipeline execution. These contributions are introduced, applied and evaluated based on multiple scenarios from two application domains, manufacturing and logistics.

[1]  Kia Teymourian,et al.  Enabling knowledge-based complex event processing , 2010, EDBT '10.

[2]  Nenad Stojanovic,et al.  Where events meet events: PLAY event marketplace , 2012, DEBS.

[3]  Umeshwar Dayal,et al.  The architecture of an active database management system , 1989, SIGMOD '89.

[4]  Gustavo Alonso,et al.  Web Services , 2004, Data-Centric Systems and Applications.

[5]  J. P. Martins,et al.  Reusing Ontologies , 2000 .

[6]  Nenad Stojanovic,et al.  EchoPAT: a system for real-time complex event pattern monitoring , 2010, DEBS '10.

[7]  Ljiljana Stojanovic,et al.  StreamPipes: solving the challenge with semantic stream processing pipelines , 2015, DEBS.

[8]  Bernhard Seeger,et al.  JEPC: The Java Event Processing Connectivity , 2013, Datenbank-Spektrum.

[9]  Jay Kreps,et al.  Kafka : a Distributed Messaging System for Log Processing , 2011 .

[10]  Nenad Stojanovic,et al.  GRUVe: A Methodology for Complex Event Pattern Life Cycle Management , 2010, CAiSE.

[11]  Jorge S. Cardoso,et al.  Linked USDL: A Vocabulary for Web-Scale Service Trading , 2014, ESWC.

[12]  Sebastian Rudolph,et al.  Stream reasoning and complex event processing in ETALIS , 2012, Semantic Web.

[13]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[14]  Roland Stühmer.  Web-oriented Event Processing , 2015 .

[15]  Panos Vassiliadis,et al.  A Survey of Extract-Transform-Load Technology , 2009, Int. J. Data Warehous. Min..

[16]  Dario Bonino,et al.  Mastering real-time big data with stream processing chains , 2012, XRDS.

[17]  Opher Etzion,et al.  Event Processing Network - A Conceptual Model , 2007 .

[18]  Mathias Weske,et al.  Enabling Semantic Complex Event Processing in the Domain of Logistics , 2013, ICSOC Workshops.

[19]  John Mylopoulos,et al.  The Business Intelligence Model : Strategic Modelling version 1 . 0 , 2010 .

[20]  Matjaz B. Juric,et al.  Towards Complex Event Aware Services as Part of SOA , 2014, IEEE Transactions on Services Computing.

[21]  Amit P. Sheth,et al.  The SSN ontology of the W3C semantic sensor network incubator group , 2012, J. Web Semant..

[22]  Aaron E. Walsh.  UDDI, SOAP, and WSDL: The Web Services Specification Reference Book , 2002 .

[23]  Peter Kepplinger,et al.  Model-driven rule composition for event-based systems , 2011, Int. J. Bus. Process. Integr. Manag..

[24]  Josef Schiefer,et al.  Complex Event Processing off the shelf - Rapid development of event-driven applications with solution templates , 2011, 2011 19th Mediterranean Conference on Control & Automation (MED).

[25]  Jan Pries-Heje,et al.  A Comprehensive Framework for Evaluation in Design Science Research 1 , 2022 .

[26]  Thomas Diefenbach,et al.  Business Performance Measurement. Theory and Practice , 2004 .

[27]  D. Luckham.  The Power of Events , 2002 .

[28]  Rik Van de Walle,et al.  Survey of Semantic Description of REST APIs , 2014 .

[29]  Sinan Sen,et al.  Efficient and Effective Event Pattern Management , 2013 .

[30]  Jan Pries-Heje,et al.  Strategies for Design Science Research Evaluation , 2008, ECIS.

[31]  Jun Ma,et al.  An Event-Driven System for Business Awareness Management in the Logistics Domain , 2012, Business Process Management Workshops.

[32]  Fulvio Corno,et al.  spChains: A Declarative Framework for Data Stream Processing in Pervasive Applications , 2012, ANT/MobiWIS.

[33]  John Domingue,et al.  Toward the Next Wave of Services: Linked Services for the Web of Data , 2010, J. Univers. Comput. Sci..

[34]  Adrian Paschke,et al.  Fusion of background knowledge and streams of events , 2012, DEBS.

[35]  A. Polleres,et al.  Towards Intelligent web Services: Web Service Modeling Ontology (WSMO) , 2005 .

[36]  Alejandro P. Buchmann,et al.  Event Stream Processing Units in Business Processes , 2013, BPM.

[37]  Frank Kargl,et al.  A conceptual model for event-sourced graph computing , 2015, DEBS.

[38]  Nenad Stojanovic,et al.  An approach for iterative event pattern recommendation , 2010, DEBS '10.

[39]  Peter Friess,et al.  Internet of Things Applications - From Research and Innovation to Market Deployment , 2014 .

[40]  Bugra Gedik,et al.  Fundamentals of Stream Processing: Application Design, Systems, and Analytics , 2014 .

[41]  Steffen Staab,et al.  OntoEdit: Multifaceted Inferencing for Ontology Engineering , 2003, J. Data Semant..

[42]  Sebastian Rudolph,et al.  EP-SPARQL: a unified language for event processing and stream reasoning , 2011, WWW.

[43]  K. Mani Chandy,et al.  Event Processing - Designing IT Systems for Agile Companies , 2009 .

[44]  Jun Ma,et al.  ALERT: semantic event-driven collaborative platform for software development , 2012, DEBS.

[45]  Dieter Fensel,et al.  Knowledge Engineering: Principles and Methods , 1998, Data Knowl. Eng..

[46]  Christian Gütl,et al.  Hydra: A Vocabulary for Hypermedia-Driven Web APIs , 2013, LDOW.

[47]  Didar Zowghi,et al.  Requirements Elicitation: A Survey of Techniques, Approaches, and Tools , 2005 .

[48]  Bela Stantic,et al.  Introducing Knowledge-Enrichment Techniques for Complex Event Processing , 2011 .

[49]  Steffen Staab,et al.  On-To-Knowledge Methodology (OTKM) , 2004, Handbook on Ontologies.

[50]  Jos de Bruijn,et al.  Web Service Modeling Ontology , 2005, Appl. Ontology.

[51]  Nenad Stojanovic,et al.  A Methodology for Designing Events and Patterns in Fast Data Processing , 2013, CAiSE.

[52]  Anette Weisbecker,et al.  A Methodology for Dynamic Service Compositions Based on an Event-Driven Approach , 2011, 2011 Annual SRII Global Conference.

[53]  Nenad Stojanovic,et al.  SEPP: Semantics-Based Management of Fast Data Streams , 2014, 2014 IEEE 7th International Conference on Service-Oriented Computing and Applications.

[54]  Gregoris Mentzas,et al.  A Real-Time Architecture for Proactive Decision Making in Manufacturing Enterprises , 2015, OTM Workshops.

[55]  Daniele Braga,et al.  C-SPARQL: SPARQL for continuous querying , 2009, WWW '09.

[56]  John A. Kunze,et al.  Dublin Core Metadata for Resource Discovery , 1998, RFC.

[57]  Fulvio Corno,et al.  Real-Time Big Data Processing for Domain Experts: An Application to Smart Buildings , 2013 .

[58]  Kresimir Vidackovic,et al.  Business-oriented development methodology for complex event processing: demonstration of an integrated approach for process monitoring , 2010, DEBS '10.

[59]  Jennifer Widom,et al.  Models and issues in data stream systems , 2002, PODS.

[60]  Iadh Ounis,et al.  Real-Time Detection, Tracking, and Monitoring of Automatically Discovered Events in Social Media , 2014, ACL.

[61]  K. Mani Chandy,et al.  Rapid detection of rare geospatial events: earthquake warning applications , 2011, DEBS '11.

[62]  Christopher D. Town,et al.  SSWAP: A Simple Semantic Web Architecture and Protocol for semantic web services , 2009, BMC Bioinformatics.

[63]  Bela Stantic,et al.  OECEP: enriching complex event processing with domain knowledge from ontologies , 2012, BCI '12.

[64]  Nenad Stojanovic,et al.  Demo: ALERT - real-time coordination in open source software development , 2013, DEBS '13.

[65]  Graham Witt.  Writing Effective Business Rules , 2012 .

[66]  Takahiro Kawamura,et al.  Semantic Matching of Web Services Capabilities , 2002, SEMWEB.

[67]  Nenad Stojanovic,et al.  Using Complex Event Processing for Modeling Semantic Requests in Real-Time Social Media Monitoring , 2012, ICWSM 2012.