A Distributed Complex Event Processing System Based on Publish/Subscribe

The advent of the Internet of Things (IoT) significantly stimulates the development of context-aware applications. Complex event processing (CEP) is a technology for real-time data processing. However, a single node of CEP engine cannot keep up with the demand of high performance facing on the growing volume of sensor data. Many researches have focused on distributed complex event processing. In this paper, we propose a solution of distributed CEP based on pub/sub mechanism; by leveraging the loose coupling characteristics of pub/sub, it is easy to scale the system. The persistence storage and master–slave structure of the message broker also provide high reliability. Furthermore, we develop a configuration module for users to describe a complex event processing flow by a directed acyclic graph (DAG). The performance evaluation experiment demonstrates that our approach works well with large data set.

[1]  David M. Eyers,et al.  TrustCEP: Adopting a Trust-Based Approach for Distributed Complex Event Processing , 2017, 2017 18th IEEE International Conference on Mobile Data Management (MDM).

[2]  Carlo Curino,et al.  Apache Hadoop YARN: yet another resource negotiator , 2013, SoCC.

[3]  Kurt Rothermel,et al.  Distributed heterogeneous event processing: enhancing scalability and interoperability of CEP in an industrial context , 2010, DEBS '10.

[4]  Srinath Perera,et al.  Wihidum: Distributed complex event processing , 2015, J. Parallel Distributed Comput..

[5]  Thomas Plagemann,et al.  DCEP-Sim: An Open Simulation Framework for Distributed CEP , 2017, DEBS.

[6]  Kurt Rothermel,et al.  Supporting Strong Reliability for Distributed Complex Event Processing Systems , 2011, 2011 IEEE International Conference on High Performance Computing and Communications.

[7]  Dimitrios Gunopulos,et al.  Elastic complex event processing exploiting prediction , 2015, 2015 IEEE International Conference on Big Data (Big Data).