A scalable complex event processing system and evaluations of its performance

This paper describes a scalable context delivery platform (SCTXPF) and our evaluations of it. The SCTXPF receives a large number of events from various event sources and a large number of complex event processing (CEP) rules from various services/applications. The SCTXPF achieves load distribution of CEP operations by parallelizing event processors (EPs) and allocating CEP rules to each EP. The SCTXPF should allocate CEP rules efficiently to be able to operate with a high level of performance and be scalable. The rule allocation algorithm allocates the CEP rules to EPs so that the state of event processing is efficiently managed. The SCTXPF achieves high throughput and scalable CEP with the EPs operating independently of one another. We evaluated the efficiency of the rule allocation algorithm in terms of scalability and performance. The results revealed that the proposed system is scalable and the performance reached 2,700,000 events/sec and the proposed algorithm improves its scalability.

[1]  Tadashi Sato,et al.  SCTXPF: Scalable Context Delivery Platform , 2011, 2011 IEEE International Conference on Communications Workshops (ICC).

[2]  D. Luckham The Power of Events , 2002 .

[3]  Kurt Rothermel,et al.  Distributed heterogeneous event processing: enhancing scalability and interoperability of CEP in an industrial context , 2010, DEBS '10.

[4]  Leonardo Neumeyer,et al.  S4: Distributed Stream Computing Platform , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[5]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, TOCS.

[6]  Opher Etzion,et al.  A stratified approach for supporting high throughput event processing applications , 2009, DEBS '09.

[7]  Yongheng Wang,et al.  High-performance complex event processing for large-scale RFID applications , 2010, 2010 2nd International Conference on Signal Processing Systems.

[8]  Patrick Valduriez,et al.  StreamCloud: A Large Scale Data Streaming System , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.