A Dynamic Complex Event Processing Architecture for Cloud Monitoring and Analysis

Cloud monitoring and analysis are challenging tasks that have recently been addressed by Complex Event Processing (CEP) techniques. CEP systems can process many incoming event streams and execute continuously running queries to analyze the behavior of a Cloud. Based on a Cloud performance monitoring and analysis use case, this paper experimentally evaluates different CEP architectures in terms of precision, recall and other performance indicators. The results of the experimental comparison are used to propose a novel dynamic CEP architecture for Cloud monitoring and analysis. The novel dynamic CEP architecture is designed to dynamically switch between different centralized and distributed CEP architectures depending on the current machine load and network traffic conditions in the observed Cloud environment.

[1]  Schahram Dustdar,et al.  Application-level performance monitoring of cloud services based on the complex event processing paradigm , 2012, 2012 Fifth IEEE International Conference on Service-Oriented Computing and Applications (SOCA).

[2]  Grzegorz Dyk,et al.  GRID MONITORING BASED ON COMPLEX EVENT PROCESSING TECHNOLOGIES , 2010 .

[3]  Mohamed Jmaiel,et al.  AOP4CSM: An Aspect-Oriented Programming Approach for Cloud Service Monitoring , 2011, 2011 IEEE 11th International Conference on Computer and Information Technology.

[4]  Y. Heyden,et al.  Robust statistics in data analysis — A review: Basic concepts , 2007 .

[5]  Alessandro Margara,et al.  Processing flows of information: From data stream to complex event processing , 2012, CSUR.

[6]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[7]  Luciano Baresi,et al.  Event-Based Multi-level Service Monitoring , 2013, 2013 IEEE 20th International Conference on Web Services.

[8]  Miroslaw Malek,et al.  A survey of online failure prediction methods , 2010, CSUR.

[9]  William von Hagen.  Professional XEN Virtualization , 2008 .

[10]  Mia Hubert,et al.  Robust statistics for outlier detection , 2011, WIREs Data Mining Knowl. Discov..

[11]  Ricardo Gomes Clemente,et al.  HOLMES: an event-driven solution to monitor data centers through continuous queries and machine learning , 2010, DEBS '10.

[12]  Ludmila Cherkasova,et al.  XenMon: QoS Monitoring and Performance Profiling Tool , 2005 .