Assessing the Performance Impact of Service Monitoring

Service monitoring is an essential part of service-oriented software systems and is required for meeting regulatory requirements, verifying compliance to service-level agreements, optimising system performance, and minimising the cost of hosting Web services. However, service monitoring comes with a cost, including a performance impact on the monitored services and systems. Therefore, it is important to deploy the right level of monitoring at the appropriate time and location in order to achieve the objectives of monitoring whilst minimising its impact on services and systems. Although there have been many efforts to create Web services monitoring techniques and frameworks, there has been limited work in quantifying theim pact of Web service monitoring. In this paper, we report on experiments assessing the performance impact of service monitoring under typical system monitoring settings. The performance impact of monitoring method, monitor location, monitor processing capability, and monitoring mode are taken into consideration. Based on the experimental results, we advise on the most appropriate ways to deploy service monitoring.

[1]  Reiko Heckel,et al.  Automatic Conformance Testing of Web Services , 2005, FASE.

[2]  Zheng Li,et al.  A runtime monitoring and validation framework for Web service interactions , 2006, Australian Software Engineering Conference (ASWEC'06).

[3]  Koustuv Dasgupta,et al.  Adaptation inWeb Service Composition and Execution , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[4]  Nuno Laranjeiro,et al.  Benchmarking the Robustness of Web Services , 2007, 13th Pacific Rim International Symposium on Dependable Computing (PRDC 2007).

[5]  George Spanoudakis,et al.  Run-time monitoring of requirements for systems composed of Web-services: initial implementation and evaluation experience , 2005, IEEE International Conference on Web Services (ICWS'05).

[6]  Jocelyn Simmonds,et al.  Runtime Monitoring of Web Service Conversations , 2007, IEEE Transactions on Services Computing.

[7]  Ian T. Foster,et al.  DiPerF: an automated distributed performance testing framework , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[8]  Fabio Casati,et al.  Automated SLA Monitoring for Web Services , 2002, DSOM.

[9]  Helmut Reiser,et al.  Monitoring Quality of Service across Organizational Boundaries , 2000, USM.

[10]  Yi Xiao,et al.  SOA-Based Service Recovery Framework , 2008, 2008 The Ninth International Conference on Web-Age Information Management.

[11]  Wolfgang Emmerich,et al.  A Model-Driven Architecture for Electronic Service Management Systems , 2003, ICSOC.

[12]  Heiko Ludwig,et al.  Defining and Monitoring Service-Level Agreements for Dynamic e-Business , 2002, LISA.

[13]  Paulo F. Pires,et al.  Monitoring e-business Web services usage through a log based architecture , 2004 .

[14]  Gerardo Canfora,et al.  Search-based testing of service level agreements , 2007, GECCO '07.

[15]  Luciano Baresi,et al.  Towards Dynamic Monitoring of WS-BPEL Processes , 2005, ICSOC.

[16]  Mike P. Papazoglou,et al.  Service oriented architectures: approaches, technologies and research issues , 2007, The VLDB Journal.

[17]  Hong Linh Truong,et al.  Towards a Framework for Monitoring and Analyzing QoS Metrics of Grid Services , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[18]  Onyeka Ezenwoye,et al.  Enabling Robustness in Existing BPEL Processes , 2006, ICEIS.

[19]  Arthur H. M. ter Hofstede,et al.  Formal description of non-functional service properties , 2005 .

[20]  Schahram Dustdar,et al.  Bootstrapping Performance and Dependability Attributes ofWeb Services , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[21]  Marco Aiello,et al.  Planning and monitoring the execution of web service requests , 2003, International Journal on Digital Libraries.

[22]  Mohsen Rouached,et al.  Analysis of Composite Web Services Using Logging Facilities , 2006, ICSOC Workshops.

[23]  Marco Aiello,et al.  Associating assertions with business processes and monitoring their execution , 2004, ICSOC '04.

[24]  George Spanoudakis,et al.  A framework for requirents monitoring of service based systems , 2004, ICSOC '04.

[25]  Hartmut Ritter,et al.  Efficient Selection and Monitoring of QoS-Aware Web Services with the WS-QoS Framework , 2004, IEEE/WIC/ACM International Conference on Web Intelligence (WI'04).

[26]  Colin Atkinson,et al.  Strategies for the Run-Time Testing of Third Party Web Services , 2007, IEEE International Conference on Service-Oriented Computing and Applications (SOCA '07).

[27]  Xiuzhen Zhang,et al.  Predicting Defective Software Components from Code Complexity Measures , 2007 .

[28]  Kavitha Ranganathan,et al.  Proactive Management of Service Instance Pools for Meeting Service Level Agreements , 2005, ICSOC.

[29]  Raymond A. Paul,et al.  Adaptive testing, oracle generation, and test case ranking for Web services , 2005, 29th Annual International Computer Software and Applications Conference (COMPSAC'05).

[30]  Raymond A. Paul,et al.  Automated model checking and testing for composite Web services , 2005, Eighth IEEE International Symposium on Object-Oriented Real-Time Distributed Computing (ISORC'05).

[31]  Soo-Ho Chang,et al.  The LLAMA Middleware Support for Accountable Service-Oriented Architecture , 2008, ICSOC.

[32]  L. O'Brien Lero,et al.  Quality Attributes for Service-Oriented Architectures , 2007, International Workshop on Systems Development in SOA Environments (SDSOA'07: ICSE Workshops 2007).

[33]  Asit Dan,et al.  Cremona: an architecture and library for creation and monitoring of WS-agreents , 2004, ICSOC '04.

[34]  Amit P. Sheth,et al.  Modeling Quality of Service for Workflows and Web Service Processes , 2002 .

[35]  Xiang Fu,et al.  Analyzing conversations of Web services , 2006, IEEE Internet Computing.

[36]  G. Spanoudakis,et al.  A Framework for Requirements Monitoring of Service Based Systems , 2004 .

[37]  George Spanoudakis,et al.  Non-Intrusive Monitoring of Service-Based Systems , 2006, Int. J. Cooperative Inf. Syst..

[38]  Karthikeyan Ponnalagu,et al.  Run-Time Adaptation of Non-functional Properties of Composite Web Services Using Aspect-Oriented Programming , 2007, ICSOC.

[39]  Wim Vanderperren,et al.  AOP for Dynamic Configuration and Management of Web Services , 2004, Int. J. Web Serv. Res..

[40]  Atul Singh,et al.  Using queries for distributed monitoring and forensics , 2006, EuroSys.

[41]  William N. Robinson,et al.  Monitoring Web service requirements , 2003, Proceedings. 11th IEEE International Requirements Engineering Conference, 2003..

[42]  Eric Wohlstadter,et al.  Transaction policies for service-oriented computing , 2004, Data Knowl. Eng..

[43]  Paulo F. Pires,et al.  Monitoring e-business Web services usage through a log based architecture , 2004, Proceedings. IEEE International Conference on Web Services, 2004..

[44]  Salima Benbernou,et al.  Run-Time Monitoring for Privacy-Agreement Compliance , 2007, ICSOC.

[45]  Raymond A. Paul,et al.  A robust testing framework for verifying Web services by completeness and consistency analysis , 2005, IEEE International Workshop on Service-Oriented System Engineering (SOSE'05).