Monitoring Service Compositions in MoDe4SLA - Design of Validation

In previous research we introduced the MoDe4SLA approach for monitoring service compositions. MoDe4SLA identifies complex dependencies between Service Level Agreements (SLAs) in a service composition. By explicating these dependencies, causes of SLA violations of a service might be explained by malfunctioning of the services it depends on. MoDe4SLA assists managers in identifying such causes. In this paper we discuss how to evaluate our approach concerning usefulness for the user as well as effectiveness for the business. Usefulness is evaluated by experts who are asked to manage simulated runs of service compositions using MoDe4SLA. Their opinion on the approach is an indicator for its usefulness. Effectiveness is evaluated by comparing runtime results of SLA management using MoDe4SLA with runtime results of unsupported management. Criteria for effectiveness are cost reduction and increase in customer satisfaction.

[1]  Amit P. Sheth,et al.  Modeling Quality of Service for Workflows and Web Service Processes , 2002 .

[2]  Manish Gupta,et al.  Problem Determination Using Dependency Graphs and Run-Time Behavior Models , 2004, DSOM.

[3]  Fabio Casati,et al.  Automated SLA Monitoring for Web Services , 2002, DSOM.

[4]  Wil M. P. van der Aalst,et al.  Workflow Patterns , 2003, Distributed and Parallel Databases.

[5]  Marco Pistore,et al.  Run-Time Monitoring of Instances and Classes of Web Service Compositions , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[6]  Srinivas Ramanathan,et al.  Using service models for management of Internet services , 2000, IEEE Journal on Selected Areas in Communications.

[7]  Gero Mühl,et al.  QoS aggregation for Web service composition using workflow patterns , 2004 .

[8]  Luciano Baresi,et al.  Towards Dynamic Monitoring of WS-BPEL Processes , 2005, ICSOC.

[9]  Luciano Baresi,et al.  Smart monitors for composed services , 2004, ICSOC '04.

[10]  Michael C. Jäger,et al.  SENECA - Simulation of Algorithms for the Selection of Web Services for Compositions , 2005, TES.

[11]  Axel Keller,et al.  The virtual resource manager: an architecture for SLA-aware resource management , 2004, IEEE International Symposium on Cluster Computing and the Grid, 2004. CCGrid 2004..

[12]  Wil M. P. van der Aalst,et al.  Workflow Patterns , 2004, Distributed and Parallel Databases.

[13]  DumasMarlon,et al.  QoS-Aware Middleware for Web Services Composition , 2004 .

[14]  Daniel A. Menascé,et al.  Response-time analysis of composite Web services , 2004, IEEE Internet Computing.

[15]  Vladimir Tosic,et al.  Management applications of the Web Service Offerings Language (WSOL) , 2005, Inf. Syst..

[16]  George Spanoudakis,et al.  Run-time monitoring of requirements for systems composed of Web-services: initial implementation and evaluation experience , 2005, IEEE International Conference on Web Services (ICWS'05).

[17]  Manfred Reichert,et al.  Monitoring Dependencies for SLAs: The MoDe4SLA Approach , 2008, 2008 IEEE International Conference on Services Computing.

[18]  Anne H. H. Ngu,et al.  QoS-aware middleware for Web services composition , 2004, IEEE Transactions on Software Engineering.