An Approach of QoS Evaluation for Web Services Design With Optimized Avoidance of SLA Violations

Quality of service (QoS) is an o cial agreement that governs the contractual commitments between service providers and consumers in respect to various nonfunctional requirements, such as performance, dependability, and security. While more Web services are available for the construction of software systems based upon service-oriented architecture (SOA), QoS has become a decisive factor for service consumers to choose from service providers who provide similar services. QoS is usually documented on a service-level agreement (SLA) to ensure the functionality and quality of services and to de ne monetary penalties in case of any violation of the written agreement. Consequently, service providers have a strong interest in keeping their commitments to avoid and reduce the situations that may cause SLA violations. However, there is a noticeable shortage of tools that can be used by service providers to either quantitively evaluate QoS of their services for the predication of SLA violations or actively adjust their design for the avoidance of SLA violations with optimized service recon gurations. Developed in this dissertation research is an innovative framework that tackles the problem of SLA violations in three separated yet connected phases. For a given SOA system under examination, the framework employs sensitivity analysis in the rst phase to identify factors that are in uential to system performance, and the impact of in uential factors on QoS is then quantitatively measured with a metamodel-based analysis in the second phase. The results of analyses are then used in the third phase to search both globally and locally for optimal solutions via a controlled number of experiments. In addition to technical details, this dissertation includes experiment results to demonstrate that this new approach can help service providers not only predicting SLA violations but also avoiding the unnecessary increase of the operational cost during service optimization.

[1]  Zibin Zheng,et al.  Online QoS Prediction for Runtime Service Adaptation via Adaptive Matrix Factorization , 2017, IEEE Transactions on Parallel and Distributed Systems.

[2]  Patrick Willems,et al.  Global sensitivity analysis of yield output from the water productivity model , 2014, Environ. Model. Softw..

[3]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[4]  Chung-Horng Lung,et al.  An Approach to Quantitative Software Architecture Sensitivity Analysis , 2000, Int. J. Softw. Eng. Knowl. Eng..

[5]  Charles B. Roosen,et al.  An introduction to multivariate adaptive regression splines , 1995, Statistical methods in medical research.

[6]  Marjorie Musy,et al.  Application of sensitivity analysis in building energy simulations: combining first and second order elementary effects Methods , 2012, ArXiv.

[7]  Harris Wu,et al.  A flexible QoS-aware Web service composition method by multi-objective optimization in cloud manufacturing , 2016, Comput. Ind. Eng..

[8]  Joshua Zhexue Huang,et al.  Web services: problems and future directions , 2004, J. Web Semant..

[9]  Lei Wang,et al.  Two-stage approach for reliable dynamic Web service composition , 2016, Knowl. Based Syst..

[10]  Zalmiyah Zakaria,et al.  Quality of Service (QoS) Task Scheduling Algorithm with Taguchi Orthogonal Approach for Cloud Computing Environment , 2017 .

[11]  Mary Shaw,et al.  Software architecture - perspectives on an emerging discipline , 1996 .

[12]  Hasan Kurtaran,et al.  Application of response surface methodology in the optimization of cutting conditions for surface roughness , 2005 .

[13]  Zibin Zheng,et al.  An Online Performance Prediction Framework for Service-Oriented Systems , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Giuseppe Di Modica,et al.  Dynamic SLAs management in service oriented environments , 2009, J. Syst. Softw..

[15]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[16]  Youcef Baghdadi,et al.  A Literature Review on Service Identification Challenges in Service Oriented Architecture , 2018, KMO.

[17]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007, DAC 2006.

[18]  Mohd Fadzil Hassan,et al.  Renegotiation in Service Level Agreement Management for a Cloud-Based System , 2015, ACM Comput. Surv..

[19]  G. Gary Wang,et al.  ADAPTIVE RESPONSE SURFACE METHOD - A GLOBAL OPTIMIZATION SCHEME FOR APPROXIMATION-BASED DESIGN PROBLEMS , 2001 .

[20]  Zhaohui Wu,et al.  Mobile Service Selection for Composition: An Energy Consumption Perspective , 2017, IEEE Transactions on Automation Science and Engineering.

[21]  Badlishah Sham Baharin,et al.  Optimizing conditions for enzymatic clarification of banana juice using response surface methodology (RSM) , 2006 .

[22]  Junhao Wen,et al.  A New QoS-Aware Web Service Recommendation System Based on Contextual Feature Recognition at Server-Side , 2017, IEEE Transactions on Network and Service Management.

[23]  Karen A. Pitts,et al.  Fundamentals Concepts in the Design of Experiments , 1996 .

[24]  Fang-Fang Chua,et al.  A Machine Learning Model for Detection and Prediction of Cloud Quality of Service Violation , 2018, ICCSA.

[25]  Bin Xiao,et al.  TAP: A personalized trust-aware QoS prediction approach for web service recommendation , 2017, Knowl. Based Syst..

[26]  Linpeng Huang,et al.  A Web service QoS prediction approach based on time- and location-aware collaborative filtering , 2014, Service Oriented Computing and Applications.

[27]  Yizhong Wu,et al.  An adaptive metamodel-based global optimization algorithm for black-box type problems , 2015 .

[28]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[29]  Farshad Rahimpour,et al.  A modeling study by response surface methodology (RSM) and artificial neural network (ANN) on Cu2+ adsorption optimization using light expended clay aggregate (LECA) , 2014 .

[30]  Paul Clements,et al.  Software architecture in practice , 1999, SEI series in software engineering.

[31]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[32]  Elizabeth Chang,et al.  Risk-based framework for SLA violation abatement from the cloud service provider's perspective , 2018, Comput. J..

[33]  Xiaobu Yuan,et al.  Performance analysis of service-oriented architectures with multi-factor sensitivity analysis , 2007, 2007 IEEE International Conference on Electro/Information Technology.

[34]  Deniz Baş,et al.  Modeling and optimization I: Usability of response surface methodology , 2007 .

[35]  Praveen Dhyani,et al.  A Multi-Objective Optimization of Cloud Based SLA-Violation Prediction and Adaptation , 2016 .

[36]  David Garlan,et al.  A formal basis for architectural connection , 1997, TSEM.

[37]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[38]  John C. Grundy,et al.  A visual language and environment for composing web services , 2005, ASE.

[39]  Eoin Woods,et al.  Software Systems Architecture: Working with Stakeholders Using Viewpoints and Perspectives , 2005 .

[40]  Joseph G. Davis,et al.  Service Selection in Web Service Composition: A Comparative Review of Existing Approaches , 2014, Web Services Foundations.

[41]  Alexandru Iosup,et al.  On the Performance Variability of Production Cloud Services , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[42]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[43]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[44]  Zibin Zheng,et al.  Investigating QoS of Real-World Web Services , 2014, IEEE Transactions on Services Computing.

[45]  Qiang Yang,et al.  Transfer learning for collaborative filtering via a rating-matrix generative model , 2009, ICML '09.

[47]  Ching-Hsien Hsu,et al.  QoS prediction for service recommendations in mobile edge computing , 2017, J. Parallel Distributed Comput..

[48]  Pierre Sens,et al.  SLA guarantees for cloud services , 2016, Future Gener. Comput. Syst..

[49]  John C. Grundy,et al.  Deployed software component testing using dynamic validation agents , 2005, J. Syst. Softw..

[50]  Xin-She Yang,et al.  A literature survey of benchmark functions for global optimisation problems , 2013, Int. J. Math. Model. Numer. Optimisation.

[51]  Inderveer Chana,et al.  Q-aware: Quality of service based cloud resource provisioning , 2015, Comput. Electr. Eng..

[52]  Richard Craig Van Nostrand,et al.  Design of Experiments Using the Taguchi Approach: 16 Steps to Product and Process Improvement , 2002, Technometrics.

[53]  Ivan N. Vuchkov,et al.  Quality Improvement with Design of Experiments: A Response Surface Approach , 2001 .

[54]  Stephen J. H. Yang,et al.  An optimal QoS-based Web service selection scheme , 2009, Inf. Sci..

[55]  O. Alfano,et al.  Modeling and optimization of photo-Fenton degradation of 2,4-D using ferrioxalate complex and response surface methodology (RSM). , 2015, Journal of environmental management.

[56]  Farookh Khadeer Hussain,et al.  Risk Management Framework to Avoid SLA Violation in Cloud from a Provider's Perspective , 2016, 3PGCIC.

[57]  Xavier Franch,et al.  Quality models for web services: A systematic mapping , 2014, Inf. Softw. Technol..

[58]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[59]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[60]  Elizabeth Chang,et al.  Provider-Based Optimized Personalized Viable SLA (OPV-SLA) Framework to Prevent SLA Violation , 2016, Comput. J..

[61]  M. Lankhorst.  Enterprise Architecture at Work , 2013 .

[62]  David Gawn,et al.  Decision-making in IT service management: a simulation based approach , 2014, Decis. Support Syst..

[63]  Sheng Di,et al.  Host load prediction in a Google compute cloud with a Bayesian model , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[64]  George Q. Huang,et al.  Optimal service selection and composition for service-oriented manufacturing network , 2011, Int. J. Comput. Integr. Manuf..

[65]  Reiko Heckel,et al.  Towards Contract-based Testing of Web Services , 2005, Electron. Notes Theor. Comput. Sci..

[66]  Aad van Moorsel,et al.  Mitigating Provider Uncertainty in Service Provision Contracts , 2010, Economic Models and Algorithms for Distributed Systems.

[67]  Zibin Zheng,et al.  QoS-Aware Web Service Recommendation by Collaborative Filtering , 2011, IEEE Transactions on Services Computing.

[68]  Uwe Fink,et al.  Performance Solutions A Practical Guide To Creating Responsive Scalable Software , 2016 .

[69]  Joseph McMahan,et al.  An Architecture for Analysis , 2018, IEEE Micro.

[70]  Thomas Erl,et al.  SOA Principles of Service Design , 2007 .

[71]  Joseph A. Konstan,et al.  Rating-Based Collaborative Filtering: Algorithms and Evaluation , 2018, Social Information Access.

[72]  Adem Çiçek,et al.  Optimization of drilling parameters using Taguchi technique and response surface methodology (RSM) in drilling of AISI 304 steel with cryogenically treated HSS drills , 2013, Journal of Intelligent Manufacturing.

[73]  San-Yih Hwang,et al.  Service Selection for Web Services with Probabilistic QoS , 2015, IEEE Transactions on Services Computing.

[74]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[75]  Keqin Li,et al.  Minimizing SLA violation and power consumption in Cloud data centers using adaptive energy-aware algorithms , 2017, Future Gener. Comput. Syst..

[76]  Roberto J. Bayardo,et al.  Vinci: a service-oriented architecture for rapid development of web applications , 2001, WWW '01.

[77]  David Lehký,et al.  Neural network ensemble-based parameter sensitivity analysis in civil engineering systems , 2017, Neural Computing and Applications.

[78]  Carlo Meloni,et al.  Uncertainty Management in Simulation-Optimization of Complex Systems : Algorithms and Applications , 2015 .

[79]  Rajkumar Buyya,et al.  STAR: SLA-aware Autonomic Management of Cloud Resources , 2020, IEEE Transactions on Cloud Computing.

[80]  David Garlan,et al.  Architecture-Based Performance Analysis , 1998 .

[81]  Xiaobu Yuan,et al.  Analysis of Service-Oriented Architectures with Sensitivity Analysis , 2006, 2006 IEEE International Conference on Electro/Information Technology.

[82]  Daniel A. Menascé,et al.  QoS Issues in Web Services , 2002, IEEE Internet Comput..

[83]  Swapna S. Gokhale,et al.  Reliability prediction and sensitivity analysis based on software architecture , 2002, 13th International Symposium on Software Reliability Engineering, 2002. Proceedings..

[84]  B. Iooss,et al.  A Review on Global Sensitivity Analysis Methods , 2014, 1404.2405.

[85]  Kishor S. Trivedi,et al.  Architecture based analysis of performance, reliability and security of software systems , 2005, WOSP '05.

[86]  Kenneth Y. Goldberg,et al.  Eigentaste: A Constant Time Collaborative Filtering Algorithm , 2001, Information Retrieval.

[87]  Bruno Sudret,et al.  Polynomial chaos expansions and stochastic finite element methods , 2015 .

[88]  Christina Catley,et al.  Software Performance Engineering of a Web service-based Clinical Decision Support infrastructure , 2004, WOSP '04.

[89]  C. Murray Woodside,et al.  Software Resource Architecture , 2001, Int. J. Softw. Eng. Knowl. Eng..

[90]  Zibin Zheng,et al.  Collaborative Web Service QoS Prediction via Neighborhood Integrated Matrix Factorization , 2013, IEEE Transactions on Services Computing.

[91]  Faraz Saleem,et al.  Service Oriented Architecture for Cloud Computing , 2015 .

[92]  Xiaomeng Su,et al.  A Survey of Automated Web Service Composition Methods , 2004, SWSWPC.

[93]  Guan Zhou,et al.  An enhanced hybrid and adaptive meta-model based global optimization algorithm for engineering optimization problems , 2016 .

[94]  Robert B. Gramacy,et al.  Cases for the nugget in modeling computer experiments , 2010, Statistics and Computing.

[95]  Yuming Zhou,et al.  Predicting object-oriented software maintainability using multivariate adaptive regression splines , 2007, J. Syst. Softw..

[96]  John C. Grundy,et al.  Engineering plug‐in software components to support collaborative work , 2002, Softw. Pract. Exp..

[97]  Elizabeth Chang,et al.  Profile-Based Viable Service Level Agreement (SLA) Violation Prediction Model in the Cloud , 2015, 2015 10th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC).

[98]  J. Freidman,et al.  Multivariate adaptive regression splines , 1991 .

[99]  John Murphy,et al.  A framework for performance monitoring, modelling and prediction of component oriented distributed systems , 2002, WOSP '02.

[100]  Michael R. Lyu,et al.  Online QoS Prediction , 2017 .

[101]  Katerina Goseva-Popstojanova,et al.  Architecture-based approach to reliability assessment of software systems , 2001, Perform. Evaluation.

[102]  Ashutosh Kumar Singh,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2010 .

[103]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .