Web service reliability prediction based on machine learning

Abstract Web service reliability is an important mission that keeps web services running normally. Within web service, the web services invoked by users not only depend on the service itself, but also on web load condition (such as latency). Due to the features of web dynamics, traditional reliability methods have become inappropriate; at the same time, the web condition parameter sparsity problem will cause inaccurate reliability prediction. To address these new challenges, in this paper, we propose a new web service reliability prediction method based on machine learning considering user, web service and web condition. First we solve the web condition parameter sparsity problem, then we use the k-means clustering method to aggregate past invocation data, incorporate user, service, and web condition parameters to build a reliability feedback matrix, at last we predict web service reliability by considering specific web condition environments. The experiment shows that our machine learning method is able to solve the data sparsity problem and improve accurate web service reliability prediction, and we discuss how data sparsity and the number of feedback clusters to affect web service reliability prediction.

[1]  Haibing Guan,et al.  Towards high-quality I/O virtualization , 2009, SYSTOR '09.

[2]  Yoav Shoham,et al.  Fab: content-based, collaborative recommendation , 1997, CACM.

[3]  Boualem Benatallah,et al.  Web Service Composition , 2015 .

[4]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[5]  Anne H. H. Ngu,et al.  QoS computation and policing in dynamic web service selection , 2004, WWW Alt. '04.

[6]  Junfeng Zhao,et al.  Personalized QoS Prediction forWeb Services via Collaborative Filtering , 2007, IEEE International Conference on Web Services (ICWS 2007).

[7]  Linpeng Huang,et al.  A Web service QoS prediction approach based on time- and location-aware collaborative filtering , 2014, Service Oriented Computing and Applications.

[8]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[9]  John Riedl,et al.  An algorithmic framework for performing collaborative filtering , 1999, SIGIR '99.

[10]  Yasushi Inoguchi,et al.  Improving accuracy of host load predictions on computational grids by artificial neural networks , 2011, Int. J. Parallel Emergent Distributed Syst..

[11]  T. Senjyu,et al.  Neural networks approach to forecast several hour ahead electricity prices and loads in deregulated market , 2006 .

[12]  Chenyang Lu,et al.  Reliable clinical monitoring using wireless sensor networks: experiences in a step-down hospital unit , 2010, SenSys '10.

[13]  Harald C. Gall,et al.  Cross-project defect prediction: a large scale experiment on data vs. domain vs. process , 2009, ESEC/SIGSOFT FSE.

[14]  Gerhard Nahler,et al.  Pearson Correlation Coefficient , 2020, Definitions.

[15]  Serge Mankovskii,et al.  Service Oriented Architecture , 2009, Encyclopedia of Database Systems.

[16]  Yutaka Tsuchiya,et al.  Average Value Method: A New Approach to Practical Optical Computed Tomography for a Turbid Medium Such as Human Tissue. , 1998 .

[17]  Anne H. H. Ngu,et al.  QoS-aware middleware for Web services composition , 2004, IEEE Transactions on Software Engineering.

[18]  Kishor S. Trivedi,et al.  MODELING USER-PERCEIVED RELIABILITY BASED ON USER BEHAVIOR GRAPHS , 2009 .

[19]  K. Krishna,et al.  Genetic K-means algorithm. , 1999, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society.

[20]  Jana Koehler,et al.  Web Service Composition - Current Solutions and Open Problems , 2003 .

[21]  G. Brassington,et al.  Mean absolute error and root mean square error: which is the better metric for assessing model performance? , 2017 .

[22]  Zibin Zheng,et al.  Collaborative reliability prediction of service-oriented systems , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[23]  Vincenzo Grassi,et al.  Reliability Modeling and Analysis of Service-Oriented Architectures , 2007, Test and Analysis of Web Services.

[24]  Nicolas Monmarché,et al.  AntClust: Ant Clustering and Web Usage Mining , 2003, GECCO.

[25]  Pedro Larrañaga,et al.  An empirical comparison of four initialization methods for the K-Means algorithm , 1999, Pattern Recognit. Lett..

[26]  Nikos A. Vlassis,et al.  The global k-means clustering algorithm , 2003, Pattern Recognit..

[27]  T.V. Prabhakar,et al.  Dynamic selection of Web services with recommendation system , 2005, International Conference on Next Generation Web Services Practices (NWeSP'05).

[28]  Liu Qinghua,et al.  A Global QoS Optimizing Web Services Selection Algorithm Based on MOACO for Dynamic Web Service Composition , 2009, 2009 International Forum on Information Technology and Applications.

[29]  Zibin Zheng,et al.  WS-DREAM: A distributed reliability assessment Mechanism for Web Services , 2008, 2008 IEEE International Conference on Dependable Systems and Networks With FTCS and DCC (DSN).

[30]  Amin Vahdat,et al.  Differentiated multimedia Web services using quality aware transcoding , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[31]  Nanning Zheng,et al.  Similarity Learning with Spatial Constraints for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Thomas Hofmann,et al.  Unifying collaborative and content-based filtering , 2004, ICML.

[33]  Yoav Shoham,et al.  Content-Based, Collaborative Recommendation. , 1997 .

[34]  Mehrbakhsh Nilashi,et al.  Collaborative filtering recommender systems , 2013 .