Outlier Resilient Collaborative Web Service QoS Prediction

Nowadays, more and more Web services are provided by different enterprises and organizations. The proliferation of Web services makes it difficult for users to select the most appropriate Web services among numerous functionally identical or similar service candidates. Quality-of-Service (QoS) is widely employed for describing the non-functional characteristics of Web services, and it has become the key differentiator for service selection. However, users cannot invoke all Web services to obtain the corresponding QoS values due to high time cost and huge resource overhead. Thus, it is essential to predict unknown QoS values. Although various QoS prediction methods have been proposed, few of them have taken outliers into consideration, which may dramatically degrade the prediction performance. To overcome this limitation, we propose a robust collaborative QoS prediction method in this paper. Our method utilizes Cauchy loss to measure the discrepancy between the observed QoS values and the predicted ones. Owing to the robustness of Cauchy loss, our method is resilient to outliers. We further extend our method to provide time-aware QoS prediction results by taking the temporal information into consideration. Finally, we conduct extensive experiments on both static and dynamic datasets. The results demonstrate that our method is able to achieve better performance than state-of-the-art baseline methods.

[1]  Takeo Kanade,et al.  Robust L/sub 1/ norm factorization in the presence of outliers and missing data by alternative convex programming , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Ching-Hsien Hsu,et al.  Multiple Attributes QoS Prediction via Deep Neural Model with Contexts* , 2018, IEEE Transactions on Services Computing.

[3]  Fei Tony Liu,et al.  Isolation-Based Anomaly Detection , 2012, TKDD.

[4]  Sarathkumar Rangarajan Qos-Based Web Service Discovery And Selection Using Machine Learning , 2018, EAI Endorsed Trans. Scalable Inf. Syst..

[5]  Shanlin Yang,et al.  Time-aware cloud service recommendation using similarity-enhanced collaborative filtering and ARIMA model , 2018, Decis. Support Syst..

[6]  C. Müller,et al.  Breakdown points of Cauchy regression-scale estimators , 2002 .

[7]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[8]  C. Sneha,et al.  USER-BASED COLLABORATIVE-FILTERING RECOMMENDATION , 2015 .

[9]  Zhenyu He,et al.  Similarity-Maintaining Privacy Preservation and Location-Aware Low-Rank Matrix Factorization for QoS Prediction Based Web Service Recommendation , 2021, IEEE Transactions on Services Computing.

[10]  Junfeng Zhao,et al.  Personalized QoS Prediction forWeb Services via Collaborative Filtering , 2007, IEEE International Conference on Web Services (ICWS 2007).

[11]  Ching-Hsien Hsu,et al.  Collaborative QoS prediction with context-sensitive matrix factorization , 2017, Future Gener. Comput. Syst..

[12]  Hailong Sun,et al.  Temporal QoS-aware web service recommendation via non-negative tensor factorization , 2014, WWW.

[13]  Feng Li,et al.  Web service QoS prediction: when collaborative filtering meets data fluctuating in big-range , 2020, World Wide Web.

[14]  Stephan Günnemann,et al.  Introduction to Tensor Decompositions and their Applications in Machine Learning , 2017, ArXiv.

[15]  Anders P. Eriksson,et al.  Efficient computation of robust low-rank matrix approximations in the presence of missing data using the L1 norm , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Zibin Zheng,et al.  QoS Prediction of Web Services Based on Two-Phase K-Means Clustering , 2015, 2015 IEEE International Conference on Web Services.

[17]  Jie Cao,et al.  Hybrid Collaborative Filtering algorithm for bidirectional Web service recommendation , 2012, Knowledge and Information Systems.

[18]  Yandong Tang,et al.  Robust Tensor Factorization with Unknown Noise , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Zhaohui Wu,et al.  Efficient web service QoS prediction using local neighborhood matrix factorization , 2015, Eng. Appl. Artif. Intell..

[20]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[21]  Zibin Zheng,et al.  Covering-Based Web Service Quality Prediction via Neighborhood-Aware Matrix Factorization , 2019, IEEE Transactions on Services Computing.

[22]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[23]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[24]  Guoyin Wang,et al.  A Data-Aware Latent Factor Model for Web Service QoS Prediction , 2019, PAKDD.

[25]  Xiong Luo,et al.  Web Service QoS Prediction Based on Adaptive Dynamic Programming Using Fuzzy Neural Networks for Cloud Services , 2015, IEEE Access.

[26]  Dacheng Tao,et al.  Multi-View Intact Space Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Shuicheng Yan,et al.  Practical low-rank matrix approximation under robust L1-norm , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Zhiliang Zhu,et al.  WS-SCAN: A effective approach for web services clustering , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[29]  Lei Zhang,et al.  A Cyclic Weighted Median Method for L1 Low-Rank Matrix Factorization with Missing Entries , 2013, AAAI.

[30]  Chuan Chen,et al.  An Embedding Based Factorization Machine Approach for Web Service QoS Prediction , 2017, ICSOC.

[31]  Zibin Zheng,et al.  QoS-Aware Web Service Recommendation via Collaborative Filtering , 2014, Web Services Foundations.

[32]  Yvonne Freeh,et al.  An R and S–PLUS Companion to Applied Regression , 2004 .

[33]  MengChu Zhou,et al.  Temporal Pattern-Aware QoS Prediction via Biased Non-Negative Latent Factorization of Tensors , 2020, IEEE Transactions on Cybernetics.

[34]  Jiajie Xu,et al.  Differential private collaborative Web services QoS prediction , 2018, World Wide Web.

[35]  Shuang Xu,et al.  Adaptive Quantile Low-Rank Matrix Factorization , 2019, Pattern Recognit..

[36]  Zibin Zheng,et al.  Personalized Reliability Prediction of Web Services , 2013, TSEM.

[37]  G. Box,et al.  Distribution of Residual Autocorrelations in Autoregressive-Integrated Moving Average Time Series Models , 1970 .

[38]  Liangli Ma,et al.  Web service QoS prediction by neighbor information combined non-negative matrix factorization , 2016, J. Intell. Fuzzy Syst..

[39]  Mingsheng Shang,et al.  A momentum-incorporated latent factorization of tensors model for temporal-aware QoS missing data prediction , 2019, Neurocomputing.

[40]  Maude Manouvrier,et al.  TQoS: Transactional and QoS-Aware Selection Algorithm for Automatic Web Service Composition , 2010, IEEE Transactions on Services Computing.

[41]  Zongpeng Li,et al.  Robust web service recommendation via quantile matrix factorization , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[42]  Yao Wang,et al.  Low-Rank Matrix Factorization under General Mixture Noise Distributions , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[43]  Paolo Traverso,et al.  Service-Oriented Computing: State of the Art and Research Challenges , 2007, Computer.

[44]  Zibin Zheng,et al.  Location-Based Hierarchical Matrix Factorization for Web Service Recommendation , 2014, 2014 IEEE International Conference on Web Services.

[45]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[46]  Liang Chen,et al.  A service computing manifesto , 2017 .

[47]  Shie Mannor,et al.  Sparse Algorithms Are Not Stable: A No-Free-Lunch Theorem , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Zibin Zheng,et al.  QoS-Aware Web Service Recommendation by Collaborative Filtering , 2011, IEEE Transactions on Services Computing.

[49]  Deyu Meng,et al.  Robust Matrix Factorization with Unknown Noise , 2013, 2013 IEEE International Conference on Computer Vision.

[50]  Larry S. Davis,et al.  Truncated Cauchy Non-Negative Matrix Factorization , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Hao Wu,et al.  QoS-Aware Web Service Recommendation with Reinforced Collaborative Filtering , 2018, ICSOC.

[52]  Richong Zhang,et al.  Predicting the Quality of Web Services Based on User Stability , 2016, 2016 IEEE International Conference on Services Computing (SCC).

[53]  Bin Xiao,et al.  TAP: A personalized trust-aware QoS prediction approach for web service recommendation , 2017, Knowl. Based Syst..

[54]  Lars Grunske,et al.  An automated approach to forecasting QoS attributes based on linear and non-linear time series modeling , 2012, 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering.

[55]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[56]  Zibin Zheng,et al.  A Location-Based Factorization Machine Model for Web Service QoS Prediction , 2021, IEEE Transactions on Services Computing.

[57]  Zibin Zheng,et al.  WSPred: A Time-Aware Personalized QoS Prediction Framework for Web Services , 2011, 2011 IEEE 22nd International Symposium on Software Reliability Engineering.

[58]  Xuelong Li,et al.  Robust Subspace Clustering by Cauchy Loss Function , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[59]  Kyong-Ho Lee,et al.  Outlier-robust web service selection based on a probabilistic QoS model , 2016, Int. J. Web Grid Serv..

[60]  Zibin Zheng,et al.  Online QoS Prediction for Runtime Service Adaptation via Adaptive Matrix Factorization , 2017, IEEE Transactions on Parallel and Distributed Systems.

[61]  Yan Yan,et al.  $L_{1}$ -Norm Low-Rank Matrix Factorization by Variational Bayesian Method , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[62]  Zibin Zheng,et al.  Collaborative reliability prediction of service-oriented systems , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[63]  Jian Wang,et al.  Personalized LSTM Based Matrix Factorization for Online QoS Prediction , 2018, 2018 IEEE International Conference on Web Services (ICWS).

[64]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[65]  Guoyin Wang,et al.  A Posterior-Neighborhood-Regularized Latent Factor Model for Highly Accurate Web Service QoS Prediction , 2022, IEEE Transactions on Services Computing.

[66]  Bo Jiang,et al.  L1-norm Error Function Robustness and Outlier Regularization , 2017, ArXiv.

[67]  Zibin Zheng,et al.  Asymmetric Correlation Regularized Matrix Factorization for Web Service Recommendation , 2016, 2016 IEEE International Conference on Web Services (ICWS).

[68]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[69]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[70]  Zibin Zheng,et al.  Web Service Personalized Quality of Service Prediction via Reputation-Based Matrix Factorization , 2016, IEEE Transactions on Reliability.

[71]  Jonathan T. Barron,et al.  A General and Adaptive Robust Loss Function , 2017, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[72]  Mingdong Tang,et al.  An Effective Web Service Recommendation Method Based on Personalized Collaborative Filtering , 2011, 2011 IEEE International Conference on Web Services.