Spatio-temporal context-aware collaborative QoS prediction

Abstract With the exponential growth of Web services, various collaborative QoS prediction methods have been suggested to make an efficient evaluation of quality-of-services (QoS) and assist users selecting appropriate services. It is still a technical challenge to be taken into account the impact of complex spatio-temporal contexts of service invocations and make use of their characteristics in the forecasting process. To this end, we propose two universal spatio-temporal context-aware collaborative neural models (STCA-1 and STCA-2) to make QoS prediction by considering invocation time and multiple spatial features both of service-side and user-side. Our proposed models utilize hierarchical neural networks to realize the embedding expression of original features, the generation of second-order features, the fusion of first-order and second-order features, the interaction between spatial features and temporal features layer by layer. In particular, attention mechanism is introduced to automatically assign weights to spatial features and realize the discriminative application in feature fusion. Experiments on a large-scale dataset demonstrate the effectiveness of the proposed method: (1) The prediction error can be significantly reduced in comparison with the baseline methods particularly in the case of sparse training data, where our models achieve a performance improvement by about 10.9–21.0% in term of MAE and NMAE, and by 2.4–7.8% in term of RMSE. (2) Attention mechanisms enable us to give intuitive explanations of the effectiveness of feature fusion more reasonably and thus strengthen the interpretability of the prediction models.

[1]  Jianwei Yin,et al.  Context-aware QoS prediction for web service recommendation and selection , 2016, Expert Syst. Appl..

[2]  Zhaohui Wu,et al.  Efficient web service QoS prediction using local neighborhood matrix factorization , 2015, Eng. Appl. Artif. Intell..

[3]  Xiaohui Hu,et al.  A Time-Aware and Data Sparsity Tolerant Approach for Web Service Recommendation , 2014, 2014 IEEE International Conference on Web Services.

[4]  Klaus-Robert Müller,et al.  Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models , 2017, ArXiv.

[5]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[6]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[7]  Zibin Zheng,et al.  A Spatial-Temporal QoS Prediction Approach for Time-aware Web Service Recommendation , 2016, ACM Trans. Web.

[8]  Wei Xiong,et al.  A Learning Approach to QoS Prediction via Multi-Dimensional Context , 2017, 2017 IEEE International Conference on Web Services (ICWS).

[9]  Jinjun Chen,et al.  Cloud service QoS prediction via exploiting collaborative filtering and location‐based data smoothing , 2015, Concurr. Comput. Pract. Exp..

[10]  Zibin Zheng,et al.  Web Service Recommendation via Exploiting Location and QoS Information , 2014, IEEE Transactions on Parallel and Distributed Systems.

[11]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[12]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[13]  Ching-Hsien Hsu,et al.  Collaborative QoS prediction with context-sensitive matrix factorization , 2017, Future Gener. Comput. Syst..

[14]  Zibin Zheng,et al.  Personalized Web Service Recommendation via Normal Recovery Collaborative Filtering , 2013, IEEE Transactions on Services Computing.

[15]  Jun Wang,et al.  Product-Based Neural Networks for User Response Prediction , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[16]  Zibin Zheng,et al.  CASR-TSE: Context-Aware Web Services Recommendation for Modeling Weighted Temporal-Spatial Effectiveness , 2017 .

[17]  Wei-Tek Tsai,et al.  On Testing and Evaluating Service-Oriented Software , 2008, Computer.

[18]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[19]  Ching-Hsien Hsu,et al.  Towards increasing reliability of clouds environments with RESTful web services , 2017, Future Gener. Comput. Syst..

[20]  Wensheng Tang,et al.  Multi-valued collaborative QoS prediction for cloud service via time series analysis , 2017, Future Gener. Comput. Syst..

[21]  A. Ng Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[22]  Antonio Pescapè,et al.  Integration of Cloud computing and Internet of Things: A survey , 2016, Future Gener. Comput. Syst..

[23]  Zibin Zheng,et al.  QoS-Aware Web Service Recommendation by Collaborative Filtering , 2011, IEEE Transactions on Services Computing.

[24]  Xin Yan,et al.  Linear Regression Analysis: Theory and Computing , 2009 .

[25]  Yoav Goldberg,et al.  A Primer on Neural Network Models for Natural Language Processing , 2015, J. Artif. Intell. Res..

[26]  Tat-Seng Chua,et al.  Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks , 2017, IJCAI.

[27]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[28]  Zibin Zheng,et al.  Location-Based Hierarchical Matrix Factorization for Web Service Recommendation , 2014, 2014 IEEE International Conference on Web Services.

[29]  Linpeng Huang,et al.  A Web service QoS prediction approach based on time- and location-aware collaborative filtering , 2014, Service Oriented Computing and Applications.

[30]  Jongmoon Baik,et al.  Location-Based Web Service QoS Prediction via Preference Propagation to Address Cold Start Problem , 2021, IEEE Transactions on Services Computing.

[31]  Charu C. Aggarwal,et al.  Neighborhood-Based Collaborative Filtering , 2016 .

[32]  Zibin Zheng,et al.  WSPred: A Time-Aware Personalized QoS Prediction Framework for Web Services , 2011, 2011 IEEE 22nd International Symposium on Software Reliability Engineering.

[33]  Ching-Hsien Hsu,et al.  Multiple Attributes QoS Prediction via Deep Neural Model with Contexts* , 2018, IEEE Transactions on Services Computing.

[34]  Zibin Zheng,et al.  Predicting Quality of Service for Selection by Neighborhood-Based Collaborative Filtering , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Bo Cheng,et al.  Multi-Dimensional QoS Prediction for Service Recommendations , 2019, IEEE Transactions on Services Computing.

[36]  Zibin Zheng,et al.  Collaborative Web Service QoS Prediction via Neighborhood Integrated Matrix Factorization , 2013, IEEE Transactions on Services Computing.