A Recurrent Neural Network Based Approach for Web Service QoS Prediction

QoS (Quality of Service) is a series of widely used indicators for networked user-oriented online services such as SOAP/JSON based web services, serverless microservices or function services in the modern cloud market. Of which, response time and throughput are most important measurements which almost determine the whole user experience caused by underlying factors including network delay or congestion, fluctuating service computation performance at different system workload level, or constrained by cascading resource or service dependencies. It’s valuable to accurately predict QoS indicators under complex scenarios and conditions combination from archived history service experience dataset. In this paper, two subsets of real-world dataset named WS-DREAM were used, which collected 339 users’ records on 5825 web services. Based on related work and descriptive analysis, two QoS (response time and throughput) prediction models were proposed for classification and regression problems. A custom recurrent neural network(RNN) was proposed, which comprises stacked multiple LSTM(Long term and Short Term Memory) layers, several regularization techniques were used. Extensive experiments were conducted to verify the accuracy and efficiency of deep learning based approach comparing with 6 competitive machine learning approaches, including decision tree, AdaBoost, multilayer perceptron, XGBoost, LightGBM, and CatBoost. Results showed the prediction accuracy of most algorithms could reach more than 90%, and the proposed RNN based network showed a superior performance both at accuracy and efficiency than other approaches.

[1]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[2]  Zibin Zheng,et al.  Investigating QoS of Real-World Web Services , 2014, IEEE Transactions on Services Computing.

[3]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[4]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[5]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[6]  Chouki Tibermacine,et al.  An Encoder-Decoder Architecture for the Prediction of Web Service QoS , 2018, ESOCC.

[7]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[8]  Geoffrey E. Hinton,et al.  Training Recurrent Neural Networks , 2013 .

[9]  Fang-Fang Chua,et al.  A Machine Learning Model for Detection and Prediction of Cloud Quality of Service Violation , 2018, ICCSA.

[10]  Bhavani Thuraisingham.  Developing and Securing the Cloud , 2018 .

[11]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[12]  Zibin Zheng,et al.  Distributed QoS Evaluation for Real-World Web Services , 2010, 2010 IEEE International Conference on Web Services.

[13]  Tie-Yan Liu,et al.  LightGBM: A Highly Efficient Gradient Boosting Decision Tree , 2017, NIPS.

[14]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[15]  Le Van Thinh.  Qos prediction for web services based on Restricted Boltzmann Machines , 2017, J. Serv. Sci. Res..