Host Load Prediction with Bi-directional Long Short-Term Memory in Cloud Computing

Host load prediction is the basic decision information for managing the computing resources usage on the cloud platform, its accuracy is critical for achieving the servicelevel agreement. Host load data in cloud environment is more high volatility and noise compared to that of grid computing, traditional data-driven methods tend to have low predictive accuracy when dealing with host load of cloud computing, Thus, we have proposed a host load prediction method based on Bidirectional Long Short-Term Memory (BiLSTM) in this paper. Our BiLSTM-based apporach improve the memory capbility and nonlinear modeling ability of LSTM and LSTM Encoder-Decoder (LSTM-ED), which is used in the recent previous work, In order to evaluate our approach, we have conducted experiments using a 1-month trace of a Google data centre with more than twelve thousand machines. our BiLSTM-based approach successfully achieves higher accuracy than other previous models, including the recent LSTM one and LSTM-ED one.

[1]  Yanjun Qi,et al.  CloudInsight: Utilizing a Council of Experts to Predict Future Cloud Application Workloads , 2018, 2018 IEEE 11th International Conference on Cloud Computing (CLOUD).

[2]  Yasushi Inoguchi,et al.  Improving accuracy of host load predictions on computational grids by artificial neural networks , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[3]  Guangwen Yang,et al.  Load prediction using hybrid model for computational grid , 2007, 2007 8th IEEE/ACM International Conference on Grid Computing.

[4]  Yu Zhou,et al.  Host Load Prediction Based on PSR and EA-GMDH for Cloud Computing System , 2013, 2013 International Conference on Cloud and Green Computing.

[5]  Sheng Di,et al.  Characterization and Comparison of Cloud versus Grid Workloads , 2012, 2012 IEEE International Conference on Cluster Computing.

[6]  Xifeng Yan,et al.  Workload characterization and prediction in the cloud: A multiple time series approach , 2012, 2012 IEEE Network Operations and Management Symposium.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Peter A. Dinda,et al.  Host load prediction using linear models , 2000, Cluster Computing.

[9]  Aniruddha S. Gokhale,et al.  Efficient Autoscaling in the Cloud Using Predictive Models for Workload Forecasting , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[10]  Richard E. Brown,et al.  United States Data Center Energy Usage Report , 2016 .

[11]  Yoichi Muraoka,et al.  Extended forecast of CPU and network load on computational Grid , 2004, IEEE International Symposium on Cluster Computing and the Grid, 2004. CCGrid 2004..

[12]  Ian T. Foster,et al.  Homeostatic and tendency-based CPU load predictions , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[13]  Huan Liu,et al.  A Measurement Study of Server Utilization in Public Clouds , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[14]  Yu Zhou,et al.  Host load prediction with long short-term memory in cloud computing , 2017, The Journal of Supercomputing.

[15]  Yu Zhou,et al.  A new method based on PSR and EA-GMDH for host load prediction in cloud computing system , 2014, The Journal of Supercomputing.

[16]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[17]  Yu Zhou,et al.  Multi-step-ahead host load prediction using autoencoder and echo state networks in cloud computing , 2015, The Journal of Supercomputing.

[18]  Hoang Minh Nguyen,et al.  Host load prediction in cloud computing using Long Short-Term Memory Encoder–Decoder , 2019, The Journal of Supercomputing.

[19]  Kranthimanoj Nagothu,et al.  Prediction of cloud data center networks loads using stochastic and neural models , 2011, 2011 6th International Conference on System of Systems Engineering.

[20]  Fern Y. Hunt,et al.  Using Markov chain analysis to study dynamic behaviour in large-scale grid systems , 2009, AusGrid '09.

[21]  Sheng Di,et al.  Host load prediction in a Google compute cloud with a Bayesian model , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.