Resource usage prediction of cloud workloads using deep bidirectional long short term memory networks

Resource usage prediction is an important aspect for achieving optimal resource provisioning in cloud. The presence of long range dependence in cloud workloads makes conventional time series resource usage prediction models unsuitable for prediction. In this paper, we proposed to use multivariate long short term memory (LSTM) models for prediction of resource usage in cloud workloads. We analyze and compare the predictions of LSTM model and bidirectional LSTM model with fractional difference based methods. The proposed LSTM models have been evaluated and compared with the state-of-the-art existing methods on Google cluster trace [1]. The experimental results show that the proposed algorithms outperform state-of-the-art algorithms.

[1]  K. Shida,et al.  Bi-directionalization of neural computing architecture for time series prediction. III. Application to laser intensity time record "Data Set A" , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[2]  Yu Zhou,et al.  Host load prediction with long short-term memory in cloud computing , 2017, The Journal of Supercomputing.

[3]  Aniruddha S. Gokhale,et al.  iOverbook: Intelligent Resource-Overbooking to Support Soft Real-Time Applications in the Cloud , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[4]  Zhenhuan Gong,et al.  PRESS: PRedictive Elastic ReSource Scaling for cloud systems , 2010, 2010 International Conference on Network and Service Management.

[5]  Timothy A. Gonsalves,et al.  Fractional Difference based Hybrid Model for Resource Prediction in Cloud Network , 2016, ICNCC '16.

[6]  Ming Shao,et al.  A Multi-stream Bi-directional Recurrent Neural Network for Fine-Grained Action Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Kishan G. Mehrotra,et al.  Forecasting the behavior of multivariate time series using neural networks , 1992, Neural Networks.

[8]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[9]  Patrick Aboagye-Sarfo,et al.  A comparison of multivariate and univariate time series approaches to modelling and forecasting emergency department demand in Western Australia , 2015, J. Biomed. Informatics.

[10]  Jacek M. Zurada,et al.  Bi-directional computing architecture for time series prediction , 2001, Neural Networks.

[11]  Xiaohui Gu,et al.  AGILE: Elastic Distributed Resource Scaling for Infrastructure-as-a-Service , 2013, ICAC.

[12]  J. Beran Statistical methods for data with long-range dependence , 1992 .

[13]  Inderveer Chana,et al.  Energy Efficiency Techniques in Cloud Computing , 2015, ACM Comput. Surv..

[14]  Jian Su,et al.  A novel bidirectional mechanism based on time series model for wind power forecasting , 2016 .

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Quanyan Zhu,et al.  Dynamic energy-aware capacity provisioning for cloud computing environments , 2012, ICAC '12.