Short-Term Load Forecasting of Virtual Machines Based on Improved Neural Network

Cloud computing allows applications to share resources on physical machines in an independent manner so as to effectively increase the utilization of physical machines. To enable cloud service users to obtain high-quality services, it is significant for cloud service providers to reduce the time required to allocate and deploy virtual machines, as well as to provide time windows for the deployment of physical servers. To ensure demand is met, one effective implementation method is to predict the workload of virtual machines in the future, as this contributes to the efficient deployment of a data center’s requests from virtual machines to dynamically changing physical servers. However, due to the complexity of virtual machine requests, virtual machine workload prediction remains a significant challenge at present; on the one hand, it is difficult for standard recurrent neural networks to capture long-term dependencies because of the disappearance of gradients, while on the other hand, the long short-term memory method cannot handle irregular intervals. Accordingly, a new virtual machine workload prediction method that is capable of managing irregular time intervals is proposed in this paper. The proposed method combines the amount and time intervals of historical virtual machine work requests in order to accurately predict the virtual machine’s future workload using a fixed length of time as a unit. Experiments show that the proposed model can generate more accurate prediction results than the long short-term memory method.

[1]  Volker Tresp,et al.  Predicting Clinical Events by Combining Static and Dynamic Information Using Recurrent Neural Networks , 2016, 2016 IEEE International Conference on Healthcare Informatics (ICHI).

[2]  Svetha Venkatesh,et al.  DeepCare: A Deep Dynamic Memory Model for Predictive Medicine , 2016, PAKDD.

[3]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[4]  Jaime Lloret,et al.  Artificial Neural Network for Short-Term Load Forecasting in Distribution Systems , 2014 .

[5]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[6]  Nirwan Ansari,et al.  Optimizing Resource Utilization of a Data Center , 2016, IEEE Communications Surveys & Tutorials.

[7]  Mohammad Abid Bazaz,et al.  Short term load forecasting using artificial neural network , 2017, 2017 Fourth International Conference on Image Information Processing (ICIIP).

[8]  Yan Liu,et al.  Recurrent Neural Networks for Multivariate Time Series with Missing Values , 2016, Scientific Reports.

[9]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[10]  Xifeng Yan,et al.  Workload characterization and prediction in the cloud: A multiple time series approach , 2012, 2012 IEEE Network Operations and Management Symposium.

[11]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[12]  Archana Ganapathi,et al.  Statistics-driven workload modeling for the Cloud , 2010, 2010 IEEE 26th International Conference on Data Engineering Workshops (ICDEW 2010).

[13]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[16]  Ce Zhang,et al.  Software reliability prediction using a deep learning model based on the RNN encoder-decoder , 2018, Reliab. Eng. Syst. Saf..

[17]  Jun Hu,et al.  Short-Term Load Forecasting With Deep Residual Networks , 2018, IEEE Transactions on Smart Grid.

[18]  Yoshua Bengio,et al.  The problem of learning long-term dependencies in recurrent networks , 1993, IEEE International Conference on Neural Networks.

[19]  Bin Zhang,et al.  A deep learning approach for VM workload prediction in the cloud , 2016, 2016 17th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD).

[20]  Scott Shenker,et al.  Overcoming the Internet impasse through virtualization , 2005, Computer.

[21]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[22]  Yang Wang,et al.  Short-Term Load-Forecasting Method Based on Wavelet Decomposition With Second-Order Gray Neural Network Model Combined With ADF Test , 2017, IEEE Access.

[23]  Yan Liu,et al.  Deep Learning Solutions to Computational Phenotyping in Health Care , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[24]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[25]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[26]  J. R. Zhang.  Research on Power Load Forecasting Based on the Improved Elman Neural Network , 2016 .

[27]  Aniruddha S. Gokhale,et al.  Efficient Autoscaling in the Cloud Using Predictive Models for Workload Forecasting , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[28]  Li-Der Chou,et al.  A novel VM workload prediction using Grey Forecasting model in cloud data center , 2014, The International Conference on Information Networking 2014 (ICOIN2014).

[29]  D VinuthaH,et al.  Electric Load Forecasting using a Neural Network Approach , 2014 .