Self directed learning based workload forecasting model for cloud resource management

Abstract Workload prediction plays a vital role in intelligent resource scaling and load balancing that maximize the economic growth of cloud service providers as well as users’ quality of experience (QoE). Numerous approaches have been discovered to estimate the future workload and machine learning is being widely used to improve the forecast accuracy. This paper presents a self directed workload forecasting method (SDWF) that captures the forecasting error trend by computing the deviation in recent forecasts and applies it to enhance the accuracy of further predictions. The model utilizes an improved heuristic approach based on the blackhole phenomena for the training of neurons. The efficacy of the proposed method is evaluated over six different real world data traces. The accuracy of the model is compared with existing models that use different state-of-art approaches including deep learning, differential evolution and back propagation. The maximum relative reduction in mean squared forecast error is observed up to 99.99% compared with existing methods. In addition, the statistical analysis is also carried out using Friedman and Wilcoxon signed rank tests to validate the efficacy of the proposed forecasting model.

[1]  Haoran Zhang,et al.  Improved PSO-Based Method for Leak Detection and Localization in Liquid Pipelines , 2018, IEEE Transactions on Industrial Informatics.

[2]  Bo Cheng,et al.  Predicting of Job Failure in Compute Cloud Based on Online Extreme Learning Machine: A Comparative Study , 2017, IEEE Access.

[3]  E. Smirni,et al.  Report Data Centers in the Wild : A Large Performance Study , 2012 .

[4]  Bo Cheng,et al.  A cost-aware auto-scaling approach using the workload prediction in service clouds , 2014, Inf. Syst. Frontiers.

[5]  Kevin Lee,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012, Future Gener. Comput. Syst..

[6]  Jitendra Kumar,et al.  Dynamic resource scaling in cloud using neural network and black hole algorithm , 2016, 2016 Fifth International Conference on Eco-friendly Computing and Communication Systems (ICECCS).

[7]  Rajiv Misra,et al.  Performance Comparison of Deep VM Workload Prediction Approaches for Cloud , 2018 .

[8]  Raffaela Mirandola,et al.  An online learning model based on episode mining for workload prediction in cloud , 2018, Future Gener. Comput. Syst..

[9]  Ashutosh Kumar Singh,et al.  Cloud datacenter workload estimation using error preventive time series forecasting models , 2019, Cluster Computing.

[10]  Bin Zhang,et al.  A deep learning approach for VM workload prediction in the cloud , 2016, 2016 17th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD).

[11]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[12]  Rajkumar Buyya,et al.  Cloud Computing Principles and Paradigms , 2011 .

[13]  Haiying Shen,et al.  Resource Demand Misalignment: An Important Factor to Consider for Reducing Resource Over-Provisioning in Cloud Datacenters , 2018, IEEE/ACM Transactions on Networking.

[14]  Jitendra Kumar,et al.  Long Short Term Memory Recurrent Neural Network (LSTM-RNN) Based Workload Forecasting Model For Cloud Datacenters , 2018 .

[15]  Jia Zhang,et al.  SGW-SCN: An integrated machine learning approach for workload forecasting in geo-distributed cloud data centers⁎ , 2019, Inf. Sci..

[16]  Oscar Castillo,et al.  Time series prediction using ensembles of ANFIS models with genetic optimization of interval type-2 and type-1 fuzzy integrators , 2014, Int. J. Hybrid Intell. Syst..

[17]  Xiaoyong Tang,et al.  Large-Scale Computing Systems Workload Prediction Using Parallel Improved LSTM Neural Network , 2019, IEEE Access.

[18]  Enda Barrett,et al.  Predicting host CPU utilization in the cloud using evolutionary neural networks , 2018, Future Gener. Comput. Syst..

[19]  Qinru Qiu,et al.  A Hierarchical Framework of Cloud Resource Allocation and Power Management Using Deep Reinforcement Learning , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[20]  Yanjun Qi,et al.  CloudInsight: Utilizing a Council of Experts to Predict Future Cloud Application Workloads , 2018, 2018 IEEE 11th International Conference on Cloud Computing (CLOUD).

[21]  Oscar Castillo,et al.  ClusFuDE: Forecasting low dimensional numerical data using an improved method based on automatic clustering, fuzzy relationships and differential evolution , 2018, Eng. Appl. Artif. Intell..

[22]  MengChu Zhou,et al.  Temporal Prediction of Multiapplication Consolidated Workloads in Distributed Clouds , 2019, IEEE Transactions on Automation Science and Engineering.

[23]  Raffaela Mirandola,et al.  A sequential pattern mining model for application workload prediction in cloud environment , 2018, J. Netw. Comput. Appl..

[24]  Wei Zhong,et al.  A load prediction model for cloud computing using PSO-based weighted wavelet support vector machine , 2018, Applied Intelligence.

[25]  Se Won Kim,et al.  Workload prediction using run-length encoding for runtime processor power management , 2015 .

[26]  Maryam Amiri,et al.  Survey on prediction models of applications for resources provisioning in cloud , 2017, J. Netw. Comput. Appl..

[27]  Yu Zhang,et al.  Intelligent Cloud Resource Management with Deep Reinforcement Learning , 2018, IEEE Cloud Computing.

[28]  Marcos José Santana,et al.  Combining time series prediction models using genetic algorithm to autoscaling Web applications hosted in the cloud infrastructure , 2015, Neural Computing and Applications.

[29]  Mydhili K Nair,et al.  Intelligent VMs prediction in cloud computing environment , 2017, 2017 International Conference On Smart Technologies For Smart Nation (SmartTechCon).

[30]  Ashutosh Kumar Singh,et al.  Secure and energy aware load balancing framework for cloud data centre networks , 2019, Electronics Letters.

[31]  Kranthimanoj Nagothu,et al.  Prediction of cloud data center networks loads using stochastic and neural models , 2011, 2011 6th International Conference on System of Systems Engineering.

[32]  Haifeng Chen,et al.  Proactive Workload Management in Hybrid Cloud Computing , 2014, IEEE Transactions on Network and Service Management.

[33]  Abdolreza Hatamlou,et al.  Black hole: A new heuristic optimization approach for data clustering , 2013, Inf. Sci..

[34]  César A. F. De Rose,et al.  A Preliminary Study of Machine Learning Workload Prediction Techniques for Cloud Applications , 2019, 2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP).

[35]  Xin-She Yang,et al.  Nature-Inspired Optimization Algorithms: Challenges and Open Problems , 2020, J. Comput. Sci..

[36]  Rajkumar Buyya,et al.  Ensemble learning based predictive framework for virtual machine resource request prediction , 2020, Neurocomputing.

[37]  Xiaofei Wang,et al.  Dynamic Resource Prediction and Allocation for Cloud Data Center Using the Multiobjective Genetic Algorithm , 2018, IEEE Systems Journal.

[38]  Inderveer Chana,et al.  An intelligent regressive ensemble approach for predicting resource usage in cloud computing , 2019, J. Parallel Distributed Comput..

[39]  Ashutosh Kumar Singh,et al.  Cloud Resource Demand Prediction using Differential Evolution based Learning , 2019, 2019 7th International Conference on Smart Computing & Communications (ICSCC).

[40]  Martha Pulido,et al.  Particle swarm optimization of ensemble neural networks with fuzzy aggregation for time series prediction of the Mexican Stock Exchange , 2014, Inf. Sci..

[41]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[42]  Zhen Xiao,et al.  Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment , 2013, IEEE Transactions on Parallel and Distributed Systems.

[43]  Randy H. Katz,et al.  Heterogeneity and dynamicity of clouds at scale: Google trace analysis , 2012, SoCC '12.

[44]  Keqin Li,et al.  An Artificial Neural Network Approach to Power Consumption Model Construction for Servers in Cloud Data Centers , 2020, IEEE Transactions on Sustainable Computing.

[45]  Mohsen Guizani,et al.  Energy-Efficient Resource Allocation and Provisioning Framework for Cloud Data Centers , 2015, IEEE Transactions on Network and Service Management.

[46]  Jitendra Kumar,et al.  Workload prediction in cloud using artificial neural network and adaptive differential evolution , 2018, Future Gener. Comput. Syst..

[47]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines , 2009, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.