Toward Generalized Neural Model for VMs Power Consumption Estimation in Data Centers

The power consumption of IT equipment is always being a big challenge for data centers. The research communities are attempting to solve this problem, by employing various of energy-aware tasks scheduling or VMs consolidation policies. It is crucial for these policies to figure out the major parameters that affect power consumption and their correlation. In this paper, we first identify the major parameters using real cloud services' workload and power consumption data. An important observation is that the parameters are strongly interdependent and the importance of individual parameters varies in different cloud services. Nevertheless, existing power consumption models are unable to fully capture this feature and thus lack generalization. To address this gap, we propose Lapem that adopts a Long Short-term Memory network for power consumption estimation. Lapem further uses an attention mechanism to achieve stable performance and improve generalization. The experimental results demonstrate that Lapem estimates power consumption with a relative error of as low as 2%-5%. More importantly, in comparison with the state-of-the-art models, Lapem reduces the estimation error by more than 23% when generalizing to new cloud services.

[1]  Chunyang Lu,et al.  VPower: Metering power consumption of VM , 2013, 2013 IEEE 4th International Conference on Software Engineering and Service Science.

[2]  Hai Jin,et al.  Virtual Machine Power Accounting with Shapley Value , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[3]  Vipin Chaudhary,et al.  VMeter: Power modelling for virtualized clouds , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[4]  Alexander Schill,et al.  Power Consumption Estimation Models for Processors, Virtual Machines, and Servers , 2014, IEEE Transactions on Parallel and Distributed Systems.

[5]  Feng Zhao,et al.  Virtual machine power metering and provisioning , 2010, SoCC '10.

[6]  Silvia Santini,et al.  Energy-Aware Coflow and Antenna Scheduling for Hybrid Server-Centric Data Center Networks , 2019, IEEE Transactions on Green Communications and Networking.

[7]  Roberto Morabito,et al.  Power Consumption of Virtualization Technologies: An Empirical Investigation , 2015, 2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC).

[8]  Weiwei Lin,et al.  An intelligent power consumption model for virtual machines under CPU-intensive workload in cloud environment , 2017, Soft Comput..

[9]  Luca Castellazzi,et al.  Trends in Data Centre Energy Consumption under the European Code of Conduct for Data Centre Energy Efficiency , 2017 .

[10]  Hai Jin,et al.  Non-IT Energy Accounting in Virtualized Datacenter , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[11]  Ada Gavrilovska,et al.  VM power metering: feasibility and challenges , 2011, PERV.

[12]  T. Veni,et al.  Prediction Model for Virtual Machine Power Consumption in Cloud Environments , 2016 .

[13]  Romain Rouvoy,et al.  Process-level power estimation in VM-based systems , 2015, EuroSys.

[14]  Cristian Rodriguez Rivero,et al.  Long-term power consumption demand prediction: A comparison of energy associated and Bayesian modeling approach , 2015, 2015 Latin America Congress on Computational Intelligence (LA-CCI).

[15]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[16]  Rizos Sakellariou,et al.  A Survey of Power and Energy Predictive Models in HPC Systems and Applications , 2017, ACM Comput. Surv..

[17]  Carl E. Rasmussen,et al.  Robust Filtering and Smoothing with Gaussian Processes , 2012, IEEE Transactions on Automatic Control.

[18]  Alexander Schill,et al.  Analysis of the Power and Hardware Resource Consumption of Servers under Different Load Balancing Policies , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Andreas Kassler,et al.  Optimising for energy or robustness? Trade-offs for VM consolidation in virtualized datacenters under uncertainty , 2017, Optim. Lett..

[21]  Lutz Prechelt,et al.  Early Stopping-But When? , 1996, Neural Networks: Tricks of the Trade.

[22]  Alex Graves,et al.  Long Short-Term Memory , 2020, Computer Vision.

[23]  Xiaohua Jia,et al.  Towards VM Power Metering: A Decision Tree Method and Evaluations , 2015, ICA3PP.

[24]  Michael Ferdman,et al.  Demystifying cloud benchmarking , 2016, 2016 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS).

[25]  Kresimir Mihic,et al.  A system for online power prediction in virtualized environments using gaussian mixture models , 2010, Design Automation Conference.

[26]  Howon Kim,et al.  Long Short Term Memory Recurrent Neural Network Classifier for Intrusion Detection , 2016, 2016 International Conference on Platform Technology and Service (PlatCon).