A cloud server energy consumption measurement system for heterogeneous cloud environments

Abstract With rapid development of cloud computing technologies and applications, the number and scale of cloud data centers have grown exponentially in recent years. One of the major problems with current cloud data centers is their huge energy consumption, which makes energy consumption management one of the hottest research topics in the field of cloud computing. This paper aims at implementing an effective Distributed Energy Meter (DEM) system for heterogeneous cloud environments based on a multi-component power consumption model for cloud servers. Specifically, we propose a modeling method for the energy consumption of key components (CPU, memory and disk) of computer servers and reveal the mathematical relationship between the resource usage of the key components and the system energy consumption. The proposed DEM system cannot only estimate the energy consumption of heterogeneous cluster environments (Linux and Windows NT), but also support various CPU power consumption models. In addition, a unique disk power consumption model that uses different thresholds to distinguish various disk I/O states (sequential/random, read/write) to achieve an accurate estimation of disk power consumption. Experimental studies conducted on a heterogeneous cluster with workloads generated by PCMark and Sysbench demonstrate that the proposed DEM system outperforms the state-of-art models in estimating the energy consumption of heterogeneous cloud environments.

[1]  Haoyu Wang,et al.  A Power Monitoring System Based on a Multi-Component Power Model , 2018, Int. J. Grid High Perform. Comput..

[2]  Nikolay Mehandjiev,et al.  On Achieving Energy Efficiency and Reducing CO2 Footprint in Cloud Computing , 2016, IEEE Transactions on Cloud Computing.

[3]  Kenli Li,et al.  Partition Scheduling on Heterogeneous Multicore Processors for Multi-dimensional Loops Applications , 2017, International Journal of Parallel Programming.

[4]  Laurence T. Yang,et al.  Energy-Efficient Resource Allocation for D2D Communications Underlaying Cloud-RAN-Based LTE-A Networks , 2016, IEEE Internet of Things Journal.

[5]  Stephen W. Poole,et al.  Power signature analysis of the SPECpower_ssj2008 benchmark , 2011, (IEEE ISPASS) IEEE INTERNATIONAL SYMPOSIUM ON PERFORMANCE ANALYSIS OF SYSTEMS AND SOFTWARE.

[6]  Johannes G. Janzen Calculating Memory System Power for DDR SDRAM , 2001 .

[7]  Yolande Berbers,et al.  LofoSwitch: An online policy for concerted server and disk power control in content distribution networks , 2015, Ad Hoc Networks.

[8]  Ying Zhang,et al.  A heuristic task scheduling algorithm based on server power efficiency model in cloud environments , 2017, Sustain. Comput. Informatics Syst..

[9]  Dongqing Xie,et al.  Cognitive Multiuser Energy Harvesting Decode-and-Forward Relaying System With Direct Links , 2018, IEEE Access.

[10]  Vipin Chaudhary,et al.  VMeter: Power modelling for virtualized clouds , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[11]  Hui Wang,et al.  A new dynamic firefly algorithm for demand estimation of water resources , 2018, Inf. Sci..

[12]  Witawas Srisa-an,et al.  Significant Permission Identification for Machine-Learning-Based Android Malware Detection , 2018, IEEE Transactions on Industrial Informatics.

[13]  George K. Karagiannidis,et al.  Secrecy Cooperative Networks With Outdated Relay Selection Over Correlated Fading Channels , 2017, IEEE Transactions on Vehicular Technology.

[14]  Weiwei Lin,et al.  An intelligent power consumption model for virtual machines under CPU-intensive workload in cloud environment , 2017, Soft Comput..

[15]  Jie Wu,et al.  Quality-Guaranteed Event-Sensitive Data Collection and Monitoring in Vibration Sensor Networks , 2017, IEEE Transactions on Industrial Informatics.

[16]  Jin Li,et al.  A Hybrid Cloud Approach for Secure Authorized Deduplication , 2015, IEEE Transactions on Parallel and Distributed Systems.

[17]  Qing Wang,et al.  Distance metric optimization driven convolutional neural network for age invariant face recognition , 2018, Pattern Recognit..

[18]  Xiaofeng Chen,et al.  Secure Distributed Deduplication Systems with Improved Reliability , 2015, IEEE Trans. Computers.

[19]  Jianfeng Ma,et al.  Verifiable Computation over Large Database with Incremental Updates , 2014, IEEE Transactions on Computers.

[20]  Jin Li,et al.  Multi-resource scheduling and power simulation for cloud computing , 2017, Inf. Sci..

[21]  Trevor N. Mudge,et al.  Power: A First-Class Architectural Design Constraint , 2001, Computer.

[22]  Weiwei Lin,et al.  An Ensemble Random Forest Algorithm for Insurance Big Data Analysis , 2017, IEEE Access.

[23]  Jin Li,et al.  Design and theoretical analysis of virtual machine placement algorithm based on peak workload characteristics , 2017, Soft Comput..

[24]  Anand Sivasubramaniam,et al.  Understanding the performance-temperature interactions in disk I/O of server workloads , 2006, The Twelfth International Symposium on High-Performance Computer Architecture, 2006..

[25]  Xuan Li,et al.  Centralized Duplicate Removal Video Storage System with Privacy Preservation in IoT , 2018, Sensors.

[26]  Giovanni Giuliani,et al.  A methodology to predict the power consumption of servers in data centres , 2011, e-Energy.

[27]  Jie Wu,et al.  Sensing and Decision Making in Cyber-Physical Systems: The Case of Structural Event Monitoring , 2016, IEEE Transactions on Industrial Informatics.

[28]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[29]  Houfeng Wang,et al.  Model approach to grammatical evolution: theory and case study , 2016, Soft Comput..

[30]  Feng Zhao,et al.  Virtual machine power metering and provisioning , 2010, SoCC '10.

[31]  Ching-Hsien Hsu,et al.  Experimental and quantitative analysis of server power model for cloud data centers , 2016, Future Gener. Comput. Syst..

[32]  Fei Zhang,et al.  Simulation of power consumption of cloud data centers , 2013, Simul. Model. Pract. Theory.

[33]  Chaoyue Zhu,et al.  Novel algorithms and equivalence optimisation for resource allocation in cloud computing , 2015, Int. J. Web Grid Serv..

[34]  Siu-Ming Yiu,et al.  Multi-key privacy-preserving deep learning in cloud computing , 2017, Future Gener. Comput. Syst..

[35]  Edward Osita Ofoegbu,et al.  An Intelligent Power Load Control/Switching System Using an Energy Meter and Relay Circuit , 2016, Int. J. Grid High Perform. Comput..