Analysis of power consumption in heterogeneous virtual machine environments

Reduction of energy consumption in Cloud computing datacenters today is a hot a research topic, as these consume large amounts of energy. Furthermore, most of the energy is used inefficiently because of the improper usage of computational resources such as CPU, storage and network. A good balance between the computing resources and performed workload is mandatory. In the context of data-intensive applications, a significant portion of energy is consumed just to keep alive virtual machines or to move data around without performing useful computation. Moreover, heterogeneity of resources increases the difficulty degree, when trying to achieve energy efficiency. Power consumption optimization requires identification of those inefficiencies in the underlying system and applications. Based on the relation between server load and energy consumption, we study the efficiency of data-intensive applications, and the penalties, in terms of power consumption, that are introduced by different degrees of heterogeneity of the virtual machines characteristics in a cluster.

[1]  Liang Liu,et al.  A multi-objective ant colony system algorithm for virtual machine placement in cloud computing , 2013, J. Comput. Syst. Sci..

[2]  Alexandru Iosup,et al.  V for Vicissitude: The Challenge of Scaling Complex Big Data Workflows , 2014, 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[3]  Natalia Kryvinska,et al.  Towards cloud-centric service environments , 2012, J. Serv. Sci. Res..

[4]  Lin Wang,et al.  Power-efficient assignment of virtual machines to physical machines , 2016, Future Gener. Comput. Syst..

[5]  Costin-Gabriel Chiru,et al.  Cost efficient cloud-based service oriented architecture for water pollution prediction , 2015, 2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP).

[6]  Valentin Cristea,et al.  A decentralized strategy for genetic scheduling in heterogeneous environments , 2006, Multiagent Grid Syst..

[7]  Nik Bessis,et al.  Towards Inter-cloud Schedulers: A Survey of Meta-scheduling Approaches , 2011, 2011 International Conference on P2P, Parallel, Grid, Cloud and Internet Computing.

[8]  Massoud Pedram,et al.  Energy-Efficient Virtual Machine Replication and Placement in a Cloud Computing System , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[9]  Samee Ullah Khan,et al.  Multi-level hierarchic genetic-based scheduling of independent jobs in dynamic heterogeneous grid environment , 2012, Inf. Sci..

[10]  Samee Ullah Khan,et al.  Energy-Aware Grid Scheduling of Independent Tasks and Highly Distributed Data , 2013, 2013 11th International Conference on Frontiers of Information Technology.

[11]  Gustavo Rau de Almeida Callou,et al.  Estimating reliability importance and total cost of acquisition for data center power infrastructures , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[12]  Florin Pop,et al.  Asymptotic scheduling for many task computing in Big Data platforms , 2015, Inf. Sci..

[13]  Vipin Chaudhary,et al.  VMeter: Power modelling for virtualized clouds , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[14]  Natalia Kryvinska,et al.  Strategic management of disruptive technologies: a practical framework in the context of voice services and of computing towards the cloud , 2013, Int. J. Grid Util. Comput..

[15]  Ciprian Dobre,et al.  Deadline scheduling for aperiodic tasks in inter-Cloud environments: a new approach to resource management , 2015, The Journal of Supercomputing.

[16]  Lizy Kurian John,et al.  Complete System Power Estimation Using Processor Performance Events , 2012, IEEE Transactions on Computers.

[17]  Scott Shenker,et al.  Discretized streams: fault-tolerant streaming computation at scale , 2013, SOSP.

[18]  Komal Shringare,et al.  Apache Hadoop Goes Realtime at Facebook , 2015 .

[19]  Christopher Thraves,et al.  Power-efficient assignment of virtual machines to physical machines , 2013, Future Gener. Comput. Syst..

[20]  Fatos Xhafa,et al.  Genetic Algorithms for Energy-Aware Scheduling in Computational Grids , 2011, 2011 International Conference on P2P, Parallel, Grid, Cloud and Internet Computing.

[21]  Ching-Chi Lin,et al.  Energy-Aware Virtual Machine Dynamic Provision and Scheduling for Cloud Computing , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[22]  Scott Shenker,et al.  Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[23]  Rina Panigrahy,et al.  Heuristics for Vector Bin Packing , 2011 .

[24]  Jordi Torres,et al.  Energy accounting for shared virtualized environments under DVFS using PMC-based power models , 2012, Future Gener. Comput. Syst..

[25]  Christoforos E. Kozyrakis,et al.  Energy proportionality and workload consolidation for latency-critical applications , 2015, SoCC.

[26]  Robert J. Fowler,et al.  SoftPower: fine-grain power estimations using performance counters , 2010, HPDC '10.

[27]  Valentin Cristea,et al.  Optimizing the Energy Efficiency of Message Exchanging for Service Distribution in Interoperable Infrastructures , 2012, 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems.

[28]  Mauro Birattari,et al.  Dm63 Heuristics for Combinatorial Optimization Ant Colony Optimization Exercises Outline Ant Colony Optimization: the Metaheuristic Application Examples Generalized Assignment Problem (gap) Connection between Aco and Other Metaheuristics Encodings Capacited Vehicle Routing Linear Ordering Ant Colony , 2022 .

[29]  Rajkumar Buyya,et al.  Energy and Carbon-Efficient Placement of Virtual Machines in Distributed Cloud Data Centers , 2013, Euro-Par.

[30]  Lizhe Wang,et al.  Genetic-Based Solutions For Independent Batch Scheduling In Data Grids , 2013, ECMS.

[31]  Mohsen Sharifi,et al.  Power-efficient distributed scheduling of virtual machines using workload-aware consolidation techniques , 2012, The Journal of Supercomputing.

[32]  Julian Soh,et al.  Microsoft Azure and Cloud Computing , 2020, Microsoft Azure.

[33]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines , 2009, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.

[34]  Valentin Cristea,et al.  Using a novel message-exchanging optimization (MEO) model to reduce energy consumption in distributed systems , 2013, Simul. Model. Pract. Theory.

[35]  Ewa Niewiadomska-Szynkiewicz,et al.  Dynamic power management in energy-aware computer networks and data intensive computing systems , 2014, Future Gener. Comput. Syst..

[36]  Christine Morin,et al.  Energy-Aware Ant Colony Based Workload Placement in Clouds , 2011, 2011 IEEE/ACM 12th International Conference on Grid Computing.

[37]  Kang G. Shin,et al.  Real-time dynamic voltage scaling for low-power embedded operating systems , 2001, SOSP.

[38]  Xilong Qu,et al.  Virtual machine power measuring technique with bounded error in cloud environments , 2013, J. Netw. Comput. Appl..

[39]  Alexander Schill,et al.  Power Consumption Estimation Models for Processors, Virtual Machines, and Servers , 2014, IEEE Transactions on Parallel and Distributed Systems.

[40]  George Markowsky,et al.  Multidimensional Bin Packing Algorithms , 1977, IBM J. Res. Dev..

[41]  Sanjay Ghemawat,et al.  MapReduce: simplified data processing on large clusters , 2008, CACM.

[42]  Cees T. A. M. de Laat,et al.  Addressing big data issues in Scientific Data Infrastructure , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[43]  Valentin Cristea,et al.  Impact of Virtual Machines Heterogeneity on Data Center Power Consumption in Data-Intensive Applications , 2015, ARMS-CC@PODC.

[44]  Achim Streit,et al.  Load and Thermal-Aware VM Scheduling on the Cloud , 2013, ICA3PP.

[45]  Rajkumar Buyya,et al.  An Inter-Cloud Meta-Scheduling (ICMS) Simulation Framework: Architecture and Evaluation , 2018, IEEE Transactions on Services Computing.

[46]  Yuan Yu,et al.  Dryad: distributed data-parallel programs from sequential building blocks , 2007, EuroSys '07.

[47]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[48]  Andreas Berl,et al.  An energy consumption model for virtualized office environments , 2011, Future Gener. Comput. Syst..

[49]  Francesco Palmieri,et al.  Introducing Fraudulent Energy Consumption in Cloud Infrastructures: A New Generation of Denial-of-Service Attacks , 2017, IEEE Systems Journal.