Energy-Aware Application-Centric VM Allocation for HPC Workloads

Virtualized data centers and clouds are being increasingly considered for traditional High-Performance Computing (HPC) workloads that have typically targeted Grids and conventional HPC platforms. However, maximizing energy efficiency, cost-effectiveness, and utilization of data center resources while ensuring performance and other Quality of Service (QoS) guarantees for HPC applications requires careful consideration of important and extremely challenging tradeoffs. An innovative application-centric energy-aware strategy for Virtual Machine (VM) allocation is presented. The proposed strategy ensures high resource utilization and energy efficiency through VM consolidation while satisfying application QoS. While existing VM allocation solutions are aimed at satisfying only the resource utilization requirements of applications along only one dimension (CPU utilization), the proposed approach is more generic as it employs knowledge obtained through application profiling along multiple dimensions. The results of our evaluation show that the proposed VM allocation strategy enables significant reduction either in energy consumption or in execution time, depending on the optimization goals.

[1]  Anand Sivasubramaniam,et al.  Xen and co.: communication-aware CPU scheduling for consolidated xen-based hosting platforms , 2007, VEE '07.

[2]  Rajkumar Buyya,et al.  Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation , 2009, CloudCom.

[3]  Ripal Nathuji,et al.  Exploiting Platform Heterogeneity for Power Efficient Data Centers , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[4]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[5]  Hui Wang,et al.  An Adaptive Resource Flowing Scheme amongst VMs in a VM-Based Utility Computing , 2007, 7th IEEE International Conference on Computer and Information Technology (CIT 2007).

[6]  Xiaomin Zhang,et al.  Characterization & analysis of a server consolidation benchmark , 2008, VEE '08.

[7]  Andrzej Kochut,et al.  Dynamic Placement of Virtual Machines for Managing SLA Violations , 2007, 2007 10th IFIP/IEEE International Symposium on Integrated Network Management.

[8]  Akshat Verma,et al.  Power-aware dynamic placement of HPC applications , 2008, ICS '08.

[9]  Dario Pompili,et al.  Management in Instrumented Datacenters , 2010 .

[10]  Yasuhiro Ajiro,et al.  Improving Packing Algorithms for Server Consolidation , 2007, Int. CMG Conference.

[11]  Daniel A. Menascé,et al.  Autonomic Virtualized Environments , 2006, International Conference on Autonomic and Autonomous Systems (ICAS'06).

[12]  Eric Bouillet,et al.  Efficient resource provisioning in compute clouds via VM multiplexing , 2010, ICAC '10.

[13]  Andrzej Kochut,et al.  On Strategies for Dynamic Resource Management in Virtualized Server Environments , 2007, 2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[14]  Xavier Lorca,et al.  Entropy: a consolidation manager for clusters , 2009, VEE '09.

[15]  Richard E. Brown,et al.  Report to Congress on Server and Data Center Energy Efficiency: Public Law 109-431 , 2008 .

[16]  Peter Desnoyers,et al.  Memory buddies: exploiting page sharing for smart colocation in virtualized data centers , 2009, VEE '09.

[17]  Hyong S. Kim,et al.  How to tame your VMs: an automated control system for virtualized services , 2010 .

[18]  Manish Parashar,et al.  Investigating the potential of application-centric aggressive power management for HPC workloads , 2010, 2010 International Conference on High Performance Computing.

[19]  George Varghese,et al.  Difference engine , 2010, OSDI.

[20]  Frank Bellosa,et al.  Energy Management for Hypervisor-Based Virtual Machines , 2007, USENIX Annual Technical Conference.