Multiperiod robust optimization for proactive resource provisioning in virtualized data centers

Energy management has become a significant concern in data centers for reducing operational costs. Using virtualization allows server consolidation, which increases server utilization and reduces energy consumption by turning off idle servers. This needs to consider the power state change overhead. In this paper, we investigate proactive resource provisioning in short-term planning for performance and energy management. To implement short-term planning based on workload prediction, this requires dealing with high fluctuations that are inaccurately predictable by using single value prediction. Unlike long-term planning, short-term planning can not depend on periodical patterns. Thus, we propose an adaptive range-based prediction algorithm instead of a single value. We implement and extensively evaluate the proposed range-based prediction algorithm with different days of real workload. Then, we exploit the range prediction for implementing proactive provisioning using robust optimization taking into consideration uncertainty of the demand. We formulate proactive VM provisioning as a multiperiod robust optimization problem. To evaluate the proposed approach, we use several experimental setups and different days of real workload. We use two metrics: energy savings and robustness for ranking the efficiency of different scenarios. Our approach mitigates undesirable changes in the power state of servers. This enhances servers’ availability for accommodating new VMs, its robustness against uncertainty in workload change, and its reliability against a system failure due to frequent power state changes.

[1]  Ming Mao,et al.  A Performance Study on the VM Startup Time in the Cloud , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[2]  Aameek Singh,et al.  Shares and utilities based power consolidation in virtualized server environments , 2009, 2009 IFIP/IEEE International Symposium on Integrated Network Management.

[3]  Ying Lu,et al.  Efficient Power Management of Heterogeneous Soft Real-Time Clusters , 2008, 2008 Real-Time Systems Symposium.

[4]  Karsten Schwan,et al.  VirtualPower: coordinated power management in virtualized enterprise systems , 2007, SOSP.

[5]  Calton Pu,et al.  Generating Adaptation Policies for Multi-tier Applications in Consolidated Server Environments , 2008, 2008 International Conference on Autonomic Computing.

[6]  J. Fabian,et al.  Power and performance , 1990 .

[7]  Lachlan L. H. Andrew,et al.  Dynamic Right-Sizing for Power-Proportional Data Centers , 2011, IEEE/ACM Transactions on Networking.

[8]  T. S. West Analytical Chemistry , 1969, Nature.

[9]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[10]  Arkadi Nemirovski,et al.  Robust solutions of Linear Programming problems contaminated with uncertain data , 2000, Math. Program..

[11]  Vijay Sukthankar,et al.  An optimized capacity planning approach for virtual infrastructure exhibiting stochastic workload , 2010, SAC '10.

[12]  Zhenhuan Gong,et al.  PAC: Pattern-driven Application Consolidation for Efficient Cloud Computing , 2010, 2010 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[13]  KyoungSoo Park,et al.  CoMon: a mostly-scalable monitoring system for PlanetLab , 2006, OPSR.

[14]  Daniel Mossé,et al.  Dynamic optimization of power and performance for virtualized server clusters , 2010, SAC '10.

[15]  Kai Hwang,et al.  Adaptive Workload Prediction of Grid Performance in Confidence Windows , 2010, IEEE Transactions on Parallel and Distributed Systems.

[16]  Prashant J. Shenoy,et al.  Energy-aware load balancing in content delivery networks , 2011, 2012 Proceedings IEEE INFOCOM.

[17]  Rajkumar Buyya,et al.  Power Aware Scheduling of Bag-of-Tasks Applications with Deadline Constraints on DVS-enabled Clusters , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[18]  Nagarajan Kandasamy,et al.  Power and performance management of virtualized computing environments via lookahead control , 2008, 2008 International Conference on Autonomic Computing.

[19]  Andrzej Kochut,et al.  Dynamic Placement of Virtual Machines for Managing SLA Violations , 2007, 2007 10th IFIP/IEEE International Symposium on Integrated Network Management.

[20]  Daniel Mossé,et al.  A dynamic optimization model for power and performance management of virtualized clusters , 2010, e-Energy.

[21]  Mor Harchol-Balter,et al.  Optimal power allocation in server farms , 2009, SIGMETRICS '09.

[22]  Dimitris Bertsimas,et al.  Empirical Comparison of Robust , Data Driven and Stochastic Optimization , 2009 .

[23]  Eric Bouillet,et al.  Efficient resource provisioning in compute clouds via VM multiplexing , 2010, ICAC '10.

[24]  Alexei A. Gaivoronski,et al.  Stochastic optimization for real time service capacity allocation under random service demand , 2012, Ann. Oper. Res..

[25]  Xiaoyun Zhu,et al.  1000 Islands: Integrated Capacity and Workload Management for the Next Generation Data Center , 2008, 2008 International Conference on Autonomic Computing.

[26]  Calton Pu,et al.  A Cost-Sensitive Adaptation Engine for Server Consolidation of Multitier Applications , 2009, Middleware.

[27]  Feng Zhao,et al.  Energy aware consolidation for cloud computing , 2008, CLUSTER 2008.

[28]  Jordi Torres,et al.  Towards energy-aware scheduling in data centers using machine learning , 2010, e-Energy.

[29]  Yuanyuan Zhou,et al.  Hibernator: helping disk arrays sleep through the winter , 2005, SOSP '05.

[30]  C. Floudas,et al.  A Comparative Theoretical and Computational Study on Robust Counterpart Optimization: I. Robust Linear Optimization and Robust Mixed Integer Linear Optimization. , 2011, Industrial & engineering chemistry research.

[31]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[32]  Suman Nath,et al.  Energy-Aware Server Provisioning and Load Dispatching for Connection-Intensive Internet Services , 2008, NSDI.

[33]  Akshat Verma,et al.  Power-aware dynamic placement of HPC applications , 2008, ICS '08.

[34]  Prajakta S. Kalekar Time series Forecasting using Holt-Winters Exponential Smoothing , 2004 .

[35]  Mark J. Clement,et al.  Analytical performance prediction on multicomputers , 1993, Supercomputing '93. Proceedings.