Power and performance management of virtualized computing environments via lookahead control

There is growing incentive to reduce the power consumed by large-scale data centers that host online services such as banking, retail commerce, and gaming. Virtualization is a promising approach to consolidating multiple online services onto a smaller number of computing resources. A virtualized server environment allows computing resources to be shared among multiple performance-isolated platforms called virtual machines. By dynamically provisioning virtual machines, consolidating the workload, and turning servers on and off as needed, data center operators can maintain the desired quality-of-service (QoS) while achieving higher server utilization and energy efficiency. We implement and validate a dynamic resource provisioning framework for virtualized server environments wherein the provisioning problem is posed as one of sequential optimization under uncertainty and solved using a lookahead control scheme. The proposed approach accounts for the switching costs incurred while provisioning virtual machines and explicitly encodes the corresponding risk in the optimization problem. Experiments using the Trade6 enterprise application show that a server cluster managed by the controller conserves, on average, 22% of the power required by a system without dynamic control while still maintaining QoS goals. Finally, we use trace-based simulations to analyze controller performance on server clusters larger than our testbed, and show how concepts from approximation theory can be used to further reduce the computational burden of controlling large systems.

[1]  T. Copeland,et al.  Financial Theory and Corporate Policy. , 1980 .

[2]  Masahito Yamada,et al.  Structural Time Series Models and the Kalman Filter , 1989 .

[3]  Andrew Harvey,et al.  Forecasting, Structural Time Series Models and the Kalman Filter. , 1991 .

[4]  David Mosberger,et al.  httperf—a tool for measuring web server performance , 1998, PERV.

[5]  Martin Arlitt,et al.  Workload Characterization of the 1998 World Cup Web Site , 1999 .

[6]  Jan M. Maciejowski,et al.  Predictive control : with constraints , 2002 .

[7]  Virgílio A. F. Almeida Capacity Planning for Web Services , 2002, Performance.

[8]  Ricardo Bianchini,et al.  Dynamic cluster reconfiguration for power and performance , 2003 .

[9]  David E. Culler,et al.  USENIX Association Proceedings of USITS ’ 03 : 4 th USENIX Symposium on Internet Technologies and Systems , 2003 .

[10]  Nagarajan Kandasamy,et al.  Online control for self-management in computing systems , 2004, Proceedings. RTAS 2004. 10th IEEE Real-Time and Embedded Technology and Applications Symposium, 2004..

[11]  Frederica Darema,et al.  Grid Computing and Beyond: The Context of Dynamic Data Driven Applications Systems , 2005, Proceedings of the IEEE.

[12]  Peter A. Dinda,et al.  VSched: Mixing Batch And Interactive Virtual Machines Using Periodic Real-time Scheduling , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[13]  Joseph F. Murray,et al.  Reliability and security of RAID storage systems and D2D archives using SATA disk drives , 2005, TOS.

[14]  Qin Li,et al.  Understanding the performance of enterprise applications , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[15]  Nagarajan Kandasamy,et al.  Risk-aware limited lookahead control for dynamic resource provisioning in enterprise computing systems , 2006, 2006 IEEE International Conference on Autonomic Computing.

[16]  Gautam Kar,et al.  Application Performance Management in Virtualized Server Environments , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[17]  David E. Irwin,et al.  Ensemble-level Power Management for Dense Blade Servers , 2006, 33rd International Symposium on Computer Architecture (ISCA'06).

[18]  David E. Irwin,et al.  Virtual Machine Hosting for Networked Clusters: Building the Foundations for "Autonomic" Orchestration , 2006, First International Workshop on Virtualization Technology in Distributed Computing (VTDC 2006).

[19]  Anand Sivasubramaniam,et al.  Xen and co.: communication-aware CPU scheduling for consolidated xen-based hosting platforms , 2007, VEE '07.

[20]  Nagarajan Kandasamy,et al.  Approximation Modeling for the Online Performance Management of Distributed Computing Systems , 2007, ICAC.

[21]  Jin Qian,et al.  PARAID: A gear-shifting power-aware RAID , 2007, TOS.

[22]  Karsten Schwan,et al.  VirtualPower: coordinated power management in virtualized enterprise systems , 2007, SOSP.

[23]  Ripal Nathuji,et al.  Exploiting Platform Heterogeneity for Power Efficient Data Centers , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[24]  Vijay K. Naik,et al.  Efficient Resource Virtualization and Sharing Strategies for Heterogeneous Grid Environments , 2007, 2007 10th IFIP/IEEE International Symposium on Integrated Network Management.

[25]  Malgorzata Steinder,et al.  Server virtualization in autonomic management of heterogeneous workloads , 2007, Integrated Network Management.

[26]  Jing Xu,et al.  On the Use of Fuzzy Modeling in Virtualized Data Center Management , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[27]  Xiaorui Wang,et al.  Server-Level Power Control , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[28]  Rajarshi Das,et al.  Coordinating Multiple Autonomic Managers to Achieve Specified Power-Performance Tradeoffs , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[29]  Kang G. Shin,et al.  Online Web Cluster Capacity Estimation and Its Application to Energy Conservation , 2007, IEEE Transactions on Parallel and Distributed Systems.

[30]  Nagarajan Kandasamy,et al.  Power and Performance Management of Virtualized Computing Environments Via Lookahead Control , 2008, ICAC.