Dynamic resource management in virtualized data centers with bursty traffic

Reducing energy consumption in data centers has been a persistent goal for the last decade. Advances in virtualization and dynamic power management have helped to curb excess utilization by sharing resources and running system components in lower energy states during periods of low traffic. However, switching components among virtual machines and energy states is subject to setup times and increased energy consumption to bring them online, and this combined with the innate burstiness of traffic in data centers are significant deterrents to the successful deployment of power management techniques. In this paper, we develop a queueing model with a controllable service rate that accounts for switching frictions within a setting that has a changing arrival rate. We solve for the optimal control policy using dynamic programming, and find it has intuitive structural properties. We compare its performance against benchmark heuristics, and the relative advantages among them in different scenarios are discussed.

[1]  Alan Scheller-Wolf,et al.  Exact analysis of the M/M/k/setup class of Markov chains via recursive renewal reward , 2013, SIGMETRICS '13.

[2]  Ulas C. Kozat,et al.  Dynamic resource allocation and power management in virtualized data centers , 2010, 2010 IEEE Network Operations and Management Symposium - NOMS 2010.

[3]  Erhan Bayraktar,et al.  Sequential tracking of a hidden Markov chain using point process observations , 2007, 0712.0413.

[4]  Lachlan L. H. Andrew,et al.  Dynamic Right-Sizing for Power-Proportional Data Centers , 2011, IEEE/ACM Transactions on Networking.

[5]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[6]  Christoforos E. Kozyrakis,et al.  Automatic power management schemes for Internet servers and data centers , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[7]  Timothy H. McCalmont,et al.  Provisioning , 2011, Journal of cutaneous pathology.

[8]  Rajkumar Buyya,et al.  Energy Efficient Resource Management in Virtualized Cloud Data Centers , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[9]  Susanne Albers,et al.  Energy-efficient algorithms , 2010, Commun. ACM.

[10]  Ulrich Drepper,et al.  The Cost of Virtualization , 2008, ACM Queue.

[11]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[12]  Huseyin Topaloglu,et al.  Dynamic service rate control for a single-server queue with Markov-modulated arrivals , 2013 .

[13]  Sandy Irani,et al.  Competitive analysis of dynamic power management strategies for systems with multiple power saving states , 2002, Proceedings 2002 Design, Automation and Test in Europe Conference and Exhibition.

[14]  Mor Harchol-Balter,et al.  Are sleep states effective in data centers? , 2012, 2012 International Green Computing Conference (IGCC).