A column generation approach for power-aware optimization of virtualized heterogeneous server clusters

Increasingly, clusters of servers have been deployed in large data centers to support the development and implementation of many kinds of services, having distinct workload demands that vary over time, in a scalable and efficient computing environment. Emerging trends are utility/cloud computing platforms, where many network services, implemented and supported using server virtualization techniques, are hosted on a shared cluster infrastructure of physical servers. The energy consumed to maintain these large server clusters became a very important concern, which in turn, requires major investigation of optimization techniques to improve the energy efficiency of their computing infrastructure. In this work, we propose an efficient approach to solve a relevant cluster optimization problem which, in practice, can be used as an embedded module to implement an integrated power and performance management solution in a real server cluster. The optimization approach simultaneously deals with (i) CPU power-saving techniques combined with server switching on/off mechanisms, (ii) the case of server heterogeneity, (iii) virtualized server environments, (iv) an efficient optimization method, which is based on column generation techniques. The key aspects of our approach are the basis on rigorous and robust optimization techniques, given by high quality solutions in short amount of processing time, and experimental results on the cluster configuration problem for large-scale heterogeneous server clusters that can make use of virtualization techniques.

[1]  Cláudio Alves,et al.  A stabilized branch-and-price-and-cut algorithm for the multiple length cutting stock problem , 2008, Comput. Oper. Res..

[2]  José M. Valério de Carvalho,et al.  Using Extra Dual Cuts to Accelerate Column Generation , 2005, INFORMS J. Comput..

[3]  Philip S. Yu,et al.  The state of the art in locally distributed Web-server systems , 2002, CSUR.

[4]  E. N. Elnozahy,et al.  Energy-Efficient Server Clusters , 2002, PACS.

[5]  Enrique V. Carrera,et al.  Load balancing and unbalancing for power and performance in cluster-based systems , 2001 .

[6]  Salim Hariri,et al.  Autonomic power and performance management for computing systems , 2006, 2006 IEEE International Conference on Autonomic Computing.

[7]  Nagarajan Kandasamy,et al.  Power and performance management of virtualized computing environments via lookahead control , 2008, 2008 International Conference on Autonomic Computing.

[8]  Claudio Scordino,et al.  Energy-Efficient Real-Time Heterogeneous Server Clusters , 2006, 12th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS'06).

[9]  Daniel Mossé,et al.  Power optimization for dynamic configuration in heterogeneous web server clusters , 2010, J. Syst. Softw..

[10]  Feng Zhao,et al.  Energy aware consolidation for cloud computing , 2008, CLUSTER 2008.

[11]  Kenneth Ward Church,et al.  On Delivering Embarrassingly Distributed Cloud Services , 2008, HotNets.

[12]  Brian Hayes,et al.  What Is Cloud Computing? , 2019, Cloud Technologies.

[13]  Gu-Yeon Wei,et al.  Thread motion: fine-grained power management for multi-core systems , 2009, ISCA '09.

[14]  David Pisinger,et al.  A Minimal Algorithm for the 0-1 Knapsack Problem , 1997, Oper. Res..

[15]  David Mosberger,et al.  httperf—a tool for measuring web server performance , 1998, PERV.

[16]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[17]  Daniel Mossé,et al.  Statistical QoS Guarantee and Energy-Efficiency in Web Server Clusters , 2007, 19th Euromicro Conference on Real-Time Systems (ECRTS'07).

[18]  Martin Arlitt,et al.  A workload characterization study of the 1998 World Cup Web site , 2000, IEEE Netw..

[19]  Edward L. Haletky VMware ESX Server in the Enterprise: Planning and Securing Virtualization Servers , 2007 .

[20]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[21]  Andrew Warfield,et al.  Xen and the art of virtualization , 2003, SOSP '03.

[22]  Nagarajan Kandasamy,et al.  Self-optimization in computer systems via on-line control: application to power management , 2004 .

[23]  Xue Liu,et al.  Dynamic Voltage Scaling in Multitier Web Servers with End-to-End Delay Control , 2007, IEEE Transactions on Computers.

[24]  Anand Sivasubramaniam,et al.  Managing server energy and operational costs in hosting centers , 2005, SIGMETRICS '05.

[25]  Gleb Belov,et al.  A cutting plane algorithm for the one-dimensional cutting stock problem with multiple stock lengths , 2002, Eur. J. Oper. Res..

[26]  Lizy Kurian John,et al.  Analysis of dynamic power management on multi-core processors , 2008, ICS '08.

[27]  George B. Dantzig,et al.  Decomposition Principle for Linear Programs , 1960 .

[28]  Parthasarathy Ranganathan Recipe for efficiency: principles of power-aware computing , 2010, CACM.

[29]  Ricardo Bianchini,et al.  Power and energy management for server systems , 2004, Computer.

[30]  Martin Bichler,et al.  Capacity Planning for Virtualized Servers , 2007 .

[31]  David Pisinger,et al.  A Minimal Algorithm for the Bounded Knapsack Problem , 1995, IPCO.

[32]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[33]  Mor Harchol-Balter,et al.  Optimal power allocation in server farms , 2009, SIGMETRICS '09.

[34]  Ricardo Bianchini,et al.  Energy conservation in heterogeneous server clusters , 2005, PPoPP.

[35]  Yefu Wang,et al.  Power Optimization with Performance Assurance for Multi-tier Applications in Virtualized Data Centers , 2010, 2010 39th International Conference on Parallel Processing Workshops.

[36]  Gautam Kar,et al.  Application Performance Management in Virtualized Server Environments , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[37]  D. K. Friesen,et al.  Variable Sized Bin Packing , 1986, SIAM J. Comput..

[38]  Xiaoyun Zhu,et al.  Power-Efficient Response Time Guarantees for Virtualized Enterprise Servers , 2008, 2008 Real-Time Systems Symposium.

[39]  Akshat Verma,et al.  Power-aware dynamic placement of HPC applications , 2008, ICS '08.

[40]  Daniel Mossé,et al.  Optimized Management of Power and Performance for Virtualized Heterogeneous Server Clusters , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.