Data center power minimization with placement optimization of liquid-cooled servers and free air cooling

Abstract Most of today's data centers are equipped with servers that rely on air cooling, which is well known to have low cooling efficiency due to undesired air recirculation. As a result, many data centers have started to adopt liquid cooling and free air cooling for improved cooling efficiency. In this paper, we make two key observations. First, since data centers normally replace only a portion of their servers at a time, an important problem is where in the data center to place those new liquid-cooled servers for the best return on their investment. Given the complex thermal dynamics in a data center, we find, in our process of deploying liquid-cooled servers, different placement strategies lead to significantly different cooling power consumption. Second, different cooling techniques, including traditional air cooling, liquid cooling, and the emerging free air cooling, must be intelligently coordinated with dynamic workload allocation in order to minimize the cooling and server power of a data center. Based on the two observations, we propose SmartPlace, an intelligent placement algorithm that deploys liquid-cooled servers to minimize the power consumption of the data center cooling system. SmartPlace also takes into account the coordination with free air cooling and dynamic workload distribution among servers for jointly minimized cooling and server power in the entire data center. We compare SmartPlace with a state-of-the-art cooling optimization solution for two data centers with 1,280 and 10,240 servers, respectively. The results show that SmartPlace achieves up to 26.7% (with an average of 15%) less total power consumption with dynamically guaranteed application response time. Our hardware testbed results also demonstrate the effectiveness of SmartPlace. Moreover, we analyze how soon a data center can gain a full return on the capital investment of liquid-cooled servers.

[1]  S. Gupta,et al.  Thermal-aware task scheduling for data centers through minimizing heat recirculation , 2007, 2007 IEEE International Conference on Cluster Computing.

[2]  Jeffrey S. Chase,et al.  Balance of power: dynamic thermal management for Internet data centers , 2005, IEEE Internet Computing.

[3]  D. Agonafer,et al.  CFD analysis of free cooling of modular data centers , 2012, 2012 28th Annual IEEE Semiconductor Thermal Measurement and Management Symposium (SEMI-THERM).

[4]  Kai Ma,et al.  Exploiting thermal energy storage to reduce data center capital and operating expenses , 2014, 2014 IEEE 20th International Symposium on High Performance Computer Architecture (HPCA).

[5]  Guillaume Pierre,et al.  Corrigendum to "Wikipedia workload analysis for decentralized hosting" [Computer Networks 53 (11) (2009) 1830-1845] , 2010, Comput. Networks.

[6]  Faraz Ahmad,et al.  Joint optimization of idle and cooling power in data centers while maintaining response time , 2010, ASPLOS 2010.

[7]  David Atienza,et al.  System-level thermal-aware design of 3D multiprocessors with inter-tier liquid cooling , 2011, 2011 17th International Workshop on Thermal Investigations of ICs and Systems (THERMINIC).

[8]  Jian Li,et al.  TAPO: Thermal-aware power optimization techniques for servers and data centers , 2011, 2011 International Green Computing Conference and Workshops.

[9]  M. Iyengar,et al.  Server liquid cooling with chiller-less data center design to enable significant energy savings , 2012, 2012 28th Annual IEEE Semiconductor Thermal Measurement and Management Symposium (SEMI-THERM).

[10]  Li Li,et al.  Coordinating Liquid and Free Air Cooling with Workload Allocation for Data Center Power Minimization , 2014, ICAC.

[11]  David Atienza,et al.  Energy-efficient variable-flow liquid cooling in 3D stacked architectures , 2010, 2010 Design, Automation & Test in Europe Conference & Exhibition (DATE 2010).

[12]  Eric Peterson,et al.  Hybrid cooled data center using above ambient liquid cooling , 2010, 2010 12th IEEE Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems.

[13]  Yin En Kwa.  Development of computational fluid dynamics (CFD) models for heat recovery system in buildings (ANSYS FLUENT) , 2016 .

[14]  Vincent P. Manno,et al.  Energy savings achievable through liquid cooling: A rack level case study , 2010, 2010 12th IEEE Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems.

[15]  Yuan Chen,et al.  Integrated management of application performance, power and cooling in data centers , 2010, 2010 IEEE Network Operations and Management Symposium - NOMS 2010.

[16]  Shen Li,et al.  Joint Optimization of Computing and Cooling Energy: Analytic Model and a Machine Room Case Study , 2012, 2012 IEEE 32nd International Conference on Distributed Computing Systems.

[17]  Jeffrey S. Chase,et al.  Weatherman: Automated, Online and Predictive Thermal Mapping and Management for Data Centers , 2006, 2006 IEEE International Conference on Autonomic Computing.

[18]  Xiaorui Wang,et al.  SHIP: Scalable Hierarchical Power Control for Large-Scale Data Centers , 2009, 2009 18th International Conference on Parallel Architectures and Compilation Techniques.

[19]  Linus Schrage,et al.  Implementation and Testing of a Branch-and-Bound Based Method for Deterministic Global Optimization: Operations Research Applications , 2004 .

[20]  Jeffrey S. Chase,et al.  Making Scheduling "Cool": Temperature-Aware Workload Placement in Data Centers , 2005, USENIX Annual Technical Conference, General Track.

[21]  Guillaume Pierre,et al.  Wikipedia workload analysis for decentralized hosting , 2009, Comput. Networks.

[22]  Arnold O. Allen,et al.  Probability, statistics and queueing theory - with computer science applications (2. ed.) , 1981, Int. CMG Conference.

[23]  Satheesh Abimannan,et al.  Energy Efficient Free Cooling System for Data Centers , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[24]  Thomas F. Wenisch,et al.  PowerNap: eliminating server idle power , 2009, ASPLOS.

[25]  M. Iyengar,et al.  Energy efficient economizer based data centers with air cooled servers , 2012, 13th InterSociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems.

[26]  Li Li,et al.  Placement optimization of liquid-cooled servers for power minimization in data centers , 2014, International Green Computing Conference.

[27]  Bianca Schroeder,et al.  Temperature management in data centers: why some (might) like it hot , 2012, SIGMETRICS '12.

[28]  Qinghui Tang,et al.  Sensor-Based Fast Thermal Evaluation Model For Energy Efficient High-Performance Datacenters , 2006, 2006 Fourth International Conference on Intelligent Sensing and Information Processing.

[29]  Xiaorui Wang,et al.  Data Center Sprinting: Enabling Computational Sprinting at the Data Center Level , 2015, 2015 IEEE 35th International Conference on Distributed Computing Systems.