Optimizing the Energy Consumption of Servers and Networks in Cloud Data Centers

Data center is a cost-effective infrastructure for storing large volumes of data and hosting large- scale service applications. Cloud computing service providers are rapidly deploying data centers across the world. with huge number of servers and switches. These data centers consume sig- nificant amounts of energy, contributing to high operational costs. Thus, optimizing the energy consumption of servers and networks in data centers can reduce operational costs. In a data center, power consumption is mainly due to servers, networking devices, and cooling systems, an effective energy saving strategy is to consolidate the computation and communication into smaller number of servers and network devices and then power off as many unneeded servers and network devices as possible. In this thesis, we propose several novel methods to reduce the energy consumption of computer systems and networks in data centers, while satisfying Quality of Service (QoS) requirements specified by cloud tenants. First, we study energy efficient scheduling of periodic real-time tasks on multi-core proces- sors with voltage islands, in which cores are partitioned into multiple blocks (termed voltage is- lands). We propose a Voltage Island Largest Capacity First (VILCF) algorithm for energy efficient scheduling of periodic real-time tasks on multi-core processors. It achieves better energy efficiency by fully utilizing the remaining capacity of an island before turning on more islands or increas- ing the voltage level of the current active islands. We provide detailed theoretical analysis of the approximation ratio of the proposed VILCF algorithm in terms of energy efficiency. Second, we study the resource allocation problem for virtual networks in data centers. A cloud tenant expresses computation requirement for each virtual machine (VM) and bandwidth

[1]  Kang G. Shin,et al.  Real-time dynamic voltage scaling for low-power embedded operating systems , 2001, SOSP.

[2]  Wang Yi,et al.  Energy-efficient scheduling of real-time tasks on cluster-based multicores , 2011, 2011 Design, Automation & Test in Europe.

[3]  Naixue Xiong,et al.  VMPlanner: Optimizing virtual machine placement and traffic flow routing to reduce network power costs in cloud data centers , 2013, Comput. Networks.

[4]  Bishop Brock,et al.  Dynamic Power Management for Embedded Systems , 2003 .

[5]  Jun Liu,et al.  Voltage Island Aware Energy Efficient Scheduling of Real-Time Tasks on Multi-core Processors , 2014, 2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS).

[6]  Hakan Aydin,et al.  Energy-aware task allocation for rate monotonic scheduling , 2005, 11th IEEE Real Time and Embedded Technology and Applications Symposium.

[7]  Minghua Chen,et al.  Joint VM placement and routing for data center traffic engineering , 2012, 2012 Proceedings IEEE INFOCOM.

[8]  Anees Shaikh,et al.  CloudNaaS: a cloud networking platform for enterprise applications , 2011, SoCC.

[9]  Prathima Agrawal,et al.  Power-aware SoC test optimization through dynamic voltage and frequency scaling , 2013, 2013 IFIP/IEEE 21st International Conference on Very Large Scale Integration (VLSI-SoC).

[10]  Pedro López,et al.  Dynamic power saving in fat-tree interconnection networks using on/off links , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[11]  Jun Liu,et al.  Energy efficient scheduling of real-time tasks on multi-core processors with voltage islands , 2016, Future Gener. Comput. Syst..

[12]  Tei-Wei Kuo,et al.  Multiprocessor energy-efficient scheduling with task migration considerations , 2004, Proceedings. 16th Euromicro Conference on Real-Time Systems, 2004. ECRTS 2004..

[13]  D. Geer,et al.  Chip makers turn to multicore processors , 2005, Computer.

[14]  Dinan Gunawardena,et al.  Chatty Tenants and the Cloud Network Sharing Problem , 2013, NSDI.

[15]  Vasileios Pappas,et al.  Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement , 2010, 2010 Proceedings IEEE INFOCOM.

[16]  Massoud Pedram,et al.  Energy Minimization Using Multiple Supply Voltages , 1997 .

[17]  Radu Marculescu,et al.  Architecting voltage islands in core-based system-on-a-chip designs , 2004, Proceedings of the 2004 International Symposium on Low Power Electronics and Design (IEEE Cat. No.04TH8758).

[18]  Tei-Wei Kuo,et al.  Leakage-Aware Energy-Efficient Scheduling of Real-Time Tasks in Multiprocessor Systems , 2006, 12th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS'06).

[19]  Xue Liu,et al.  Power Saving Design for Servers under Response Time Constraint , 2010, 2010 22nd Euromicro Conference on Real-Time Systems.

[20]  Sujata Banerjee,et al.  ElasticSwitch: practical work-conserving bandwidth guarantees for cloud computing , 2013, SIGCOMM.

[21]  Helen J. Wang,et al.  SecondNet: a data center network virtualization architecture with bandwidth guarantees , 2010, CoNEXT.

[22]  Hitesh Ballani,et al.  Towards predictable datacenter networks , 2011, SIGCOMM 2011.

[23]  Alexander Stage,et al.  Network-aware migration control and scheduling of differentiated virtual machine workloads , 2009, 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing.

[24]  Sujata Banerjee,et al.  Application-driven bandwidth guarantees in datacenters , 2015, SIGCOMM.

[25]  John M. Cohn,et al.  Managing power and performance for System-on-Chip designs using Voltage Islands , 2002, ICCAD 2002.

[26]  Luís Henrique Maciel Kosmalski Costa,et al.  Online traffic-aware virtual machine placement in data center networks , 2012, 2012 Global Information Infrastructure and Networking Symposium (GIIS).

[27]  Amin Vahdat,et al.  PortLand: a scalable fault-tolerant layer 2 data center network fabric , 2009, SIGCOMM '09.

[28]  Haitao Wu,et al.  BCube: a high performance, server-centric network architecture for modular data centers , 2009, SIGCOMM '09.

[29]  Ning Ding,et al.  The only constant is change: incorporating time-varying network reservations in data centers , 2012, SIGCOMM.

[30]  Athanasios V. Vasilakos,et al.  GreenDCN: A General Framework for Achieving Energy Efficiency in Data Center Networks , 2013, IEEE Journal on Selected Areas in Communications.

[31]  Josep Torrellas,et al.  Variation-Aware Application Scheduling and Power Management for Chip Multiprocessors , 2008, 2008 International Symposium on Computer Architecture.

[32]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[33]  Li-Shiuan Peh,et al.  Dynamic power management for power optimization of interconnection networks using on/off links , 2003, 11th Symposium on High Performance Interconnects, 2003. Proceedings..

[34]  Li-Chun Wang,et al.  EQVMP: Energy-efficient and QoS-aware virtual machine placement for software defined datacenter networks , 2014, The International Conference on Information Networking 2014 (ICOIN2014).

[35]  Meng Wang,et al.  Consolidating virtual machines with dynamic bandwidth demand in data centers , 2011, 2011 Proceedings IEEE INFOCOM.

[36]  Jian-Jia Chen,et al.  Energy efficiency analysis for the Single Frequency Approximation (SFA) scheme , 2013, 2013 IEEE 19th International Conference on Embedded and Real-Time Computing Systems and Applications.

[37]  Albert G. Greenberg,et al.  A flexible model for resource management in virtual private networks , 1999, SIGCOMM '99.

[38]  Mahmut T. Kandemir,et al.  Leakage Current: Moore's Law Meets Static Power , 2003, Computer.

[39]  Joonwon Lee,et al.  Energy Efficient Scheduling of Real-Time Tasks on Multicore Processors , 2008, IEEE Transactions on Parallel and Distributed Systems.

[40]  Dan Li,et al.  Towards bandwidth guarantee in multi-tenancy cloud computing networks , 2012, 2012 20th IEEE International Conference on Network Protocols (ICNP).

[41]  Luca Benini,et al.  A survey of design techniques for system-level dynamic power management , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[42]  Qi Yang,et al.  Energy-aware partitioning for multiprocessor real-time systems , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[43]  Feng Zhao,et al.  Energy aware consolidation for cloud computing , 2008, CLUSTER 2008.

[44]  V. von Kaenel,et al.  A voltage reduction technique for battery-operated systems , 1990 .

[45]  Dakai Zhu,et al.  Energy Efficient Block-Partitioned Multicore Processors for Parallel Applications , 2011, Journal of Computer Science and Technology.

[46]  Dzmitry Kliazovich,et al.  DENS: Data Center Energy-Efficient Network-Aware Scheduling , 2010, GreenCom/CPSCom.

[47]  Jie Wu,et al.  Let's stay together: Towards traffic aware virtual machine placement in data centers , 2012, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[48]  Ion Stoica,et al.  FairCloud: sharing the network in cloud computing , 2011, SIGCOMM '12.

[49]  Mahmut T. Kandemir,et al.  Compiler-Directed Energy Reduction Using Dynamic Voltage Scaling and Voltage Islands for Embedded Systems , 2013, IEEE Transactions on Computers.

[50]  Rajkumar Buyya,et al.  Energy Efficient Resource Management in Virtualized Cloud Data Centers , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[51]  Rami G. Melhem,et al.  Energy aware scheduling for distributed real-time systems , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[52]  Konstantin Andreev,et al.  Balanced Graph Partitioning , 2004, SPAA '04.

[53]  Xue Liu,et al.  Challenges Towards Elastic Power Management in Internet Data Centers , 2009, 2009 29th IEEE International Conference on Distributed Computing Systems Workshops.

[54]  Lei Shi,et al.  Dcell: a scalable and fault-tolerant network structure for data centers , 2008, SIGCOMM '08.

[55]  Dorgival O. Guedes,et al.  Gatekeeper: Supporting Bandwidth Guarantees for Multi-tenant Datacenter Networks , 2011, WIOV.

[56]  Sujata Banerjee,et al.  ElasticTree: Saving Energy in Data Center Networks , 2010, NSDI.

[57]  I-Min Liu,et al.  Post-placement voltage island generation under performance requirement , 2005, ICCAD-2005. IEEE/ACM International Conference on Computer-Aided Design, 2005..

[58]  Massoud Pedram,et al.  Dynamic voltage and frequency scaling for energy-efficient system design , 2005 .

[59]  Leonard Kleinrock,et al.  A Queue with Starter and a Queue with Vacations: Delay Analysis by Decomposition , 1986, Oper. Res..

[60]  Vipin Kumar,et al.  Multi-capacity bin packing algorithms with applications to job scheduling under multiple constraints , 1999, Proceedings of the 1999 International Conference on Parallel Processing.

[61]  Ke Xu,et al.  Achieving bandwidth guarantees in multi-tenant cloud networks using a dual-hose model , 2014, 2014 IEEE 33rd International Performance Computing and Communications Conference (IPCCC).

[62]  Xue Liu,et al.  PowerSleep: A Smart Power-Saving Scheme With Sleep for Servers Under Response Time Constraint , 2011, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[63]  Majid Sarrafzadeh,et al.  Variable voltage scheduling , 1995, ISLPED '95.

[64]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[65]  Xue Liu,et al.  Power-Saving Design for Server Farms with Response Time Percentile Guarantees , 2012, 2012 IEEE 18th Real Time and Embedded Technology and Applications Symposium.

[66]  Stephen P. Crago,et al.  Dynamic power management of multiprocessor systems , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[67]  Vinay Devadas,et al.  Coordinated power management of periodic real-time tasks on chip multiprocessors , 2010, International Conference on Green Computing.

[68]  Richard J. Anderson,et al.  Parallel Approximation Algorithms for Bin Packing , 1988, Inf. Comput..

[69]  Rami G. Melhem,et al.  Dynamic and aggressive scheduling techniques for power-aware real-time systems , 2001, Proceedings 22nd IEEE Real-Time Systems Symposium (RTSS 2001) (Cat. No.01PR1420).

[70]  Emil Talpes,et al.  Toward a multiple clock/voltage island design style for power-aware processors , 2005, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[71]  Yao-Wen Chang,et al.  Voltage island aware floorplanning for power and timing optimization , 2006, ICCAD.

[72]  Chia-Ming Wu,et al.  A green energy-efficient scheduling algorithm using the DVFS technique for cloud datacenters , 2014, Future Gener. Comput. Syst..

[73]  Lisandro Zambenedetti Granville,et al.  Data Center Network Virtualization: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[74]  Josep Torrellas,et al.  A Chip-Multiprocessor Architecture with Speculative Multithreading , 1999, IEEE Trans. Computers.

[75]  Mingwei Xu,et al.  Energy-aware routing in data center network , 2010, Green Networking '10.

[76]  Narayanan Vijaykrishnan,et al.  Reliability-aware SOC voltage islands partition and floorplan , 2006, IEEE Computer Society Annual Symposium on Emerging VLSI Technologies and Architectures (ISVLSI'06).

[77]  Antonia Zhai,et al.  Enabling improved power management in multicore processors through clustered DVFS , 2010, 2011 Design, Automation & Test in Europe.

[78]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.