Design of energy-efficient cloud systems via network and resource virtualization

Summary Data centers play a crucial role in the delivery of cloud services by enabling on-demand access to the shared resources such as software, platform and infrastructure. Virtual machine (VM) allocation is one of the challenging tasks in data center management since user requirements, typically expressed as service-level agreements, have to be met with the minimum operational expenditure. Despite their huge processing and storage facilities, data centers are among the major contributors to greenhouse gas emissions of IT services. In this paper, we propose a holistic approach for a large-scale cloud system where the cloud services are provisioned by several data centers interconnected over the backbone network. Leveraging the possibility to virtualize the backbone topology in order to bypass IP routers, which are major power consumers in the core network, we propose a mixed integer linear programming (MILP) formulation for VM placement that aims at minimizing both power consumption at the virtualized backbone network and resource usage inside data centers. Since the general holistic MILP formulation requires heavy and long-running computations, we partition the problem into two sub-problems, namely, intra and inter-data center VM placement. In addition, for the inter-data center VM placement, we also propose a heuristic to solve the virtualized backbone topology reconfiguration computation in reasonable time. We thoroughly assessed the performance of our proposed solution, comparing it with another notable MILP proposal in the literature; collected experimental results show the benefit of the proposed management scheme in terms of power consumption, resource utilization and fairness for medium size data centers. Copyright © 2013 John Wiley & Sons, Ltd.

[1]  Calton Pu,et al.  Mistral: Dynamically Managing Power, Performance, and Adaptation Cost in Cloud Infrastructures , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[2]  H. T. Mouftah,et al.  Inter-and-intra data center VM-placement for energy-efficient large-Scale cloud systems , 2012, 2012 IEEE Globecom Workshops.

[3]  Rajkumar Buyya,et al.  Power-aware provisioning of Cloud resources for real-time services , 2009, MGC '09.

[4]  Ayan Banerjee,et al.  Integrating cooling awareness with thermal aware workload placement for HPC data centers , 2011, Sustain. Comput. Informatics Syst..

[5]  Thomas Sandholm,et al.  What's inside the Cloud? An architectural map of the Cloud landscape , 2009, 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing.

[6]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[7]  Sandeep K. S. Gupta,et al.  Energy-Efficient Thermal-Aware Task Scheduling for Homogeneous High-Performance Computing Data Centers: A Cyber-Physical Approach , 2008, IEEE Transactions on Parallel and Distributed Systems.

[8]  Vasileios Pappas,et al.  Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement , 2010, 2010 Proceedings IEEE INFOCOM.

[9]  Xiaowen Dong,et al.  Green IP Over WDM Networks With Data Centers , 2011, Journal of Lightwave Technology.

[10]  Jeffrey O. Kephart,et al.  Runtime Demand Estimation for effective dynamic resource management , 2010, 2010 IEEE Network Operations and Management Symposium - NOMS 2010.

[11]  Lisandro Zambenedetti Granville,et al.  Data Center Network Virtualization: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[12]  Edmundo Roberto Mauro Madeira,et al.  Using virtual topologies to manage inter-domain QoS in next-generation networks , 2010, Int. J. Netw. Manag..

[13]  Vijay Mann,et al.  VMFlow: Leveraging VM Mobility to Reduce Network Power Costs in Data Centers , 2011, Networking.

[14]  Jeffrey S. Chase,et al.  Making Scheduling "Cool": Temperature-Aware Workload Placement in Data Centers , 2005, USENIX Annual Technical Conference, General Track.

[15]  Rodney S. Tucker,et al.  Green Cloud Computing: Balancing Energy in Processing, Storage, and Transport , 2011, Proceedings of the IEEE.

[16]  Meng Wang,et al.  Consolidating virtual machines with dynamic bandwidth demand in data centers , 2011, 2011 Proceedings IEEE INFOCOM.

[17]  Antonio Corradi,et al.  VM consolidation: A real case based on OpenStack Cloud , 2014, Future Gener. Comput. Syst..

[18]  Rina Panigrahy,et al.  Validating Heuristics for Virtual Machines Consolidation , 2011 .

[19]  Antonio Corradi,et al.  Increasing Cloud power efficiency through consolidation techniques , 2011, 2011 IEEE Symposium on Computers and Communications (ISCC).

[20]  H. T. Mouftah,et al.  Designing an energy-efficient cloud network [Invited] , 2012, IEEE/OSA Journal of Optical Communications and Networking.

[21]  Antonio Corradi,et al.  A Stable Network-Aware VM Placement for Cloud Systems , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[22]  Kurt Maly,et al.  Analysis of Energy Efficiency in Clouds , 2009, 2009 Computation World: Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns.

[23]  H. T. Mouftah,et al.  Energy-Efficient Cloud Services over Wavelength-Routed Optical Transport Networks , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[24]  Neal Charbonneau,et al.  Routing and Wavelength Assignment of Static Manycast Demands Over All-Optical Wavelength-Routed WDM Networks , 2010, IEEE/OSA Journal of Optical Communications and Networking.

[25]  Chris Develder,et al.  Improving energy efficiency in optical cloud networks by exploiting anycast routing , 2011, 2011 Asia Communications and Photonics Conference and Exhibition (ACP).

[26]  Halima Elbiaze,et al.  Network virtualization under user control , 2008, Int. J. Netw. Manag..