Energy aware resource allocation of cloud data center: review and open issues

The demand for cloud computing is increasing dramatically due to the high computational requirements of business, social, web and scientific applications. Nowadays, applications and services are hosted on the cloud in order to reduce the costs of hardware, software and maintenance. To satisfy this high demand, the number of large-scale data centers has increased, which consumes a high volume of electrical power, has a negative impact on the environment, and comes with high operational costs. In this paper, we discuss many ongoing or implemented energy aware resource allocation techniques for cloud environments. We also present a comprehensive review on the different energy aware resource allocation and selection algorithms for virtual machines in the cloud. Finally, we come up with further research issues and challenges for future cloud environments.

[1]  L. Minas,et al.  Energy Efficiency for Information Technology: How to Reduce Power Consumption in Servers and Data Centers , 2009 .

[2]  Maciej Drozdowski,et al.  Scheduling with Communication Delays , 2009 .

[3]  Jun Cai,et al.  Spectral–Energy Efficiency Tradeoff in Full-Duplex Two-Way Relay Networks , 2018, IEEE Systems Journal.

[4]  Paul J. Kühn,et al.  Automatic energy efficiency management of data center resources by load-dependent server activation and sleep modes , 2015, Ad Hoc Networks.

[5]  E. N. Elnozahy,et al.  Energy-Efficient Server Clusters , 2002, PACS.

[6]  Amnon Barak,et al.  The MOSIX multicomputer operating system for high performance cluster computing , 1998, Future Gener. Comput. Syst..

[7]  Mohamed Othman,et al.  Brokering and Load-Balancing Mechanism in the Cloud – Revisited , 2014 .

[8]  Salvatore Tucci,et al.  Performance Evaluation of Complex Systems: Techniques and Tools , 2002, Lecture Notes in Computer Science.

[9]  Jaume Salom,et al.  The location as an energy efficiency and renewable energy supply measure for data centres in Europe , 2015 .

[10]  Jeffrey S. Chase,et al.  Balance of power: dynamic thermal management for Internet data centers , 2005, IEEE Internet Computing.

[11]  Nagarajan Kandasamy,et al.  Power and performance management of virtualized computing environments via lookahead control , 2008, 2008 International Conference on Autonomic Computing.

[12]  Keqin Li,et al.  Power and performance management for parallel computations in clouds and data centers , 2016, J. Comput. Syst. Sci..

[13]  Minglu Li,et al.  Energy Efficient Allocation of Virtual Machines in Cloud Computing Environments Based on Demand Forecast , 2012, GPC.

[14]  Enzo Baccarelli,et al.  Energy-saving self-configuring networked data centers , 2013, Comput. Networks.

[15]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[16]  Calton Pu,et al.  A Cost-Sensitive Adaptation Engine for Server Consolidation of Multitier Applications , 2009, Middleware.

[17]  Suresh Singh,et al.  Greening of the internet , 2003, SIGCOMM '03.

[18]  Santhi Baskaran,et al.  A Dynamic Slack Management Technique for Real-Time System with Precedence and Resource Constraints , 2011 .

[19]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[20]  Xia Li,et al.  Hybrid shuffled frog leaping algorithm for energy-efficient dynamic consolidation of virtual machines in cloud data centers , 2014, Expert Syst. Appl..

[21]  Osman S. Unsal,et al.  ParaDIME: Parallel Distributed Infrastructure for Minimization of Energy for data centers , 2015, Microprocess. Microsystems.

[22]  Margo I. Seltzer,et al.  Isolation with Flexibility: A Resource Management Framework for Central Servers , 2000, USENIX Annual Technical Conference, General Track.

[23]  Thomas F. Wenisch,et al.  PowerNap: eliminating server idle power , 2009, ASPLOS.

[24]  Martin Bichler,et al.  More than bin packing: Dynamic resource allocation strategies in cloud data centers , 2015, Inf. Syst..

[25]  Thu D. Nguyen,et al.  Parasol and GreenSwitch: managing datacenters powered by renewable energy , 2013, ASPLOS '13.

[26]  Xinying Zheng,et al.  Energy-aware load dispatching in geographically located Internet data centers , 2011, Sustain. Comput. Informatics Syst..

[27]  Parisa Ghodous,et al.  An Innovative Energy-Aware Cloud Task Scheduling Framework , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[28]  Ishfaq Ahmad,et al.  A Cooperative Game Theoretical Technique for Joint Optimization of Energy Consumption and Response Time in Computational Grids , 2009, IEEE Transactions on Parallel and Distributed Systems.

[29]  Rajkumar Buyya,et al.  A Heuristic for Mapping Virtual Machines and Links in Emulation Testbeds , 2009, 2009 International Conference on Parallel Processing.

[30]  T. N. Vijaykumar,et al.  Heat-and-run: leveraging SMT and CMP to manage power density through the operating system , 2004, ASPLOS XI.

[31]  Mateusz Jarus,et al.  Performance bounded energy efficient virtual machine allocation in the global cloud , 2014, Sustain. Comput. Informatics Syst..

[32]  Sonja Klingert,et al.  Renewable energy-aware data centre operations for smart cities the DC4Cities approach , 2015, 2015 International Conference on Smart Cities and Green ICT Systems (SMARTGREENS).

[33]  A. Wierman,et al.  Optimality, fairness, and robustness in speed scaling designs , 2010, SIGMETRICS '10.

[34]  Xi He,et al.  Power-aware scheduling of virtual machines in DVFS-enabled clusters , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[35]  Mohamed Othman,et al.  EVALUATION OF CLOUD BROKERING ALGORITHMS IN CLOUD BASED DATA CENTER , 2015 .

[36]  Drazen Fabris,et al.  Servers and data centers energy performance metrics , 2014 .

[37]  Dario Pompili,et al.  Energy-Efficient Thermal-Aware Autonomic Management of Virtualized HPC Cloud Infrastructure , 2012, Journal of Grid Computing.

[38]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[39]  Leandro Navarro-Moldes,et al.  A Stackelberg game to derive the limits of energy savings for the allocation of data center resources , 2013, Future Gener. Comput. Syst..

[40]  Gargi Dasgupta,et al.  Server Workload Analysis for Power Minimization using Consolidation , 2009, USENIX Annual Technical Conference.

[41]  Albert Y. Zomaya,et al.  Energy Conscious Scheduling for Distributed Computing Systems under Different Operating Conditions , 2011, IEEE Transactions on Parallel and Distributed Systems.

[42]  Fermín Galán Márquez,et al.  From infrastructure delivery to service management in clouds , 2010, Future Gener. Comput. Syst..

[43]  Ricardo Bianchini,et al.  Nomad: a scalable operating system for clusters of uni- and multiprocessors , 1999, ICWC 99. IEEE Computer Society International Workshop on Cluster Computing.

[44]  Ibrahim Matta,et al.  GreenCoop: cooperative green routing with energy-efficient servers , 2010, e-Energy.

[45]  Karl R. Haapala,et al.  Real-time monitoring and evaluation of energy efficiency and thermal management of data centers , 2015 .

[46]  Dimitrios S. Nikolopoulos Green Building Blocks - Software Stacks for Energy-Efficient Clusters and Data Centres , 2009, ERCIM News.

[47]  Lu Peng,et al.  Operational Cost Optimization for Cloud Computing Data Centers Using Renewable Energy , 2016, IEEE Systems Journal.

[48]  Jordi Torres,et al.  Creating Power-Aware Middleware for Energy-Efficient Data Centres , 2009, ERCIM News.

[49]  Azizah Abdul Rahman,et al.  Energy efficiency and low carbon enabler green it framework for data centers considering green metrics , 2012 .

[50]  Yves Robert,et al.  Energy-aware scheduling under reliability and makespan constraints , 2011, 2012 19th International Conference on High Performance Computing.

[51]  Noah Pflugradt,et al.  Overview of direct air free cooling and thermal energy storage potential energy savings in data centres , 2015 .

[52]  Shriram Raghunathan,et al.  Heterogeneity and thermal aware adaptive heuristics for energy efficient consolidation of virtual machines in infrastructure clouds , 2016, J. Comput. Syst. Sci..

[53]  Gabor Kecskemeti,et al.  DISSECT-CF: A simulator to foster energy-aware scheduling in infrastructure clouds , 2015, Simul. Model. Pract. Theory.

[54]  Vanish Talwar,et al.  No "power" struggles: coordinated multi-level power management for the data center , 2008, ASPLOS.

[55]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[56]  Adam Wierman,et al.  Renewable and cooling aware workload management for sustainable data centers , 2012, SIGMETRICS '12.

[57]  Wen-Jing Hsu,et al.  Non-clairvoyant speed scaling for batched parallel jobs on multiprocessors , 2009, CF '09.

[58]  Jean-Marc Pierson,et al.  Energy-Efficient and Thermal-Aware Resource Management for Heterogeneous Datacenters , 2014, Sustain. Comput. Informatics Syst..

[59]  Jeffrey S. Chase,et al.  Making Scheduling "Cool": Temperature-Aware Workload Placement in Data Centers , 2005, USENIX Annual Technical Conference, General Track.

[60]  Jaume Salom,et al.  Energy-efficient, thermal-aware modeling and simulation of data centers: The CoolEmAll approach and evaluation results , 2015, Ad Hoc Networks.

[61]  Dzmitry Kliazovich,et al.  DENS: Data Center Energy-Efficient Network-Aware Scheduling , 2010, GreenCom/CPSCom.

[62]  Alexis Kwasinski,et al.  Distributed (green) data centers: A new concept for energy, computing, and telecommunications , 2014 .

[63]  Thu D. Nguyen,et al.  Designing and Managing Data centers Powered by Renewable Energy , 2014, IEEE Micro.

[64]  Mohamed Othman,et al.  Energy efficient virtual machine provisioning in cloud data centers , 2014, 2014 IEEE 2nd International Symposium on Telecommunication Technologies (ISTT).

[65]  Ishfaq Ahmad,et al.  Fast Algorithms for Simultaneous Optimization of Performance , Energy and Temperature in DAG Scheduling on Multi-Core Processors , 2012 .

[66]  Allan Borodin,et al.  On the power of randomization in online algorithms , 1990, STOC '90.

[67]  Paul Barford,et al.  Generating representative Web workloads for network and server performance evaluation , 1998, SIGMETRICS '98/PERFORMANCE '98.

[68]  Marco Mellia,et al.  Energy saving and network performance: a trade-off approach , 2010, e-Energy.

[69]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[70]  Enrique V. Carrera,et al.  Load balancing and unbalancing for power and performance in cluster-based systems , 2001 .

[71]  Gerald Kotonya,et al.  A resource-aware framework for resource-constrained service-oriented systems , 2015, Future Gener. Comput. Syst..

[72]  Mohamed Othman,et al.  Optimized load balancing for efficient resource provisioning in the cloud , 2014, 2014 IEEE 2nd International Symposium on Telecommunication Technologies (ISTT).

[73]  Weisong Shi,et al.  RESCUE: An energy-aware scheduler for cloud environments , 2014, Sustain. Comput. Informatics Syst..

[74]  Rajkumar Buyya,et al.  Energy Efficient Resource Management in Virtualized Cloud Data Centers , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[75]  Qiang He,et al.  An energy consumption model and analysis tool for Cloud computing environments , 2012, 2012 First International Workshop on Green and Sustainable Software (GREENS).

[76]  Laurent Lefèvre,et al.  Multi-facet approach to reduce energy consumption in clouds and grids: the GREEN-NET framework , 2010, e-Energy.

[77]  Dang Minh Quan,et al.  T-Alloc: A practical energy efficient resource allocation algorithm for traditional data centers , 2012, Future Gener. Comput. Syst..

[78]  Hamed Mohsenian Rad,et al.  Energy and Performance Management of Green Data Centers: A Profit Maximization Approach , 2013, IEEE Transactions on Smart Grid.

[79]  Dror G. Feitelson,et al.  Workload Modeling for Performance Evaluation , 2002, Performance.

[80]  A. B. M. Shawkat Ali,et al.  A survey on gaps, threat remediation challenges and some thoughts for proactive attack detection in cloud computing , 2012, Future Gener. Comput. Syst..

[81]  Fei Zhang,et al.  Simulation of power consumption of cloud data centers , 2013, Simul. Model. Pract. Theory.

[82]  Cao Jian,et al.  Energy Efficient Allocation of Virtual Machines in Cloud Computing Environments Based on Demand Forecast , 2013 .

[83]  Allan Borodin,et al.  Online computation and competitive analysis , 1998 .

[84]  Aameek Singh,et al.  Shares and utilities based power consolidation in virtualized server environments , 2009, 2009 IFIP/IEEE International Symposium on Integrated Network Management.

[85]  László Gyarmati,et al.  How can architecture help to reduce energy consumption in data center networking? , 2010, e-Energy.

[86]  Feng Zhao,et al.  Energy aware consolidation for cloud computing , 2008, CLUSTER 2008.

[87]  Jeffrey M. Galloway,et al.  Decreasing power consumption with energy efficient data aware strategies , 2013, Future Gener. Comput. Syst..

[88]  Jordi Torres,et al.  Towards energy-aware scheduling in data centers using machine learning , 2010, e-Energy.

[89]  Xiao Zhang,et al.  A high-level energy consumption model for heterogeneous data centers , 2013, Simul. Model. Pract. Theory.

[90]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[91]  Wei Du,et al.  An energy efficient clustering-based scheduling algorithm for parallel tasks on homogeneous DVS-enabled clusters , 2012, Proceedings of the 2012 IEEE 16th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[92]  Derek McAuley,et al.  Energy is just another resource: energy accounting and energy pricing in the Nemesis OS , 2001, Proceedings Eighth Workshop on Hot Topics in Operating Systems.

[93]  Karsten Schwan,et al.  VirtualPower: coordinated power management in virtualized enterprise systems , 2007, SOSP.

[94]  Jongmoo Choi,et al.  Towards greener data centers with storage class memory , 2013, Future Gener. Comput. Syst..

[95]  Luca G. Gianoli Energy-Aware Traffic Engineering for Wired IP Networks , 2014 .

[96]  Johanne Cohen,et al.  A packing problem approach to energy-aware load distribution in Clouds , 2014, Sustain. Comput. Informatics Syst..

[97]  Keqin Li Optimal configuration of a multicore server processor for managing the power and performance tradeoff , 2011, The Journal of Supercomputing.

[98]  Gabriel Antoniu,et al.  Governing energy consumption in Hadoop through CPU frequency scaling: An analysis , 2016, Future Gener. Comput. Syst..

[99]  Mor Harchol-Balter,et al.  Optimal power allocation in server farms , 2009, SIGMETRICS '09.

[100]  Thiruvengadam Radhakrishnan,et al.  An Integrated Workstation for the Visually Handicapped , 1983, IEEE Micro.

[101]  Young Myoung Ko,et al.  A distributed speed scaling and load balancing algorithm for energy efficient data centers , 2014, Perform. Evaluation.

[102]  Madhu Sharma,et al.  Analyzing the Data Center Efficiency by Using PUE to Make Data Centers More Energy Efficient by Reducing the Electrical Consumption and Exploring New Strategies , 2015 .

[103]  Albert Y. Zomaya,et al.  A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems , 2010, Adv. Comput..

[104]  Hui Li,et al.  Workload dynamics on clusters and grids , 2008, The Journal of Supercomputing.

[105]  David E. Irwin,et al.  Ensemble-level Power Management for Dense Blade Servers , 2006, 33rd International Symposium on Computer Architecture (ISCA'06).

[106]  Michel Savoie,et al.  Powering a Data Center Network via Renewable Energy: A Green Testbed , 2013, IEEE Internet Computing.