An Energy and Performance Aware Consolidation Technique for Containerized Datacenters

Cloud datacenters have become a backbone for today's business and economy, which are the fastest-growing electricity consumers, globally. Numerous studies suggest that ~30% of the US datacenters are comatose and the others are grossly less-utilized, which make it possible to save energy through resource consolidation techniques. However, consolidation comprises migrations that are expensive in terms of energy consumption and performance degradation, which is mostly not accounted for in many existing models, and, possibly, it could be more energy and performance efficient not to consolidate. In this paper, we investigate how migration decisions should be taken so that the migration cost is recovered, as only when migration cost has been recovered and performance is guaranteed, will energy start to be saved. We demonstrate through several experiments, using the Google workload data for 12,583 hosts and approximately one million tasks that belong to three different kinds of workload, how different allocation policies, combined with various migration approaches, will impact on datacenter's energy and performance efficiencies. Using several plausible assumptions for containerised datacenter set-up, we suggest, that a combination of the proposed energy-performance-aware allocation (Epc-Fu) and migration (Cper) techniques, and migrating relatively long-running containers only, offers for ideal energy and performance efficiencies.

[1]  Kohei Ichikawa,et al.  Container Rebalancing: Towards Proactive Linux Containers Placement Optimization in a Data Center , 2017, 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC).

[2]  Hai Jin,et al.  Performance and energy modeling for live migration of virtual machines , 2011, Cluster Computing.

[3]  Raouf Boutaba,et al.  Characterizing Task Usage Shapes in Google Compute Clusters , 2011 .

[4]  Randy H. Katz,et al.  Heterogeneity and dynamicity of clouds at scale: Google trace analysis , 2012, SoCC '12.

[5]  E. N. Elnozahy,et al.  Energy-Efficient Server Clusters , 2002, PACS.

[6]  Mor Harchol-Balter,et al.  Stochastic Models and Analysis for Resource Management in Server Farms , 2011 .

[7]  Richard E. Brown,et al.  United States Data Center Energy Usage Report , 2016 .

[8]  Niroj Pokhrel Live Container Migration : Opportunities and Challenges , 2016 .

[9]  Maurice Herlihy,et al.  Proceedings of the Tenth European Conference on Computer Systems , 2015, EuroSys.

[10]  Joel Nider,et al.  Cross-ISA Container Migration , 2016, SYSTOR.

[11]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[12]  Lee Gillam,et al.  Performance Evaluation for Cost-Efficient Public Infrastructure Cloud Use , 2014, GECON.

[13]  Jie Liu,et al.  Algorithm Design for Performance Aware VM Consolidation , 2013 .

[14]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[15]  Feng Zhao,et al.  Virtual machine power metering and provisioning , 2010, SoCC '10.

[16]  Shripad Nadgowda,et al.  Voyager: Complete Container State Migration , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[17]  Fei Huan,et al.  Live Migration of Docker Containers through Logging and Replay , 2015, ICM 2015.

[18]  Karl Aberer,et al.  Impact of Instance Seeking Strategies on Resource Allocation in Cloud Data Centers , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[19]  Rajkumar Buyya,et al.  A Framework and Algorithm for Energy Efficient Container Consolidation in Cloud Data Centers , 2015, 2015 IEEE International Conference on Data Science and Data Intensive Systems.

[20]  Rajkumar Buyya,et al.  ContainerCloudSim: An environment for modeling and simulation of containers in cloud data centers , 2017, Softw. Pract. Exp..

[21]  César A. F. De Rose,et al.  Server consolidation with migration control for virtualized data centers , 2011, Future Gener. Comput. Syst..

[22]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[23]  Sheng Di,et al.  Characterization and Comparison of Cloud versus Grid Workloads , 2012, 2012 IEEE International Conference on Cluster Computing.

[24]  Mor Harchol-Balter,et al.  Energy-Efficient Dynamic Capacity Provisioning in Server Farms , 2010 .

[25]  Mohsen Guizani,et al.  An Energy-Efficient VM Prediction and Migration Framework for Overcommitted Clouds , 2018, IEEE Transactions on Cloud Computing.

[26]  Lizy Kurian John,et al.  Complete System Power Estimation Using Processor Performance Events , 2012, IEEE Transactions on Computers.

[27]  Ricardo Bianchini,et al.  Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms , 2017, SOSP.

[28]  Thomas F. Wenisch,et al.  The PowerNap Server Architecture , 2011, TOCS.

[29]  Guillaume Pierre,et al.  An experiment-driven energy consumption model for virtual machine management systems , 2018, Sustain. Comput. Informatics Syst..

[30]  Abhishek Verma,et al.  Large-scale cluster management at Google with Borg , 2015, EuroSys.

[31]  Gautam Kar,et al.  Application Performance Management in Virtualized Server Environments , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[32]  Kin K. Leung,et al.  Live Service Migration in Mobile Edge Clouds , 2017, IEEE Wireless Communications.

[33]  Muhammad Zakarya,et al.  An Extended Energy-Aware Cost Recovery Approach for Virtual Machine Migration , 2019, IEEE Systems Journal.

[34]  Shahaboddin Shamshirband,et al.  Sustainable Cloud Data Centers: A survey of enabling techniques and technologies , 2016 .

[35]  Lee Gillam,et al.  An Energy Aware Cost Recovery Approach for Virtual Machine Migration , 2016, GECON.

[36]  Y. C. Tay,et al.  A Performance Comparison of Containers and Virtual Machines in Workload Migration Context , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW).

[37]  Muhammad Zakarya,et al.  Energy and performance aware resource management in heterogeneous cloud datacenters , 2017 .

[38]  Sareh Fotuhi Piraghaj Energy-efficient management of resources in container-based clouds , 2016 .

[39]  Mathijs Jeroen Scheepers Virtualization and Containerization of Application Infrastructure : A Comparison , 2014 .

[40]  Ian Foster,et al.  Predicting application run times with historical information , 2004, J. Parallel Distributed Comput..

[41]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[42]  Ramakrishnan Rajamony,et al.  An updated performance comparison of virtual machines and Linux containers , 2015, 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS).

[43]  Philippe Merle,et al.  Elasticity in Cloud Computing: State of the Art and Research Challenges , 2018, IEEE Transactions on Services Computing.