A static VM placement and hybrid job scheduling model for green data centers

Reducing energy consumption has become a critical issue in today data centers. Reducing the number of required physical and Virtual Machines results in energy-efficiency. In this paper, to avoid the disadvantages of VM migration, a static VM placement algorithm is proposed which places VMs on hosts in a Worst-Fit-Decreasing (WFD) fashion. To reduce energy consumption further, the effect of job scheduling policy on the number of VMs needed for maintaining QoS requirements is studied. Each VM is modeled by an M/M/* queue in space-shared, time-shared, and hybrid job scheduling policies, and energy consumption of real-time as well as non-real-time applications is analyzed. Numerical results show that the hybrid policy outperforms space-shared and time-shared policies, in terms of energy consumption as well as Service Level Agreement (SLA) violations. Moreover, our non-migration method outperforms three different algorithms which use VM migration, in terms of reducing both energy consumption and SLA Violations.

[1]  Haiying Shen,et al.  CompVM: A Complementary VM Allocation Mechanism for Cloud Systems , 2018, IEEE/ACM Transactions on Networking.

[2]  Fang Dong,et al.  Resource provisioning optimization for service hosting on cloud platform , 2016, 2016 IEEE 20th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[3]  Edward G. Coffman,et al.  Waiting Time Distributions for Processor-Sharing Systems , 1970, JACM.

[4]  Philip Samuel,et al.  Virtual Machine Placement for Improved Quality in IaaS Cloud , 2014, 2014 Fourth International Conference on Advances in Computing and Communications.

[5]  Zhenhuan Gong,et al.  PRESS: PRedictive Elastic ReSource Scaling for cloud systems , 2010, 2010 International Conference on Network and Service Management.

[6]  Duc T. Nguyen,et al.  Numerical Methods with Applications , 2011 .

[7]  Martin Bichler,et al.  Capacity Planning for Virtualized Servers , 2007 .

[8]  Omer F. Rana,et al.  Feedback-Control & Queueing Theory-Based Resource Management for Streaming Applications , 2017, IEEE Transactions on Parallel and Distributed Systems.

[9]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[10]  Jim Kurose,et al.  Computer Networking: A Top-Down Approach , 1999 .

[11]  Martin Bichler,et al.  Capacity Planning for Virtualized Servers 1 , 2008 .

[12]  Mohsen Guizani,et al.  An Energy-Efficient VM Prediction and Migration Framework for Overcommitted Clouds , 2018, IEEE Transactions on Cloud Computing.

[13]  Dror G. Feitelson,et al.  Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling , 2001, IEEE Trans. Parallel Distributed Syst..

[14]  Ken Chen Performance Evaluation by Simulation and Analysis with Applications to Computer Networks: Chen/Performance Evaluation by Simulation and Analysis with Applications to Computer Networks , 2015 .

[15]  BuyyaRajkumar,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012 .

[16]  Dario Pompili,et al.  Bandwidth and Energy-Aware Resource Allocation for Cloud Radio Access Networks , 2018, IEEE Transactions on Wireless Communications.

[17]  Martin Bichler,et al.  Using matrix approximation for high-dimensional discrete optimization problems: Server consolidation based on cyclic time-series data , 2013, Eur. J. Oper. Res..

[18]  Zahir Tari,et al.  DTFA: A Dynamic Threshold-Based Fuzzy Approach for Power-Efficient VM Consolidation , 2018, 2018 IEEE 17th International Symposium on Network Computing and Applications (NCA).

[19]  Ching-Hsien Hsu,et al.  An Optimal Cost-Efficient Resource Provisioning for Multi-servers Cloud Computing , 2013, 2013 International Conference on Cloud Computing and Big Data.

[20]  Zhong Ming,et al.  A state based energy optimization framework for dynamic virtual machine placement , 2019, Data Knowl. Eng..

[21]  Martin Bichler,et al.  Planning vs. Dynamic Control: Resource Allocation in Corporate Clouds , 2016, IEEE Transactions on Cloud Computing.

[22]  Sam Jabbehdari,et al.  An autonomic resource provisioning approach for service-based cloud applications: A hybrid approach , 2018, Future Gener. Comput. Syst..

[23]  David Atienza,et al.  Integrating Heuristic and Machine-Learning Methods for Efficient Virtual Machine Allocation in Data Centers , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[24]  Sangsuree Vasupongayya,et al.  On Job Fairness in Non-Preemptive Parallel Job Scheduling , 2005, IASTED PDCS.

[25]  Christine Morin,et al.  Energy-Aware Ant Colony Based Workload Placement in Clouds , 2011, 2011 IEEE/ACM 12th International Conference on Grid Computing.

[26]  Rajkumar Buyya,et al.  Environment-conscious scheduling of HPC applications on distributed Cloud-oriented data centers , 2011, J. Parallel Distributed Comput..

[27]  Branka Vucetic,et al.  Baseband Processing Units Virtualization for Cloud Radio Access Networks , 2015, IEEE Wireless Communications Letters.

[28]  Jens Braband,et al.  Waiting time distributions for M/M/N processor sharing queues , 1994 .

[29]  Minrui Fei,et al.  An Ant Colony System for energy-efficient dynamic Virtual Machine Placement in data centers , 2019, Expert Syst. Appl..

[30]  Ling Guan,et al.  Optimal allocation of virtual machines for cloud-based multimedia applications , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[31]  N CalheirosRodrigo,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011 .

[32]  Mukaddim Pathan,et al.  A two-stage approach for task and resource management in multimedia cloud environment , 2014, Computing.

[33]  Martin Bichler,et al.  A Mathematical Programming Approach for Server Consolidation Problems in Virtualized Data Centers , 2010, IEEE Transactions on Services Computing.

[34]  Guihua Nie,et al.  Research on Service Level Agreement in Cloud Computing , 2012 .

[35]  Huaxi Gu,et al.  Energy Efficient Virtual Machine Placement With an Improved Ant Colony Optimization Over Data Center Networks , 2019, IEEE Access.

[36]  Seyedmehdi Hosseinimotlagh,et al.  SEATS: smart energy-aware task scheduling in real-time cloud computing , 2014, The Journal of Supercomputing.

[37]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[38]  Haroon Rasheed,et al.  Optimal job packing, a backfill scheduling optimization for a cluster of workstations , 2009, The Journal of Supercomputing.

[39]  Nam Thoai,et al.  Minimizing Total Busy Time with Application to Energy-Efficient Scheduling of Virtual Machines in IaaS Clouds , 2016, 2016 International Conference on Advanced Computing and Applications (ACOMP).

[40]  Xiaomin Zhu,et al.  Real-Time Tasks Oriented Energy-Aware Scheduling in Virtualized Clouds , 2014, IEEE Transactions on Cloud Computing.

[41]  John Ngubiri,et al.  Performance, fairness and effectiveness in space-slicing multi-cluster schedulers , 2007 .

[42]  Borko Furht,et al.  Handbook of Cloud Computing , 2010 .

[43]  B. Avi-Itzhak,et al.  On measuring fairness in queues , 2004, Advances in Applied Probability.

[44]  Xiaohong Jiang,et al.  An Energy-Efficient Scheme for Cloud Resource Provisioning Based on CloudSim , 2011, 2011 IEEE International Conference on Cluster Computing.

[45]  Angela C. Sodan Loosely coordinated coscheduling in the context of other approaches for dynamic job scheduling: a survey , 2005, Concurr. Comput. Pract. Exp..