Best-KFF: a multi-objective preemptive resource allocation policy for cloud computing systems

Resource provisioning is a key issue in large-scale distributed systems such as cloud computing systems. Several resource provider systems utilized preemptive resource allocation techniques to maintain a high quality of service level. When there is a lack of resources for high-priority requests, leases/jobs with higher priority can run by suspending or canceling leases/jobs with lower priority to release the required resources. The state-of-the-art preemptive resource allocation methods are classified into two classes, namely, (1) heuristic and (2) brute force. The heuristic-based methods are fast, but they can’t maintain the system performance, while brute force-based methods are vice versa. In this work, we proposed a new multi-objective preemptive resource allocation policy that benefits from these two classes. We proposed a new heuristic called Best K-First-Fit ( Best - KFF ). The Best - KFF searches for the first k preemption choices at each physical machine (PM) and then sorts these preemption choices obtained from the PMs with respect to several objectives (e.g., resource utilization). Then, the Best - KFF selects the best choice maintaining the cloud computing system performance. Thus, the Best - KFF algorithm is a compromise between the heuristic and brute force classes. The higher the value of k is, the larger the search space is. The Best - KFF method maximizes the resource utilization of the physical machines and minimizes the average waiting time of advanced-reservation requests, the number of lease preemption, the preemption time, and energy consumption. The proposed method was thoroughly examined and compared against the state-of-the-art methods. The experimental results on various cloud computing systems demonstrated that the proposed preemption policy outperforms the state-of-the-art methods.

[1]  Rajkumar Buyya,et al.  Resource provisioning based on preempting virtual machines in distributed systems , 2014, Concurr. Comput. Pract. Exp..

[2]  Zhenlong Li,et al.  Big Data and cloud computing: innovation opportunities and challenges , 2017, Int. J. Digit. Earth.

[3]  Borja Sotomayor,et al.  Capacity Leasing in Cloud Systems using the OpenNebula Engine , 2008 .

[4]  Edward G. Coffman,et al.  Dynamic Bin Packing , 1983, SIAM J. Comput..

[5]  Xi He,et al.  Cloud Computing: a Perspective Study , 2010, New Generation Computing.

[6]  Mohamed Cheriet,et al.  Preemptive cloud resource allocation modeling of processing jobs , 2018, The Journal of Supercomputing.

[7]  Zhiping Peng,et al.  A multi-objective trade-off framework for cloud resource scheduling based on the Deep Q-network algorithm , 2020, Cluster Computing.

[8]  Syed Hamid Hussain Madni,et al.  Multi-objective-Oriented Cuckoo Search Optimization-Based Resource Scheduling Algorithm for Clouds , 2018, Arabian Journal for Science and Engineering.

[9]  Navtej Singh Ghumman,et al.  A REVIEW ON DYNAMIC RESOURCE ALLOCATION BASED ON LEASE TYPES IN CLOUD ENVIRONMENT , 2017, BIOINFORMATICS 2017.

[10]  Rajkumar Buyya,et al.  Preemption-Aware Energy Management in Virtualized Data Centers , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[11]  Abdullah Abuhussein,et al.  Impact of Virtualization on Cloud Computing Energy Consumption: Empirical Study , 2018, Proceedings of the 2nd International Symposium on Computer Science and Intelligent Control.

[12]  Vinay Kumar,et al.  Energy-aware scheduling using slack reclamation for cluster systems , 2019, Cluster Computing.

[13]  Fabien Hermenier,et al.  Cluster-wide context switch of virtualized jobs , 2010, HPDC '10.

[14]  Javier Bajo,et al.  Survey of agent-based cloud computing applications , 2019, Future Gener. Comput. Syst..

[15]  Li Hao,et al.  A Deadline Constrained Preemptive Scheduler Using Queuing Systems for Multi-Tenancy Clouds , 2019, 2019 IEEE 12th International Conference on Cloud Computing (CLOUD).

[16]  Arun Kumar Yadav,et al.  Preemptable priority based dynamic resource allocation in cloud computing with fault tolerance , 2015, 2015 International Conference on Communication Networks (ICCN).

[17]  Kenli Li,et al.  A Profit Maximization Scheme with Guaranteed Quality of Service in Cloud Computing , 2015, IEEE Transactions on Computers.

[18]  Borja Sotomayor,et al.  Combining batch execution and leasing using virtual machines , 2008, HPDC '08.

[19]  Samee Ullah Khan,et al.  An Energy-Efficient Task Scheduling Algorithm in DVFS-enabled Cloud Environment , 2015, Journal of Grid Computing.

[20]  Upendra Singh,et al.  Cloud computing through dynamic resource allocation scheme , 2017, 2017 International conference of Electronics, Communication and Aerospace Technology (ICECA).

[21]  Ivan Porres,et al.  Multi-objective dynamic virtual machine consolidation in the cloud using ant colony system , 2017, Int. J. Parallel Emergent Distributed Syst..

[22]  Chandra Prakash Gupta,et al.  Amazon EC2 Spot Price Prediction Using Regression Random Forests , 2020, IEEE Transactions on Cloud Computing.

[23]  Rubén S. Montero,et al.  IaaS Cloud Architecture: From Virtualized Datacenters to Federated Cloud Infrastructures , 2012, Computer.

[24]  Mahmoud Al-Ayyoub,et al.  A Deep Learning Approach for Amazon EC2 Spot Price Prediction , 2018, 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA).

[25]  Nadeem Javaid,et al.  An Enhanced Multi-Objective Gray Wolf Optimization for Virtual Machine Placement in Cloud Data Centers , 2019, Electronics.

[26]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[27]  Borja Sotomayor,et al.  Resource Leasing and the Art of Suspending Virtual Machines , 2009, 2009 11th IEEE International Conference on High Performance Computing and Communications.

[28]  Mikhail Khodak,et al.  Learning Cloud Dynamics to Optimize Spot Instance Bidding Strategies , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[29]  Kenli Li,et al.  Energy-Efficient Stochastic Task Scheduling on Heterogeneous Computing Systems , 2014, IEEE Transactions on Parallel and Distributed Systems.

[30]  C. R. Tripathy,et al.  Deadline sensitive lease scheduling in cloud computing environment using AHP , 2016, J. King Saud Univ. Comput. Inf. Sci..

[31]  Chandra Krintz,et al.  Analyzing AWS Spot Instance Pricing , 2019, 2019 IEEE International Conference on Cloud Engineering (IC2E).

[32]  Juan Luo,et al.  Tasks Scheduling and Resource Allocation in Fog Computing Based on Containers for Smart Manufacturing , 2018, IEEE Transactions on Industrial Informatics.