An energy-aware resource deployment algorithm for cloud data centers based on dynamic hybrid machine learning

Abstract To meet the ever-increasing requirements of cloud users, cloud service providers have further increased the deployment of cloud data centers. Cloud users can freely choose the cloud data center that suits them according to their own business characteristics and budget expenditures. This requires cloud service providers to continuously improve service quality and reduce usage costs to expand their own user base. Mature cloud service providers will continuously optimize cloud tasks and virtual machine deployment methods to increase physical machine utilization and reduce cloud data center energy consumption. However, existing virtual machine deployment algorithms usually have low utilization of physical machines or high energy consumption of cloud data centers, thereby reducing the frequency of use by cloud users and the benefits of cloud service providers. This paper systematically analyzes virtual machine and physical machine models. At the same time, the K-means clustering algorithm for unsupervised learning and the KNN classification algorithm for supervised learning are expanded to establish a dynamic hybrid resource deployment rule. Then, an energy-aware resource deployment algorithm for cloud data centers based on dynamic hybrid machine learning (EHML) is proposed based on the theory of machine learning. This algorithm reduces energy consumption by increasing the average utilization of physical machines. Finally, the experimental test results show that the average utilization of physical machines and energy consumption of the algorithm are significantly better than those of the comparison algorithms.

[1]  Shui Yu,et al.  A Virtual Machine Scheduling Method for Trade-Offs Between Energy and Performance in Cloud Environment , 2016, 2016 International Conference on Advanced Cloud and Big Data (CBD).

[2]  Major Singh Goraya,et al.  Two-way Ranking Based Service Mapping in Cloud Environment , 2018, Future Gener. Comput. Syst..

[3]  Quoc-Viet Pham,et al.  Multi-objective cluster head selection using fitness averaged rider optimization algorithm for IoT networks in smart cities , 2021 .

[4]  Keqin Li,et al.  Collaborative Optimization of Service Composition for Data-Intensive Applications in a Hybrid Cloud , 2019, IEEE Transactions on Parallel and Distributed Systems.

[5]  Félix García Carballeira,et al.  A heterogeneous mobile cloud computing model for hybrid clouds , 2018, Future Gener. Comput. Syst..

[6]  Xiaohua Jia,et al.  Dynamic Resource Provisioning for Energy Efficient Cloud Radio Access Networks , 2019, IEEE Transactions on Cloud Computing.

[7]  Debashis De,et al.  A Power and Latency Aware Cloudlet Selection Strategy for Multi-Cloudlet Environment , 2019, IEEE Transactions on Cloud Computing.

[8]  Benjamín Barán,et al.  Virtual machine placement for elastic infrastructures in overbooked cloud computing datacenters under uncertainty , 2018, Future Gener. Comput. Syst..

[9]  Nan Guan,et al.  Intra-Task Priority Assignment in Real-Time Scheduling of DAG Tasks on Multi-Cores , 2019, IEEE Transactions on Parallel and Distributed Systems.

[10]  Xingjun Zhang,et al.  Memory-aware resource management algorithm for low-energy cloud data centers , 2020, Future Gener. Comput. Syst..

[11]  Richard McClatchey,et al.  Cloud provider capacity augmentation through automated resource bartering , 2018, Future Gener. Comput. Syst..

[12]  Sitalakshmi Venkatraman,et al.  Use of Data Visualisation for Zero-Day Malware Detection , 2018, Secur. Commun. Networks.

[13]  Nelson L. S. da Fonseca,et al.  Estimation of the Available Bandwidth in Inter-Cloud Links for Task Scheduling in Hybrid Clouds , 2019, IEEE Transactions on Cloud Computing.

[14]  Hannu Tenhunen,et al.  Energy-Aware VM Consolidation in Cloud Data Centers Using Utilization Prediction Model , 2019, IEEE Transactions on Cloud Computing.

[15]  Yu Wang,et al.  Heterogeneity Aware Workload Management in Distributed Sustainable Datacenters , 2019, IEEE Transactions on Parallel and Distributed Systems.

[16]  Yifan Tian,et al.  Practical Privacy-Preserving MapReduce Based K-Means Clustering Over Large-Scale Dataset , 2019, IEEE Transactions on Cloud Computing.

[17]  Yifan Gong,et al.  Privacy Regulation Aware Process Mapping in Geo-Distributed Cloud Data Centers , 2019, IEEE Transactions on Parallel and Distributed Systems.

[18]  Keqiu Li,et al.  Cost-Minimizing Bandwidth Guarantee for Inter-Datacenter Traffic , 2019, IEEE Transactions on Cloud Computing.

[19]  Victor C. M. Leung,et al.  Link-Aware Virtual Machine Placement for Cloud Services based on Service-Oriented Architecture , 2020, IEEE Transactions on Cloud Computing.

[20]  Weng Chon Ao,et al.  Resource-Constrained Replication Strategies for Hierarchical and Heterogeneous Tasks , 2020, IEEE Transactions on Parallel and Distributed Systems.

[21]  Alejandro Quintero,et al.  Live Placement of Interdependent Virtual Machines to Optimize Cloud Service Profits and Penalties on SLAs , 2019, IEEE Transactions on Cloud Computing.

[22]  Victor I. Chang,et al.  A load-aware resource allocation and task scheduling for the emerging cloudlet system , 2018, Future Gener. Comput. Syst..

[23]  Mainak Adhikari,et al.  Heuristic-based load-balancing algorithm for IaaS cloud , 2018, Future Gener. Comput. Syst..

[24]  Asif Karim,et al.  A Comprehensive Survey for Intelligent Spam Email Detection , 2019, IEEE Access.

[25]  Liudong Xing,et al.  Correlation Modeling and Resource Optimization for Cloud Service With Fault Recovery , 2019, IEEE Transactions on Cloud Computing.

[26]  Azzedine Boukerche,et al.  A Multi-Layered Scheme for Distributed Simulations on the Cloud Environment , 2019, IEEE Transactions on Cloud Computing.

[27]  Prasanta K. Jana,et al.  A GSA based hybrid algorithm for bi-objective workflow scheduling in cloud computing , 2018, Future Gener. Comput. Syst..

[28]  Huiqiang Wang,et al.  An Attribute-Based Availability Model for Large Scale IaaS Clouds with CARMA , 2020, IEEE Transactions on Parallel and Distributed Systems.

[29]  Qin Zheng,et al.  IMCFN: Image-based malware classification using fine-tuned convolutional neural network architecture , 2020, Comput. Networks.

[30]  Praveen Kumar Reddy Maddikunta,et al.  Load balancing of energy cloud using wind driven and firefly algorithms in internet of everything , 2020, J. Parallel Distributed Comput..

[31]  Neeraj Kumar,et al.  Whale Optimization Algorithm With Applications to Resource Allocation in Wireless Networks , 2020, IEEE Transactions on Vehicular Technology.

[32]  Azzam Mourad,et al.  Selective Mobile Cloud Offloading to Augment Multi-Persona Performance and Viability , 2019, IEEE Transactions on Cloud Computing.

[33]  Rajkumar Buyya,et al.  Energy Efficient Allocation of Virtual Machines in Cloud Data Centers , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[34]  Wei Jie,et al.  A Review of Performance, Energy and Privacy of Intrusion Detection Systems for IoT , 2018, Electronics.