On-demand resource provision based on load estimation and service expenditure in edge cloud environment

Abstract The trend of the Internet of Everything is deepening, and the amount of data that needs to be processed in the network is growing. Using the edge cloud technology can process data at the edge of the network, lowering the burden on the data center. When the load of the edge cloud is large, it is necessary to apply for more resources to the cloud service provider, and the resource billing granularity affects the cost. When the load is small, releasing the idle node resources to the cloud service provider can lower the service expenditure. To this end, an on-demand resource provision model based on service expenditure is proposed. The demand for resources needs to be estimated in advance. To this end, a load estimation model based on ARIMA model and BP neural network is proposed. The model can estimate the load according to historical data and reduce the estimation error. Before releasing the node resources, the user data on the node need to be migrated to other working nodes to ensure that the user data will not be lost. In this paper, when selecting the migration target, the three metrics of load balancing, migration time consumption and migration cost of the cluster are considered. A data migration model based on load balancing is proposed. Through the comparison of experimental results, the proposed methods can effectively reduce service expenditure and make the cluster in a state of load balancing.

[1]  Chin Soon Chong,et al.  Fast GA-based project scheduling for computing resources allocation in a cloud manufacturing system , 2017, J. Intell. Manuf..

[2]  Erol Gelenbe,et al.  Adaptive Dispatching of Tasks in the Cloud , 2015, IEEE Transactions on Cloud Computing.

[3]  Yin Yang,et al.  A Migration Strategy based on Reliability Disk and Hotspot Data in Information Systems , 2015 .

[4]  Mingli Song,et al.  A construction method and data migration strategy for hybrid cloud storage , 2015, 2015 18th International Conference on Computer and Information Technology (ICCIT).

[5]  Weiming Shen,et al.  Agent-Oriented Cooperative Smart Objects: From IoT System Design to Implementation , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Rajkumar Buyya,et al.  Workload Prediction Using ARIMA Model and Its Impact on Cloud Applications’ QoS , 2015, IEEE Transactions on Cloud Computing.

[7]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[8]  Maung Maung Htay,et al.  Efficient Resource Management for Virtual Machine Allocation in Cloud Data Centers , 2018, 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE).

[9]  Yonggang Wen,et al.  Adaptive and scalable load balancing for metadata server cluster in cloud-scale file systems , 2015, Frontiers of Computer Science.

[10]  Kai-Yuan Cai,et al.  Adaptive Multivariable Control for Multiple Resource Allocation of Service-Based Systems in Cloud Computing , 2019, IEEE Access.

[11]  Marcos José Santana,et al.  Combining time series prediction models using genetic algorithm to autoscaling Web applications hosted in the cloud infrastructure , 2015, Neural Computing and Applications.

[12]  Wei Li,et al.  Load Prediction-Based Automatic Scaling Cloud Computing , 2016, 2016 International Conference on Networking and Network Applications (NaNA).

[13]  Mohamadreza Ahmadi,et al.  A dynamic VM consolidation technique for QoS and energy consumption in cloud environment , 2017, The Journal of Supercomputing.

[14]  Feng Xia,et al.  A survey on virtual machine migration and server consolidation frameworks for cloud data centers , 2015, J. Netw. Comput. Appl..

[15]  Weidong Li,et al.  Discrete Interior Search Algorithm for Multi-resource Fair Allocation in Heterogeneous Cloud Computing Systems , 2016, ICIC.

[16]  Jianfeng Ma,et al.  A universal fairness evaluation framework for resource allocation in cloud computing , 2015, China Communications.

[17]  Xiaoming Fu,et al.  A Survey on Virtual Machine Migration: Challenges, Techniques, and Open Issues , 2018, IEEE Communications Surveys & Tutorials.

[18]  Bingsheng He,et al.  VMbuddies: Coordinating Live Migration of Multi-Tier Applications in Cloud Environments , 2015, IEEE Transactions on Parallel and Distributed Systems.

[19]  Marília Curado,et al.  Performance Analysis of Network Traffic Predictors in the Cloud , 2016, Journal of Network and Systems Management.

[20]  Bingsheng He,et al.  Towards Efficient Resource Allocation for Heterogeneous Workloads in IaaS Clouds , 2018, IEEE Transactions on Cloud Computing.

[21]  Mohsen Guizani,et al.  An Energy-Efficient VM Prediction and Migration Framework for Overcommitted Clouds , 2018, IEEE Transactions on Cloud Computing.

[22]  Wei Wang,et al.  Multi-Resource Fair Allocation in Heterogeneous Cloud Computing Systems , 2015, IEEE Transactions on Parallel and Distributed Systems.

[23]  Praveen Khethavath,et al.  Optimized Resource Allocation and Load Balancing in Distributed Cloud using Graph Theory , 2018, 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[24]  Mahmoud Al-Ayyoub,et al.  Multi-agent based dynamic resource provisioning and monitoring for cloud computing systems infrastructure , 2015, Cluster Computing.

[25]  Maninder Singh,et al.  The Journey of QoS-Aware Autonomic Cloud Computing , 2017, IT Professional.

[26]  Rajkumar Buyya,et al.  Dynamic resource demand prediction and allocation in multi‐tenant service clouds , 2016, Concurr. Comput. Pract. Exp..

[27]  Xingong Cheng,et al.  Short-term Power Load Forecasting Based on Balanced KNN , 2018 .

[28]  Youlong Luo,et al.  Collaborative cache allocation and task scheduling for data-intensive applications in edge computing environment , 2019, Future Gener. Comput. Syst..

[29]  Qinghua Zheng,et al.  Cluster-Aware Virtual Machine Collaborative Migration in Media Cloud , 2017, IEEE Transactions on Parallel and Distributed Systems.

[30]  Eui-nam Huh,et al.  Fog Computing Micro Datacenter Based Dynamic Resource Estimation and Pricing Model for IoT , 2015, 2015 IEEE 29th International Conference on Advanced Information Networking and Applications.

[31]  Song Deng,et al.  Layered virtual machine migration algorithm for network resource balancing in cloud computing , 2018, Frontiers of Computer Science.

[32]  V. Kavitha,et al.  Energy conservation in cloud data centers by minimizing virtual machines migration through artificial neural network , 2016 .

[33]  K. R. Venugopal,et al.  Resource allocation in the cloud for video-on-demand applications using multiple cloud service providers , 2018, Cluster Computing.

[34]  P. Jayarekha,et al.  Time sliced and priority based load balancer , 2015, 2015 IEEE International Advance Computing Conference (IACC).

[35]  Hans-Arno Jacobsen,et al.  Robust Multi-Resource Allocation with Demand Uncertainties in Cloud Scheduler , 2017, 2017 IEEE 36th Symposium on Reliable Distributed Systems (SRDS).

[36]  K. R. Remesh Babu,et al.  Fault Tolerant Multiple Synchronized Parallel Load Balancing in Cloud , 2017, HIS.