Data Center Selection Based on Reinforcement Learning

As demand for cloud services continues to increase, major cloud service providers have built many data centers around the world or in certain regions to ensure the quality of services. However, optimal data center selection from the distributed data centers of a cloud service provider or a cloud service alliance remains a problem, in part because of the cost of leasing data center resources, which includes the costs of network resources and computing resources. Whereas the cost of computing resources is easy to determine, the cost of network resources is relatively difficult to determine because it depends on communication paths. In this study, the distributed data centers were abstracted into an incomplete undirected graph. Furthermore, the cost of computing resources and network resources were considered together. The mathematical model of the user’s cost was established. To obtain the optimal solution, we proposed a data center selection algorithm based reinforcement learning. The experiment results showed that the algorithm effectively solved the problem.

[1]  Masnida Hussin,et al.  Improving reliability in resource management through adaptive reinforcement learning for distributed systems , 2015, J. Parallel Distributed Comput..

[2]  Weiwei Lin,et al.  R-Learning and Gaussian Process Regression Algorithm for Cloud Job Access Control , 2016, 2016 IEEE 3rd International Conference on Cyber Security and Cloud Computing (CSCloud).

[3]  Canyu Sun,et al.  Fundamental Q-learning Algorithm in Finding Optimal Policy , 2017, 2017 International Conference on Smart Grid and Electrical Automation (ICSGEA).

[4]  Seyed Morteza Babamir,et al.  Towards optimization of availability and cost in selection of geo-distributed clouds datacenter , 2016, 2016 IEEE 10th International Conference on Application of Information and Communication Technologies (AICT).

[5]  Xiaoqing Zhu,et al.  Mobile Robot Navigation based on Deep Reinforcement Learning , 2019, 2019 Chinese Control And Decision Conference (CCDC).

[6]  Tan-Hsu Tan,et al.  Resource Allocation For D2D Communications With A Novel Distributed Q-Learning Algorithm In Heterogeneous Networks , 2018, 2018 International Conference on Machine Learning and Cybernetics (ICMLC).

[7]  David S. Linthicum Cloud Computing Changes Data Integration Forever: What's Needed Right Now , 2017, IEEE Cloud Computing.

[8]  Weiwei Lin,et al.  Random task scheduling scheme based on reinforcement learning in cloud computing , 2015, Cluster Computing.