A Container Scheduling Strategy Based on Machine Learning in Microservice Architecture

Good progress has been made in the microservice technology in recent years due to the development of docker container technology. Although microservice architecture can adjust the number of containers, there is a new problem. That is according to the current load pressure of services, how to adjust the number of containers accurately and quickly in real time, especially when the load pressure of services suddenly increases or decreases. In order to deal with the problem, a container scheduling strategy based on machine learning is proposed in this paper. The paper uses the data set obtained by our experiments to train random forest regression model in advance to predict the required containers of services in the next time window, according to the current load pressure of services. Large amounts of data has been collected to make the data set for the experiment. Based on the data set, random forest regression model has been trained in advance to predict the number of required containers of services in next time window. When adjusting the number of containers to balance load pressure of services, the proposed algorithm saves 50% of the time compared with traditional algorithms. In addition, the accuracy is 10%~38% higher compared with other machine learning algorithms.

[1]  V. Rodriguez-Galiano,et al.  Machine learning predictive models for mineral prospectivity: an evaluation of neural networks, random forest, regression trees and support vector machines , 2015 .

[2]  Kang-Won Lee,et al.  Application-aware virtual machine migration in data centers , 2011, 2011 Proceedings IEEE INFOCOM.

[3]  Luis M. Candanedo,et al.  Accurate occupancy detection of an office room from light, temperature, humidity and CO2 measurements using statistical learning models , 2016 .

[4]  Igor L. Medintz,et al.  Meta-analysis of cellular toxicity for cadmium-containing quantum dots. , 2016, Nature nanotechnology.

[5]  Jing Wang,et al.  Instance Expansion Algorithm for Micro-service with Prediction , 2018 .

[6]  IEEE Transactions on Parallel and Distributed Systems, Vol. 13 , 2002 .

[7]  Soteris A. Kalogirou,et al.  Machine learning methods for solar radiation forecasting: A review , 2017 .

[8]  Long Sun,et al.  An open IoT framework based on microservices architecture , 2017, China Communications.

[9]  Wenbin Yao,et al.  A container scheduling strategy based on neighborhood division in micro service , 2018, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium.

[10]  Luciana S. Buriol,et al.  Piecing together the NFV provisioning puzzle: Efficient placement and chaining of virtual network functions , 2015, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[11]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[12]  Mohammed Samaka,et al.  Multi-objective scheduling of micro-services for optimal service function chains , 2017, 2017 IEEE International Conference on Communications (ICC).

[13]  Mohammed Samaka,et al.  Multi-cloud Distribution of Virtual Functions and Dynamic Service Deployment: Open ADN Perspective , 2015, 2015 IEEE International Conference on Cloud Engineering.

[14]  Sonia Fahmy,et al.  Contain-ed: An NFV Micro-Service System for Containing e2e Latency , 2017, CCRV.

[15]  Shui Yu,et al.  A Virtual Machine Scheduling Method for Trade-Offs Between Energy and Performance in Cloud Environment , 2016, 2016 International Conference on Advanced Cloud and Big Data (CBD).

[16]  Xiaorong Zhu,et al.  The optimal macro control strategies of service providers and micro service selection of users: quantification model based on synergetics , 2018, Wirel. Networks.