Sparse Regression Model to Predict a Server Load for Dynamic Adjustments of Server Resources

Along with rapid prevalence of Internet of things (IoT) and mobile network services, network function virtualization (NFV) based infrastructure requires dynamic computational resource adjustments in response to time-varying environments (network traffic, resource usage, failure status, etc). To provide agile resource control and adaptiveness, it is effective to predict a virtual server load by means of machine learning technologies for proactive control. In this paper, we propose a regression analysis model utilizing a sparse modeling to predict the average server load in a future specific time period on the basis of the server load in a past specific time period. We target at the number of access to a Web server as a virtual server load. The model can reduce the prediction error compared to a traditional least square method. Besides, we propose two methods to further reduce prediction errors: (A) an algorithm for determining the time period targeted for explanatory variables, and (B) two-stage regression analyses. As a result of MATLAB calculations, we show that application of the sparse modeling can reduce the prediction error by more than 40%, and besides, the above two proposed methods are effective at further reducing the prediction error with a few minutes’ learning time. Our model also contributes to make humans’ posterior analysis easier by making a short list of explanatory variables of data than conventional methods.

[1]  A. Belloni,et al.  Least Squares After Model Selection in High-Dimensional Sparse Models , 2009, 1001.0188.

[2]  Roozbeh Farahbod,et al.  Dynamic Resource Allocation in Computing Clouds Using Distributed Multiple Criteria Decision Analysis , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[3]  Rui Wang,et al.  A network traffic flow prediction with deep learning approach for large-scale metropolitan area network , 2018, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium.

[4]  Hiroaki Harai,et al.  Autonomic resource arbitration and service-continuable network function migration along service function chains , 2018, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium.

[5]  Dominique T. Shipmon,et al.  Time Series Anomaly Detection; Detection of anomalous drops with limited features and sparse examples in noisy highly periodic data , 2017, ArXiv.

[6]  Victor Lopez,et al.  Virtual network topology adaptability based on data analytics for traffic prediction , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[7]  Hiroaki Harai,et al.  Filtering observations to improve resource control in virtual computer and network systems , 2018, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium.

[8]  Rob Sherwood,et al.  FlowVisor: A Network Virtualization Layer , 2009 .

[9]  Djamal Zeghlache,et al.  A self-stabilizing framework for dynamic bandwidth allocation in virtual networks , 2016, NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium.

[10]  Ravi Prakash,et al.  Proactive resource allocation optimization in LTE with inter-cell interference coordination , 2014, Wirel. Networks.

[11]  C. O’Brien.  Statistical Learning with Sparsity: The Lasso and Generalizations , 2016 .

[12]  Tarik Taleb,et al.  PERMIT: Network Slicing for Personalized 5G Mobile Telecommunications , 2017, IEEE Communications Magazine.

[13]  Seungjoon Lee,et al.  Network function virtualization: Challenges and opportunities for innovations , 2015, IEEE Communications Magazine.

[14]  Daniel C Elton,et al.  Applying machine learning techniques to predict the properties of energetic materials , 2018, Scientific Reports.

[15]  Hong Liu,et al.  Inter-data-center network traffic prediction with elephant flows , 2016, NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium.

[16]  Hossam Afifi,et al.  Network planning tool based on network classification and load prediction , 2016, 2016 IEEE Wireless Communications and Networking Conference.

[17]  Hiroaki Harai,et al.  Anticipating minimum resources needed to avoid service disruption of emergency support systems , 2018, 2018 21st Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN).

[18]  Chung-Horng Lung,et al.  Mobile Network Traffic Prediction Using MLP, MLPWD, and SVM , 2016, 2016 IEEE International Congress on Big Data (BigData Congress).

[19]  Jing Wang,et al.  Spatiotemporal modeling and prediction in cellular networks: A big data enabled deep learning approach , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[20]  Pedro Casas,et al.  Super learning for anomaly detection in cellular networks , 2017, 2017 IEEE 13th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[21]  Luca Fanucci,et al.  Population Health Management Exploiting Machine Learning Algorithms to Identify High-Risk Patients , 2018, 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS).

[22]  Masato Okada,et al.  Estimation of the reaction times in tasks of varying difficulty from the phase coherence of the auditory steady-state response using the least absolute shrinkage and selection operator analysis , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Filip De Turck,et al.  Design and evaluation of learning algorithms for dynamic resource management in virtual networks , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[24]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .