Predicting the online performance of video service providers on the internet

Video services on the Internet are not able to offer consistent and assured performance to users or third-party applications. Measuring levels of performance over time is difficult, and obtaining accurate measures in real time is problematic; thus, reactive measures to address loss of performance are also problematic. The ability to predict service performance can be viewed as an important added-value, one that can help users or third-part applications select the proper online service provider. With this aim in view, we have designed a measurement system and deployed it in eleven provinces and cities in China to monitor two popular websites, Youku and Tudou. The analysis indicates that the performance trend of these two service providers followed daily changing patterns, such as rush hour traffic and lower service workloads at midnight; this is consistent with user behaviors. It was also confirmed that the future performance was related to the historical records. Based on these findings, we have decided to investigate the use of modified time series models to forecast the performance of such video services. Meanwhile, some machine learning models are implemented and compared as baseline models, such as Artificial Neural Network, Support Vector Machine, and Decision Tree. In addition, a hybrid model, which is generated by combining different machine learning models, is also studied as the baseline. An investigation shows that time series models are much more suitable to this prediction problem than baseline models in most situations. To alleviate the data sparseness problem in training the predictor, a new predictor that combines different information sources is proposed, thus improving prediction precision. Furthermore, the predictor is quite stable, and we have discovered that the average performance estimation is more accurate if the model is updated within 2–3 days, which is useful in some applications, e.g., video source analysis and recommendation systems.

[1]  Miguel Rio,et al.  Internet Traffic Forecasting using Neural Networks , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[2]  Juan Pablo Artero.  Online Video Business Models: YouTube vs. Hulu , 2010 .

[3]  Poo Kuan Hoong,et al.  Impact of utilizing forecasted network traffic for data transfers , 2011, 13th International Conference on Advanced Communication Technology (ICACT2011).

[4]  Juan Pablo Artero Muñoz.  Online Video Business Models: YouTube vs. Hulu , 2010 .

[5]  Lizy Kurian John,et al.  Power and performance analysis of network traffic prediction techniques , 2012, 2012 IEEE International Symposium on Performance Analysis of Systems & Software.

[6]  Fang Hao,et al.  Unreeling netflix: Understanding and improving multi-CDN movie delivery , 2012, 2012 Proceedings IEEE INFOCOM.

[7]  Torsten Suel,et al.  Modeling and predicting user behavior in sponsored search , 2009, KDD.

[8]  Meina Song,et al.  Network Traffic Prediction and Result Analysis Based on Seasonal ARIMA and Correlation Coefficient , 2010, 2010 International Conference on Intelligent System Design and Engineering Application.

[9]  Qiang Xu,et al.  PROTEUS: network performance forecast for real-time, interactive mobile applications , 2013, MobiSys '13.

[10]  Hong Zhao.  Multiscale analysis and prediction of network traffic , 2009, 2009 IEEE 28th International Performance Computing and Communications Conference.

[11]  Gang Xu,et al.  Short Term Traffic Flow Prediction Using Hybrid ARIMA and ANN Models , 2008, 2008 Workshop on Power Electronics and Intelligent Transportation System.

[12]  Jorge Navarro-Ortiz,et al.  Analysis and modelling of YouTube traffic , 2012, Trans. Emerg. Telecommun. Technol..

[13]  Srinivasan Seshan,et al.  Developing a predictive model of quality of experience for internet video , 2013, SIGCOMM.

[14]  Manish Joshi,et al.  A Review of Network Traffic Analysis and Prediction Techniques , 2015, ArXiv.

[15]  Yin-Wong Cheung,et al.  PRACTITIONERS CORNER: Lag Order and Critical Values of a Modified Dickey-Fuller Test , 2009 .

[16]  Z. Sun,et al.  Traffic predictability based on ARIMA/GARCH model , 2006, 2006 2nd Conference on Next Generation Internet Design and Engineering, 2006. NGI '06..

[17]  Jilali Antari,et al.  Identification and Prediction of Internet Traffic Using Artificial Neural Networks , 2010, J. Intell. Learn. Syst. Appl..

[18]  R. Sivakumar,et al.  Prediction of Traffic Load in Wireless Network Using Time Series Model , 2011, 2011 International Conference on Process Automation, Control and Computing.

[19]  Fang Hao,et al.  Measurement Study of Netflix, Hulu, and a Tale of Three CDNs , 2015, IEEE/ACM Transactions on Networking.

[20]  SeshanSrinivasan,et al.  Developing a predictive model of quality of experience for internet video , 2013 .

[21]  Hao Chen,et al.  Prediction of traffic in a public safety network , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[22]  Oliver W. W. Yang,et al.  Wireless traffic modeling and prediction using seasonal ARIMA models , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[23]  Balasubramaniam Natarajan,et al.  GARCH — non-linear time series model for traffic modeling and prediction , 2008, NOMS 2008 - 2008 IEEE Network Operations and Management Symposium.

[24]  Poo Kuan Hoong,et al.  Bittorrent Network Traffic Forecasting With ARMA , 2012, ArXiv.

[25]  Cheng Huang,et al.  Estimating the performance of hypothetical cloud service deployments: A measurement-based approach , 2011, 2011 Proceedings IEEE INFOCOM.

[26]  Susan T. Dumais,et al.  Modeling and predicting behavioral dynamics on the web , 2012, WWW.

[27]  R. K. Agrawal,et al.  Combining multiple time series models through a robust weighted mechanism , 2012, 2012 1st International Conference on Recent Advances in Information Technology (RAIT).

[28]  Xiangyang Xue,et al.  Understanding and Predicting Interestingness of Videos , 2013, AAAI.

[29]  P. Ameigeiras,et al.  Analysis and modeling of YouTube traffic , 2012 .