From network traffic measurements to QoE for internet video

Video streaming is a dominant contributor to the global Internet traffic. Consequently, monitoring video streaming Quality of Experience (QoE) is of paramount importance to network providers. Monitoring QoE of video is a challenge as most of the video traffic of today is encrypted. In this paper, we consider this challenge and present an approach based on controlled experimentation and machine learning to estimate QoE from encrypted video traces using network level measurements only. We consider a case of YouTube and play out a wide range of videos under realistic network conditions to build ML models (classification and regression) that predict the subjective MOS (Mean Opinion Score) based on the ITU P.1203 model along with the QoE metrics of startup delay, quality (spatial resolution) of playout and quality variations, and this is using only the underlying network Quality of Service (QoS) features. We comprehensively evaluate our approach with different sets of input network features and output QoE metrics. Overall, our classification models predict the QoE metrics and the ITU MOS with an accuracy of 63–90% while the regression models show low error; the ITU MOS (1–5) and the startup delay (in seconds) are predicted with a root mean square error of 0.33 and 2.66 respectively.

[1]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2012, IEEE/ACM Transactions on Networking.

[2]  Rocky K. C. Chang,et al.  Measuring the quality of experience of HTTP video streaming , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[3]  Zubair Shafiq,et al.  Real-time Video Quality of Experience Monitoring for HTTPS and QUIC , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[4]  Phuoc Tran-Gia,et al.  Quantification of YouTube QoE via Crowdsourcing , 2011, 2011 IEEE International Symposium on Multimedia.

[5]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[6]  Jaideep Chandrashekar,et al.  Predicting user dissatisfaction with Internet application performance at end-hosts , 2013, 2013 Proceedings IEEE INFOCOM.

[7]  Alexander Raake,et al.  HTTP adaptive streaming QoE estimation with ITU-T rec. P. 1203: open databases and software , 2018, MMSys.

[8]  Konstantina Papagiannaki,et al.  Measuring Video QoE from Encrypted Traffic , 2016, Internet Measurement Conference.

[9]  Chadi Barakat,et al.  On Active Sampling of Controlled Experiments for QoE Modeling , 2017, Internet-QoE@SIGCOMM.

[10]  Shobha Venkataraman,et al.  Prometheus: toward quality-of-experience estimation for mobile apps from passive network measurements , 2014, HotMobile.

[11]  Michael Seufert,et al.  Unsupervised QoE field study for mobile YouTube video streaming with YoMoApp , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[12]  Kuan-Ta Chen,et al.  OneClick: A Framework for Measuring Network Quality of Experience , 2009, IEEE INFOCOM 2009.

[13]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[14]  Lea Skorin-Kapov,et al.  A machine learning approach to classifying YouTube QoE based on encrypted network traffic , 2017, Multimedia Tools and Applications.