Improving QoE prediction in mobile video through machine learning

Despite the massive adoption of HTTP adaptive streaming technology, buffering is still the most harmful event for QoE in video streaming. Previous studies have shown that buffering is not only detrimental for the overall user experience, but is also highly correlated to viewer engagement. The occurrence of buffering is particularly critical in cellular networks and mobile video deployments, as network conditions are less stable and network resources more limited. In this context, monitoring and properly predicting the QoE of video streaming services becomes paramount to cellular network operators, who need to offer high quality levels to reduce the risks of customers churning for quality dissatisfaction. In this paper, we present a novel approach to multi-dimensional QoE prediction in mobile video using machine learning models. Contrary to previous models for QoE prediction in video streaming, which are generally uni- or low-dimensional and model the impact of single video descriptors independently, we use a high-dimensional input space to model the impact of buffering and initial delay on QoE. We train and test the proposed models on a publicly available mobile video dataset, generated from subjective QoE tests with real viewers. Besides improving prediction performance, the proposed models show that there is a clear influence of other buffering pattern descriptors generally neglected in previous models — in particular those linked to the occurrence of the last stalling event, shedding light on new KPIs to monitor for better QoE assessment in video streaming.

[1]  Srinivasan Seshan,et al.  Developing a predictive model of quality of experience for internet video , 2013, SIGCOMM.

[2]  Henning Schulzrinne,et al.  YouSlow : What Influences User Abandonment Behavior for Internet Video ? , 2016 .

[3]  Alan C. Bovik,et al.  Delivery quality score model for Internet video , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[4]  Marco Mellia,et al.  An Educated Guess on QoE in Operational Networks through Large-Scale Measurements , 2016, Internet-QoE '16.

[5]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[6]  Phuoc Tran-Gia,et al.  Predicting QoE in cellular networks using machine learning and in-smartphone measurements , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[7]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[8]  Phuoc Tran-Gia,et al.  Quantification of YouTube QoE via Crowdsourcing , 2011, 2011 IEEE International Symposium on Multimedia.

[9]  Shobha Venkataraman,et al.  Prometheus: toward quality-of-experience estimation for mobile apps from passive network measurements , 2014, HotMobile.

[10]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2012, IEEE/ACM Transactions on Networking.

[11]  Michael Seufert,et al.  Exploring QoE in Cellular Networks: How Much Bandwidth do you Need for Popular Smartphone Apps? , 2015, SIGCOMM 2015.

[12]  B. Staehle,et al.  YoMo: A YouTube Application Comfort Monitoring Tool , 2010 .

[13]  Ian H. Witten,et al.  Induction of model trees for predicting continuous classes , 1996 .

[14]  Michael Seufert,et al.  YOUQMON: a system for on-line monitoring of YouTube QoE in operational 3G networks , 2013, PERV.

[15]  Xiapu Luo,et al.  Inferring the QoE of HTTP video streaming from user-viewing activities , 2011, W-MUST '11.

[16]  Vyas Sekar,et al.  Shedding light on the structure of internet video quality problems in the wild , 2013, CoNEXT.

[17]  Phuoc Tran-Gia,et al.  Poster: Understanding YouTube QoE in Cellular Networks with YoMoApp: A QoE Monitoring Tool for YouTube Mobile , 2015, MobiCom.

[18]  Zhuoqing Morley Mao,et al.  QoE Doctor: Diagnosing Mobile App QoE with Automated UI Control and Cross-layer Analysis , 2014, Internet Measurement Conference.

[19]  Alan C. Bovik,et al.  A time-varying subjective quality model for mobile streaming videos with stalling events , 2015, SPIE Optical Engineering + Applications.

[20]  Michael Seufert,et al.  Assessing effect sizes of influence factors towards a QoE model for HTTP adaptive streaming , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[21]  Michael Seufert,et al.  Next to You: Monitoring Quality of Experience in Cellular Networks From the End-Devices , 2016, IEEE Transactions on Network and Service Management.

[22]  Markus Fiedler,et al.  Initial delay vs. interruptions: Between the devil and the deep blue sea , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[23]  Alan C. Bovik,et al.  Study of the effects of stalling events on the quality of experience of mobile streaming videos , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[24]  Tobias Hoßfeld,et al.  Internet Video Delivery in YouTube: From Traffic Measurements to Quality of Experience , 2013, Data Traffic Monitoring and Analysis.