Too Late for Playback: Estimation of Video Stream Quality in Rural and Urban Contexts

The explosion of mobile broadband as an essential means of Internet connectivity has made the scalable evaluation and inference of quality of experience (QoE) for applications delivered over LTE networks critical. However, direct QoE measurement can be time and resource intensive. Further, the wireless nature of LTE networks necessitates that QoE be evaluated in multiple locations per base station as factors such as signal availability may have significant spatial variation. Based on our observations that quality of service (QoS) metrics are less time and resource-intensive to collect, we investigate how QoS can be used to infer QoE in LTE networks. Using an extensive, novel dataset representing a variety of network conditions, we design several state-of-the-art predictive models for scalable video QoE inference. We demonstrate that our models can accurately predict rebuffering events and resolution switching more than 80% of the time, despite the dataset exhibiting vastly different QoS and QoE profiles for the location types. We also illustrate that our classifiers have a high degree of generalizability across multiple videos from a vast array of genres. Finally, we highlight the importance of lowcost QoS measurements such as reference signal received power (RSRP) and throughput in QoE inference through an ablation study.

[1]  Ellen W. Zegura,et al.  Evaluating LTE Coverage and Quality from an Unmanned Aircraft System , 2019, 2019 IEEE 16th International Conference on Mobile Ad Hoc and Sensor Systems (MASS).

[2]  Ning Ding,et al.  Smartphone Energy Drain in the Wild , 2015, SIGMETRICS.

[3]  Nick Feamster,et al.  Inferring Streaming Video Quality from Encrypted Traffic: Practical Models and Deployment Experience , 2019, SIGMETRICS Perform. Evaluation Rev..

[4]  Athina Markopoulou,et al.  City-Wide Signal Strength Maps: Prediction with Random Forests , 2019, WWW.

[5]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[6]  Katherine Guo,et al.  Requet: real-time QoE detection for encrypted YouTube traffic , 2019, MMSys.

[7]  Karan Mitra,et al.  Analysis and Estimation of Video QoE in Wireless Cellular Networks using Machine Learning , 2019, 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX).

[8]  Elizabeth M. Belding-Royer,et al.  MPTCP Performance over Heterogenous Subpaths , 2019, 2019 28th International Conference on Computer Communication and Networks (ICCCN).

[9]  Patikorn Anchuen,et al.  Investigation into User-Centric QoE and Network-Centric Parameters for YouTube Service on Mobile Networks , 2019, ICCBN 2019.

[10]  Konstantina Papagiannaki,et al.  Measuring Video QoE from Encrypted Traffic , 2016, Internet Measurement Conference.

[11]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[12]  Phuoc Tran-Gia,et al.  Predicting QoE in cellular networks using machine learning and in-smartphone measurements , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[13]  Ellen W. Zegura,et al.  eMIMIC: Estimating HTTP-Based Video QoE Metrics from Encrypted Network Traffic , 2018, 2018 Network Traffic Measurement and Analysis Conference (TMA).

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Nermin Goran,et al.  Mathematical Bottom-to-Up Approach in Video Quality Estimation Based on PHY and MAC Parameters , 2017, IEEE Access.

[16]  Ellen W. Zegura,et al.  MIMIC: Using passive network measurements to estimate HTTP-based adaptive video QoE metrics , 2017, 2017 Network Traffic Measurement and Analysis Conference (TMA).

[17]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Tiago Rosa Maria Paula Queluz,et al.  A Survey on QoE-oriented Wireless Resources Scheduling , 2017, J. Netw. Comput. Appl..

[19]  Is-Haka Mkwawa,et al.  The impact of the reference signal received power to quality of experience for video streaming over LTE network , 2017, 2017 Annual Conference on New Trends in Information & Communications Technology Applications (NTICT).

[20]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[21]  Michael Seufert,et al.  You Tube QoE Monitoring with YoMoApp: A Web-Based Data Interface for Researchers , 2018, 2018 Network Traffic Measurement and Analysis Conference (TMA).

[22]  Jasmina Baraković Husić,et al.  Machine learning-based QoE prediction for video streaming over LTE network , 2018, 2018 17th International Symposium INFOTEH-JAHORINA (INFOTEH).

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Skoudarli Abdellah,et al.  QoS and QoE for mobile video service over 4G LTE network , 2017, 2017 Computing Conference.

[25]  Seong Gon Choi,et al.  A study on a QoS/QoE correlation model for QoE evaluation on IPTV service , 2010, 2010 The 12th International Conference on Advanced Communication Technology (ICACT).

[26]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[27]  Elizabeth M. Belding-Royer,et al.  #Outage: Detecting Power and Communication Outages from Social Networks , 2020, WWW.

[28]  Michael Seufert,et al.  Assessing effect sizes of influence factors towards a QoE model for HTTP adaptive streaming , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[29]  End-to-end quality adaptation scheme based on QoE prediction for video streaming service in LTE networks , 2013, 2013 11th International Symposium and Workshops on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks (WiOpt).

[30]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[31]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[32]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[33]  Niklas Carlsson,et al.  BUFFEST: Predicting Buffer Conditions and Real-time Requirements of HTTP(S) Adaptive Streaming Clients , 2017, MMSys.

[34]  Lea Skorin-Kapov,et al.  A machine learning approach to classifying YouTube QoE based on encrypted network traffic , 2017, Multimedia Tools and Applications.

[35]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[36]  Ellen W. Zegura,et al.  Packet-level Overload Estimation in LTE Networks using Passive Measurements , 2019, Internet Measurement Conference.

[37]  G. Box,et al.  Distribution of Residual Autocorrelations in Autoregressive-Integrated Moving Average Time Series Models , 1970 .

[38]  Yanjiao Chen,et al.  From QoS to QoE: A Tutorial on Video Quality Assessment , 2015, IEEE Communications Surveys & Tutorials.

[39]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[40]  Andra Lutu,et al.  Open video datasets over operational mobile networks with MONROE , 2018, MMSys.

[41]  Michael I. Jordan Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[42]  Mathias Bärtl,et al.  YouTube channels, uploads and views , 2018 .