eMIMIC: Estimating HTTP-Based Video QoE Metrics from Encrypted Network Traffic

Understanding the user-perceived Quality of Experience (QoE) of HTTP-based video has become critical for content providers, distributors, and network operators. For network operators, monitoring QoE is challenging due to lack of access to video streaming applications, user devices, or servers. Thus, network operators need to rely on the network traffic to infer key metrics that influence video QoE. Furthermore, with content providers increasingly encrypting the network traffic, the task of QoE inference from passive measurements has become even more challenging. In this paper, we present a methodology called eMIMIC that uses passive network measurements to estimate key video QoE metrics for encrypted HTTP-based Adaptive Streaming (HAS) sessions. eMIMIC uses packet headers from network traffic to model a HAS session and estimate video QoE metrics such as average bitrate and re-buffering ratio. We evaluate our methodology using network traces from a variety of realistic conditions and ground truth of two popular video streaming services collected using a lab testbed. eMIMIC estimates re-buffering ratio within 1 percentage point of ground truth for up to 70% sessions and average bitrate with error under 100 kbps for up to 80% sessions. We also compare eMIMIC with recently proposed machine learning-based QoE estimation methodology. We show that eMIMIC can predict average bitrate with 2.8%-3.2% higher accuracy and re-buffering ratio with 9.8%-24.8% higher accuracy without requiring any training on ground truth QoE metrics.

[1]  Ellen W. Zegura,et al.  MIMIC: Using passive network measurements to estimate HTTP-based adaptive video QoE metrics , 2017, 2017 Network Traffic Measurement and Analysis Conference (TMA).

[2]  Tobias Hoßfeld,et al.  Passive YouTube QoE Monitoring for ISPs , 2012, 2012 Sixth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[3]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[4]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[5]  Shobha Venkataraman,et al.  Prometheus: toward quality-of-experience estimation for mobile apps from passive network measurements , 2014, HotMobile.

[6]  Dirk Staehle,et al.  QoE-Based Traffic and Resource Management for Adaptive HTTP Video Delivery in LTE , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Rittwik Jana,et al.  VideoNOC: assessing video QoE for network operators using passive measurements , 2018, MMSys.

[8]  Josep Sanjuàs-Cuxart,et al.  Analysis of YouTube user experience from passive measurements , 2013, Proceedings of the 9th International Conference on Network and Service Management (CNSM 2013).

[9]  Andrew Hintz,et al.  Fingerprinting Websites Using Traffic Analysis , 2002, Privacy Enhancing Technologies.

[10]  Mostafa H. Ammar,et al.  Network-layer fairness for adaptive video streams , 2015, 2015 IFIP Networking Conference (IFIP Networking).

[11]  Carsten Griwodz,et al.  Video streaming using a location-based bandwidth-lookup service for bitrate planning , 2012, TOMCCAP.

[12]  Konstantina Papagiannaki,et al.  Measuring Video QoE from Encrypted Traffic , 2016, Internet Measurement Conference.

[13]  Lea Skorin-Kapov,et al.  A machine learning approach to classifying YouTube QoE based on encrypted network traffic , 2017, Multimedia Tools and Applications.

[14]  Niklas Carlsson,et al.  BUFFEST: Predicting Buffer Conditions and Real-time Requirements of HTTP(S) Adaptive Streaming Clients , 2017, MMSys.

[15]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2012, IEEE/ACM Transactions on Networking.

[16]  Srinivasan Seshan,et al.  Developing a predictive model of quality of experience for internet video , 2013, SIGCOMM.

[17]  Filip De Turck,et al.  HTTP/2-Based Adaptive Streaming of HEVC Video Over 4G/LTE Networks , 2016, IEEE Communications Letters.

[18]  Sujit Dey,et al.  Deriving and Validating User Experience Model for DASH Video Streaming , 2015, IEEE Transactions on Broadcasting.