ViCrypt to the Rescue: Real-Time, Machine-Learning-Driven Video-QoE Monitoring for Encrypted Streaming Traffic

Video streaming is the killer application of the Internet today. In this article, we address the problem of real-time, passive Quality-of-Experience (QoE) monitoring of HTTP Adaptive Video Streaming (HAS), from the Internet-Service-Provider (ISP) perspective – i.e., relying exclusively on in-network traffic measurements. Given the wide adoption of end-to-end encryption, we resort to machine-learning (ML) models to estimate multiple key video-QoE indicators (KQIs) from the analysis of the encrypted traffic. We present ViCrypt, an ML-driven monitoring solution able to infer the most important KQIs for HTTP Adaptive Streaming (HAS), namely stalling, initial delay, video resolution, and average video bitrate. ViCrypt performs estimations in real-time, during the playback of an ongoing video-streaming session, with a fine-grained temporal resolution of just one second. For this, it relies on lightweight, stream-like features continuously extracted from the encrypted stream of packets. Empirical evaluations on a large and heterogeneous corpus of YouTube measurements show that ViCrypt can infer the targeted KQIs with high accuracy, enabling large-scale passive video-QoE monitoring and proactive QoE-aware traffic management. Different from the state of the art, and besides real-time operation, ViCrypt is not bound to coarse-grained KQI-classes, providing better and sharper insights than other solutions. Finally, ViCrypt does not require chunk-detection approaches for feature extraction, significantly reducing the complexity of the monitoring approach, and potentially improving on generalization to different HAS protocols used by other video-streaming services such as Netflix and Amazon.

[1]  Michael Seufert,et al.  Impact of intermediate layer on quality of experience of HTTP adaptive streaming , 2015, 2015 11th International Conference on Network and Service Management (CNSM).

[2]  Blazej Lewcio,et al.  Video quality in next generation mobile networks — Perception of time-varying transmission , 2011, 2011 IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR).

[3]  Pedro Casas,et al.  Machine Learning Models for YouTube QoE and User Engagement Prediction in Smartphones , 2019, SIGMETRICS Perform. Evaluation Rev..

[4]  Shobha Venkataraman,et al.  Prometheus: toward quality-of-experience estimation for mobile apps from passive network measurements , 2014, HotMobile.

[5]  Phuoc Tran-Gia,et al.  YoMoApp: A tool for analyzing QoE of YouTube HTTP adaptive streaming in mobile networks , 2015, 2015 European Conference on Networks and Communications (EuCNC).

[6]  Michael L. Littman,et al.  Online Linear Regression and Its Application to Model-Based Reinforcement Learning , 2007, NIPS.

[7]  Michael Seufert Quality of experience and access network traffic management of HTTP adaptive video streaming , 2018, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium.

[8]  Zubair Shafiq,et al.  Real-time Video Quality of Experience Monitoring for HTTPS and QUIC , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[9]  Pedro Casas,et al.  A Fair Share for All: TCP-Inspired Adaptation Logic for QoE Fairness Among Heterogeneous HTTP Adaptive Video Streaming Clients , 2019, IEEE Transactions on Network and Service Management.

[10]  Ragnhild Eg,et al.  Flicker effects in adaptive video streaming to handheld devices , 2011, ACM Multimedia.

[11]  Fei Wang,et al.  HAS QoE prediction based on dynamic video features with data mining in LTE network , 2015, Science China Information Sciences.

[12]  Michael Seufert,et al.  YOUQMON: a system for on-line monitoring of YouTube QoE in operational 3G networks , 2013, PERV.

[13]  Ellen W. Zegura,et al.  eMIMIC: Estimating HTTP-Based Video QoE Metrics from Encrypted Network Traffic , 2018, 2018 Network Traffic Measurement and Analysis Conference (TMA).

[14]  Truong Cong Thang,et al.  A novel quality model for HTTP adaptive streaming , 2016, 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE).

[15]  Adam Wolisz,et al.  Simulation Framework for HTTP-Based Adaptive Streaming Applications , 2017, WNS3.

[16]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[17]  Konstantina Papagiannaki,et al.  Measuring Video QoE from Encrypted Traffic , 2016, Internet Measurement Conference.

[18]  Pierre Geurts,et al.  Supervised learning with decision tree-based methods in computational and systems biology. , 2009, Molecular bioSystems.

[19]  Alan C. Bovik,et al.  A time-varying subjective quality model for mobile streaming videos with stalling events , 2015, SPIE Optical Engineering + Applications.

[20]  Kai Zeng,et al.  Quality-of-experience of streaming video: Interactions between presentation quality and playback stalling , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[21]  Markus Fiedler,et al.  Waiting times in quality of experience for web based services , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[22]  Niklas Carlsson,et al.  BUFFEST: Predicting Buffer Conditions and Real-time Requirements of HTTP(S) Adaptive Streaming Clients , 2017, MMSys.

[23]  Michael Seufert,et al.  I See What you See: Real Time Prediction of Video Quality from Encrypted Streaming Traffic , 2019, Internet-QoE'19.

[24]  Özgü Alay,et al.  Concept and implementation of video QoE measurements in a mobile broadband testbed , 2017, 2017 Network Traffic Measurement and Analysis Conference (TMA).

[25]  Michael Seufert,et al.  Assessing effect sizes of influence factors towards a QoE model for HTTP adaptive streaming , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[26]  Philippe Pierre Pebay,et al.  Formulas for robust, one-pass parallel computation of covariances and arbitrary-order statistical moments. , 2008 .

[27]  Michael Seufert,et al.  Next to You: Monitoring Quality of Experience in Cellular Networks From the End-Devices , 2016, IEEE Transactions on Network and Service Management.

[28]  Lea Skorin-Kapov,et al.  YouTube QoE Estimation Based on the Analysis of Encrypted Network Traffic Using Machine Learning , 2016, 2016 IEEE Globecom Workshops (GC Wkshps).

[29]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[30]  Phuoc Tran-Gia,et al.  Predicting QoE in cellular networks using machine learning and in-smartphone measurements , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[31]  Christian Timmerer,et al.  Which Adaptation Logic? An Objective and Subjective Performance Evaluation of HTTP-based Adaptive Media Streaming Systems , 2016, ArXiv.

[32]  Michael Seufert,et al.  A Public Dataset for YouTube's Mobile Streaming Client , 2018, 2018 Network Traffic Measurement and Analysis Conference (TMA).

[33]  Li Gang,et al.  Stream-based Machine Learning for Real-time QoE Analysis of Encrypted Video Streaming Traffic , 2019, 2019 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN).

[34]  Tobias Hoßfeld,et al.  Passive YouTube QoE Monitoring for ISPs , 2012, 2012 Sixth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[35]  Gil Zussman,et al.  Requet: Real-Time QoE Metric Detection for Encrypted YouTube Traffic , 2020 .

[36]  O. Oyman,et al.  Quality of experience for HTTP adaptive streaming services , 2012, IEEE Communications Magazine.

[37]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[38]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[39]  Michael Seufert,et al.  Features that Matter: Feature Selection for On-line Stalling Prediction in Encrypted Video Streaming , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).