VideoNOC: assessing video QoE for network operators using passive measurements

Video streaming traffic is rapidly growing in mobile networks. Mobile Network Operators (MNOs) are expected to keep up with this growing demand, while maintaining a high video Quality of Experience (QoE). This makes it critical for MNOs to have a solid understanding of users' video QoE with a goal to help with network planning, provisioning and traffic management. However, designing a system to measure video QoE has several challenges: i) large scale of video traffic data and diversity of video streaming services, ii) cross-layer constraints due to complex cellular network architecture, and iii) extracting QoE metrics from network traffic. In this paper, we present VideoNOC, a prototype of a flexible and scalable platform to infer objective video QoE metrics (e.g., bitrate, rebuffering) for MNOs. We describe the design and architecture of VideoNOC, and outline the methodology to generate a novel data source for fine-grained video QoE monitoring. We then demonstrate some of the use cases of such a monitoring system. VideoNOC reveals video demand across the entire network, provides valuable insights on a number of design choices by content providers (e.g., OS-dependent performance, video player parameters like buffer size, range of encoding bitrates, etc.) and helps analyze the impact of network conditions on video QoE (e.g., mobility and high demand).

[1]  Josep Sanjuàs-Cuxart,et al.  Analysis of YouTube user experience from passive measurements , 2013, Proceedings of the 9th International Conference on Network and Service Management (CNSM 2013).

[2]  Niklas Carlsson,et al.  BUFFEST: Predicting Buffer Conditions and Real-time Requirements of HTTP(S) Adaptive Streaming Clients , 2017, MMSys.

[3]  Tim Dierks,et al.  The Transport Layer Security (TLS) Protocol Version 1.2 , 2008 .

[4]  Ali C. Begen,et al.  What happens when HTTP adaptive streaming players compete for bandwidth? , 2012, NOSSDAV '12.

[5]  Martino Trevisan,et al.  PAIN: A Passive Web Speed Indicator for ISPs , 2017, Internet-QoE@SIGCOMM.

[6]  Ellen W. Zegura,et al.  MIMIC: Using passive network measurements to estimate HTTP-based adaptive video QoE metrics , 2017, 2017 Network Traffic Measurement and Analysis Conference (TMA).

[7]  Shobha Venkataraman,et al.  Speed testing without speed tests: estimating achievable download speed from passive measurements , 2010, IMC '10.

[8]  Jeffrey Pang,et al.  Can you GET me now?: estimating the time-to-first-byte of HTTP transactions with passive measurements , 2012, IMC '12.

[9]  Konstantina Papagiannaki,et al.  Measuring Video QoE from Encrypted Traffic , 2016, Internet Measurement Conference.

[10]  Jaideep Chandrashekar,et al.  Predicting user dissatisfaction with Internet application performance at end-hosts , 2013, 2013 Proceedings IEEE INFOCOM.

[11]  Shichang Xu,et al.  Dissecting VOD services for cellular: performance, root causes and best practices , 2017, Internet Measurement Conference.

[12]  Lea Skorin-Kapov,et al.  A machine learning approach to classifying YouTube QoE based on encrypted network traffic , 2017, Multimedia Tools and Applications.

[13]  Mung Chiang,et al.  A scheduling framework for adaptive video delivery over cellular networks , 2013, MobiCom.

[14]  Ali C. Begen,et al.  An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP , 2011, MMSys.

[15]  Vyas Sekar,et al.  Improving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE , 2012, CoNEXT '12.

[16]  K. K. Ramakrishnan,et al.  Over the top video: the gorilla in cellular networks , 2011, IMC '11.

[17]  Srinivasan Seshan,et al.  Developing a predictive model of quality of experience for internet video , 2013, SIGCOMM.

[18]  Marco Mellia,et al.  An Educated Guess on QoE in Operational Networks through Large-Scale Measurements , 2016, Internet-QoE '16.

[19]  Srinivasan Seshan,et al.  Modeling web quality-of-experience on cellular networks , 2014, MobiCom.

[20]  Fang Hao,et al.  Measurement Study of Netflix, Hulu, and a Tale of Three CDNs , 2015, IEEE/ACM Transactions on Networking.

[21]  Fang Hao,et al.  Unreeling netflix: Understanding and improving multi-CDN movie delivery , 2012, 2012 Proceedings IEEE INFOCOM.

[22]  Niklas Carlsson,et al.  Helping Hand or Hidden Hurdle: Proxy-Assisted HTTP-Based Adaptive Streaming Performance , 2013, 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems.

[23]  Kuan-Ta Chen,et al.  OneClick: A Framework for Measuring Network Quality of Experience , 2009, IEEE INFOCOM 2009.

[24]  Tobias Hoßfeld,et al.  Passive YouTube QoE Monitoring for ISPs , 2012, 2012 Sixth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[25]  Partha Kanuparthy,et al.  Performance Characterization of a Commercial Video Streaming Service , 2016, Internet Measurement Conference.

[26]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[27]  Shobha Venkataraman,et al.  Prometheus: toward quality-of-experience estimation for mobile apps from passive network measurements , 2014, HotMobile.

[28]  Harish Viswanathan,et al.  Optimization of HTTP adaptive streaming over mobile cellular networks , 2013, 2013 Proceedings IEEE INFOCOM.

[29]  Vyas Sekar,et al.  Shedding light on the structure of internet video quality problems in the wild , 2013, CoNEXT.

[30]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.

[31]  Jaideep Chandrashekar,et al.  Characterizing Client Behavior of Commercial Mobile Video Streaming Services , 2014, MoVid@MMSys.

[32]  Ivica Rimac,et al.  Adaptive streaming: The network HAS to help , 2011, Bell Labs Technical Journal.

[33]  Ning Xia,et al.  Inside the bird's nest: measurements of large-scale live VoD from the 2008 olympics , 2009, IMC '09.

[34]  Sujit Dey,et al.  Deriving and Validating User Experience Model for DASH Video Streaming , 2015, IEEE Transactions on Broadcasting.