Moving QoE for monitoring DASH video streaming: models and a study of multiple mobile clients

Objective Quality of Experience (QoE) for Dynamic Adaptive Streaming over HTTP (DASH) video streaming has received considerable attention in recent years. While there are a number of objective QoE models, a limitation of the current models is that the QoE is provided after the entire video is delivered; also, the models are on a per client basis. For content service providers, QoE observed is important to monitor to understand ensemble performance during streaming such as for live events or concurrent streaming when multiple clients are streaming. For this purpose, we propose Moving QoE (MQoE, in short) models to measure QoE during periodically during video streaming for multiple simultaneous clients. Our first model MQoE_RF is a nonlinear model considering the bitrate gain and sensitivity from bitrate switching frequency. Our second model MQoE_SD is a linear model that focuses on capturing the standard deviation in the bitrate switching magnitude among segments along with the bitrate gain. We then study the effectiveness of both models in a multi-user mobile client environment, with the mobility patterns being based on traces from a train, a car, or a ferry. We implemented the study on the GENI testbed. Our study shows that our MQoE models are more accurate in capturing the QoE behavior during transmission than static QoE models. Furthermore, our MQoE_RF model captures the sensitivity due to bitrate switching frequency more effectively while MQoE_SD captures the sensitivity due to the magnitude of the bitrate switching. Either models are suitable for content service providers for monitoring video streaming based on their preference.

[1]  Yao Wang,et al.  Assessing the visual effect of non-periodic temporal variation of quantization stepsize in compressed video , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[2]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[3]  Truong Cong Thang,et al.  A novel quality model for HTTP adaptive streaming , 2016, 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE).

[4]  Publisher's Note , 2018, Anaesthesia.

[5]  Lea Skorin-Kapov,et al.  Optimal Fairness and Quality in Video Streaming with Multiple Users , 2018, 2018 30th International Teletraffic Congress (ITC 30).

[6]  Ralf Steinmetz,et al.  Layer-encoded video in scalable adaptive streaming , 2005, IEEE Transactions on Multimedia.

[7]  Markus Fiedler,et al.  Quality of Experience from user and network perspectives , 2010, Ann. des Télécommunications.

[8]  Danny De Vleeschauwer,et al.  Model for estimating QoE of video delivered using HTTP adaptive streaming , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[9]  Viswanathan Swaminathan,et al.  Low Latency Live Video Streaming over HTTP 2.0 , 2014, NOSSDAV.

[10]  Gerardo Rubino,et al.  Quality of experience estimation for adaptive HTTP/TCP video streaming using H.264/AVC , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[11]  Emir Halepovic,et al.  Drop the packets: using coarse-grained data to detect video performance issues , 2020, CoNEXT.

[12]  Philip Levis,et al.  Learning in situ: a randomized experiment in video streaming , 2019, NSDI.

[13]  Michael Seufert,et al.  Assessing effect sizes of influence factors towards a QoE model for HTTP adaptive streaming , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[14]  Deep Medhi,et al.  QoE for Mobile Clients with Segment-aware Rate Adaptation Algorithm (SARA) for DASH Video Streaming , 2019, ACM Trans. Multim. Comput. Commun. Appl..

[15]  Christian Timmerer,et al.  Automated QoE evaluation of Dynamic Adaptive Streaming over HTTP , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[16]  Torbjorn Einarsson,et al.  Dynamic adaptive HTTP streaming of live content , 2011, 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[17]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[18]  Srinivasan Seshan,et al.  Developing a predictive model of quality of experience for internet video , 2013, SIGCOMM.

[19]  Cong Wang,et al.  Design and Analysis of QoE-Aware Quality Adaptation for DASH , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[20]  Xiapu Luo,et al.  Inferring the QoE of HTTP video streaming from user-viewing activities , 2011, W-MUST '11.

[21]  Christian Timmerer,et al.  Live transcoding and streaming-as-a-service with MPEG-DASH , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[22]  Anastasios Kourtis,et al.  An adaptive system for real-time scalable video streaming with end-to-end QOS control , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[23]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[24]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[25]  Dong-Qing Zhang,et al.  Assessing quality of experience for adaptive HTTP video streaming , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[26]  Deep Medhi,et al.  QoE Performance for DASH Videos in a Smart Cache Environment , 2019, 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[27]  Maria G. Martini,et al.  QoE Modeling for HTTP Adaptive Video Streaming–A Survey and Open Challenges , 2019, IEEE Access.

[28]  Hermann Hellwagner,et al.  A scalable video coding dataset and toolchain for dynamic adaptive streaming over HTTP , 2015, MMSys.

[29]  Deep Medhi,et al.  Measurement of Quality of Experience of Video-on-Demand Services: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[30]  Carsten Griwodz,et al.  Commute path bandwidth traces from 3G networks: analysis and applications , 2013, MMSys.