A QoE Inference Method for DASH Video Using ICMP Probing

An increase of Video on Demand (VoD) consumption has occurred in recent years. Delivering high Quality of Experience (QoE) for users consuming VoD is crucial. Many methods were proposed to estimate QoE based on network metrics, or to obtain direct feedback from video players. Recent proposals usually require monitoring tools installed in multiple network nodes, instrumentation of client devices, updates on existing network elements, among others. We propose a method based on Internet Control Message Protocol (ICMP) probing to estimate QoE for users consuming VoD. The method allows network operators to estimate which QoE level can be delivered to the user according to current network conditions using a Machine Learning (ML) model. Our method does not require installation of software at different network nodes, relying on ICMP probing which is widely supported by existing devices. Our QoE inference model estimates Mean Opinion Score (MOS) with Root Mean Square Error (RMSE) of 0.98, with additional 27 Kbps of traffic during probing. We evaluate the model’s generalization capacity when estimating QoE for videos different from the one used for training, which can speed up model’s creation process. In those cases MOS was estimated with RMSE of 1.01.

[1]  Koenraad Laevens,et al.  Session reconstruction for HTTP adaptive streaming: Laying the foundation for network-based QoE monitoring , 2012, 2012 IEEE 20th International Workshop on Quality of Service.

[2]  Luciano Paschoal Gaspary,et al.  Network Fortune Cookie: Using Network Measurements to Predict Video Streaming Performance and QoE , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[3]  Dario Pompili,et al.  Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and Challenges , 2016, IEEE Communications Magazine.

[4]  Ali C. Begen,et al.  Enhancing MPEG DASH performance via server and network assistance , 2017 .

[5]  Maria G. Martini,et al.  QoE Modeling for HTTP Adaptive Video Streaming–A Survey and Open Challenges , 2019, IEEE Access.

[6]  Ning Wang,et al.  Real-time QoE estimation of DASH-based mobile video applications through edge computing , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[7]  Will Reese,et al.  Nginx: the high-performance web server and reverse proxy , 2008 .

[8]  Alexander Raake,et al.  HTTP adaptive streaming QoE estimation with ITU-T rec. P. 1203: open databases and software , 2018, MMSys.

[9]  Muhammad Jawad Khokhar,et al.  From Network Traffic Measurements to QoE for Internet Video , 2019, 2019 IFIP Networking Conference (IFIP Networking).

[10]  Abdelhamid Mellouk,et al.  Statistical evaluation for quality of experience prediction based on quality of service parameters , 2016, 2016 23rd International Conference on Telecommunications (ICT).

[11]  Deep Medhi,et al.  Measurement of Quality of Experience of Video-on-Demand Services: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[12]  Luigi Atzori,et al.  QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey , 2019, IEEE Communications Surveys & Tutorials.

[13]  Anja Feldmann,et al.  Pushing CDN-ISP collaboration to the limit , 2013, CCRV.

[14]  Alexander Raake,et al.  A bitstream-based, scalable video-quality model for HTTP adaptive streaming: ITU-T P.1203.1 , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[15]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[16]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[17]  Vinicius Tavares Guimaraes,et al.  UAMA: a unified architecture for active measurements in IP networks; End-to-end objetive quality indicators , 2007, 2007 10th IFIP/IEEE International Symposium on Integrated Network Management.

[18]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..