A survey on parametric QoE estimation for popular services

Abstract As we are moving forward to the 5G era, we are witnessing a transformation in the way networks are designed and behave, with the end-user placed at the epicenter of any decision. One of the most promising contributors towards this direction is the shift from Quality of Service (QoS) to Quality of Experience (QoE) service provisioning paradigms. QoE, i.e., the degree of delight or annoyance of a service as this is perceived by the end-user, paves the way for flexible service management and personalized quality monitoring. This is enabled by exploiting parametric QoE assessment models, namely specific formula-based QoE estimation methods. In this paper, recognizing a gap in the literature between the lack of a proper manual regarding the objective QoE estimation and the ever increasing interest from network stakeholders for QoE intelligence, we provide a comprehensive guide to standardized and state-of-the-art quality assessment models. More specifically, we identify and describe parametric QoE formulas for the most popular service types (i.e., VoIP, online video, video streaming, web browsing, Skype, IPTV and file download services), indicating the key performance indicators (KPIs) and major configuration parameters (MCPs) per type. Throughout the paper, it is revealed that KPIs and MCPs are highly variant per service type, and that, even for the same service, different factors contribute with a different weight on the perceived QoE. This finding can strongly enable a more meaningful resource provisioning across different applications compared to QoE-agnostic schemes. Overall, this paper is a stand-alone, self-contained repository of QoE assessment models for the most common applications, becoming a handy tutorial to parties interested in delving more into QoE network management topics.

[1]  Tobias Hoßfeld,et al.  SOS: The MOS is not enough! , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[2]  Tobias Hoßfeld,et al.  Monitoring YouTube QoE: Is Your Mobile Network Delivering the Right Experience to your Customers? , 2013, 2013 IEEE Wireless Communications and Networking Conference (WCNC).

[3]  Gerardo Rubino,et al.  Automatic quality of experience measuring on video delivering networks , 2008, PERV.

[4]  Xiaodong Lin,et al.  User-provided networking for QoE provisioning in mobile networks , 2015, IEEE Wireless Communications.

[5]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[6]  METHODS FOR SUBJECTIVE DETERMINATION OF TRANSMISSION QUALITY Summary , 2022 .

[7]  Olga Galinina,et al.  Predicting user QoE satisfaction in current mobile networks , 2014, 2014 IEEE International Conference on Communications (ICC).

[8]  John Woods,et al.  Survey on QoE\QoS Correlation Models For Multimedia Services , 2013, ArXiv.

[9]  José C. López-Ardao,et al.  Enhancements to the opinion model for video-telephony applications , 2009, LANC.

[10]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[11]  Marília Curado,et al.  A quality of experience handover system for heterogeneous multimedia wireless networks , 2013, 2013 International Conference on Computing, Networking and Communications (ICNC).

[12]  Guy Pujolle,et al.  Quality of Experience of VoIP Service: A Survey of Assessment Approaches and Open Issues , 2012, IEEE Communications Surveys & Tutorials.

[13]  Deep Medhi,et al.  Measurement of Quality of Experience of Video-on-Demand Services: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[14]  Lingfen Sun,et al.  Quality of experience-driven adaptation scheme for video applications over wireless networks , 2010, IET Commun..

[15]  Lazaros F. Merakos,et al.  Quality of experience management in mobile cellular networks: key issues and design challenges , 2015, IEEE Communications Magazine.

[16]  Kuan-Ta Chen,et al.  OneClick: A Framework for Measuring Network Quality of Experience , 2009, IEEE INFOCOM 2009.

[17]  Lingfen Sun,et al.  Content Clustering Based Video Quality Prediction Model for MPEG4 Video Streaming over Wireless Networks , 2009, 2009 IEEE International Conference on Communications.

[18]  Tobias Hoßfeld,et al.  From Packets to People: Quality of Experience as a New Measurement Challenge , 2013, Data Traffic Monitoring and Analysis.

[19]  Wolfgang Kellerer,et al.  QoE-Driven Cross-Layer Optimization for High Speed Downlink Packet Access , 2009, J. Commun..

[20]  Hongke Zhang,et al.  An Optimization-Based Scheme for Efficient Virtual Machine Placement , 2013, International Journal of Parallel Programming.

[21]  Robert G. Cole,et al.  Voice over IP performance monitoring , 2001, CCRV.

[22]  Henning Schulzrinne,et al.  Towards QoE-aware video streaming using SDN , 2014, 2014 IEEE Global Communications Conference.

[23]  Preben E. Mogensen,et al.  QoE oriented cross-layer design of a resource allocation algorithm in beyond 3G systems , 2010, Comput. Commun..

[24]  Phuoc Tran-Gia,et al.  Best Practices for QoE Crowdtesting: QoE Assessment With Crowdsourcing , 2014, IEEE Transactions on Multimedia.

[25]  Tobias Hoßfeld,et al.  Internet Video Delivery in YouTube: From Traffic Measurements to Quality of Experience , 2013, Data Traffic Monitoring and Analysis.

[26]  Lazaros F. Merakos,et al.  The Need for QoE-driven Interference Management in Femtocell-Overlaid Cellular Networks , 2013, MobiQuitous.

[27]  Sebastian Möller,et al.  Speech Quality Estimation: Models and Trends , 2011, IEEE Signal Processing Magazine.

[28]  Tarcisio F. Maciel,et al.  Radio resource allocation framework for quality of experience optimization in wireless networks , 2015, IEEE Network.

[29]  Yanjiao Chen,et al.  From QoS to QoE: A Tutorial on Video Quality Assessment , 2015, IEEE Communications Surveys & Tutorials.

[30]  Vincent Barriac,et al.  Standardization activities in the ITU for a QoE assessment of IPTV , 2008, IEEE Communications Magazine.

[31]  Péter Szilágyi,et al.  Network side lightweight and scalable YouTube QoE estimation , 2015, 2015 IEEE International Conference on Communications (ICC).

[32]  Maria Papadopouli,et al.  On User-Centric Modular QoE Prediction for VoIP Based on Machine-Learning Algorithms , 2016, IEEE Transactions on Mobile Computing.

[33]  Phuoc Tran-Gia,et al.  Investigation of Different Approaches for QoE-Oriented Scheduling in OFDMA Networks , 2013, MONAMI.

[34]  Michael Seufert,et al.  Assessing effect sizes of influence factors towards a QoE model for HTTP adaptive streaming , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[35]  Andrej Kos,et al.  An approach to modeling and control of QoE in next generation networks [Next Generation Telco IT Architectures] , 2010, IEEE Communications Magazine.