A Software Platform Design for Objective Video QoE Assessment

Along with the rapid development of 3G and 4G technologies, mobile video services have gained its popularity among users around the world. Consequently, Content Providers (CPs), Service Providers (SPs), and especially, the operators are paying increasing attentions to the quality of experience (QoE) of the video services which could be easily affected by the quality of network. In this paper, a novel real-time objective video QoE assessment method is proposed and a software assessment system is built to test the video service quality in the real network. Firstly, in the test terminals, the QoE measurement of the entire video services is conducted by collecting all of the customers’ experience in full-reference method, and then the QoE scores are evaluated through an accurate mathematic model. Secondly, the artifact of compression caused by video encoding should also be taken into account. Model in this part adopts no-reference method in consideration of the varied screen sizes in different terminals. What’s more, the platform also evaluates the error of network in the part of video transmission by associating no-reference PSNR with network delay, jitter, and packet loss ratio. The results of Mean Opinion Score (MOS) tests show that the proposed models estimate QoE with high quality estimation accuracy respectively. We develop a software toolkit using the test methodologies above, which can help the operators to make measurements for its network. This software toolkit is useful as a QoE monitoring tool on video streaming services and can be deployed on real network conveniently

[1]  Chao Sun,et al.  A Novel Full-reference Video Quality Assessment Metric for Multimedia Broadcasting Systems , 2012, J. Mobile Multimedia.

[2]  Hongwen Yang,et al.  Performance Evaluation and Accuracy Upgrading of PESQ in Chinese Environment , 2013, 2013 IEEE 77th Vehicular Technology Conference (VTC Spring).

[3]  Dacheng Yang,et al.  QoE-based evaluation model on video streaming service quality , 2012, 2012 IEEE Globecom Workshops.

[4]  Bo Yang,et al.  Blockiness evaluation for reducing blocking artifacts in compressed images , 2009, 2009 Digest of Technical Papers International Conference on Consumer Electronics.

[5]  Rocky K. C. Chang,et al.  Measuring the quality of experience of HTTP video streaming , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[6]  Jun Okamoto,et al.  No reference video-quality-assessment model for video streaming services , 2010, 2010 18th International Packet Video Workshop.

[7]  Seong Gon Choi,et al.  A study on a QoS/QoE correlation model for QoE evaluation on IPTV service , 2010, 2010 The 12th International Conference on Advanced Communication Technology (ICACT).

[8]  Methodology for the subjective assessment of video quality in multimedia applications ( Question , 2007 .

[9]  Hongyu Wang,et al.  Bit Stream Extraction Based on Video Content Method in the Scalable Extension of H.264/AVC , 2011, J. Softw..

[10]  Peter Lambert,et al.  Assessing Quality of Experience of IPTV and Video on Demand Services in Real-Life Environments , 2010, IEEE Transactions on Broadcasting.

[11]  Yalin Wu,et al.  An Adaptive Rate Control Initialization Method for H.264 at Low Bit Rate , 2013, J. Softw..

[12]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[13]  C. Ahlund,et al.  QoE estimation and prediction using hidden Markov models in heterogeneous access networks , 2012, Australasian Telecommunication Networks and Applications Conference (ATNAC) 2012.

[14]  Arnd Eden.  No-Reference Estimation of the Coding PSNR for H.264-Coded Sequences , 2007, IEEE Transactions on Consumer Electronics.

[15]  Peter Brooks,et al.  User measures of quality of experience: why being objective and quantitative is important , 2010, IEEE Network.

[16]  O. Oyman,et al.  Quality of experience for HTTP adaptive streaming services , 2012, IEEE Communications Magazine.